Sep 20 01:50:37.090893 ip-10-0-135-222 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 20 01:50:37.090902 ip-10-0-135-222 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 20 01:50:37.090910 ip-10-0-135-222 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 20 01:50:37.091133 ip-10-0-135-222 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 20 01:50:47.111971 ip-10-0-135-222 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 20 01:50:47.111989 ip-10-0-135-222 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ff3ec60f191d4b4b9472ddc024c672c2 --
Sep 20 01:52:34.603093 ip-10-0-135-222 systemd[1]: Starting Kubernetes Kubelet...
Sep 20 01:52:35.026380 ip-10-0-135-222 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 01:52:35.026380 ip-10-0-135-222 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 20 01:52:35.026380 ip-10-0-135-222 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 01:52:35.026380 ip-10-0-135-222 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 20 01:52:35.026380 ip-10-0-135-222 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 01:52:35.027495 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.027413    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 20 01:52:35.035954 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035931    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 01:52:35.035954 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035950    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 01:52:35.035954 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035956    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 01:52:35.035954 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035961    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035965    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035969    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035973    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035976    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035981    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035984    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035987    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035991    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.035995    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036001    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036006    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036011    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036015    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036019    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036024    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036028    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036032    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036036    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036040    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 01:52:35.036203 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036044    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036052    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036056    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036060    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036064    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036070    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036074    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036078    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036082    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036087    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036091    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036095    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036100    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036104    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036109    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036114    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036118    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036122    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036126    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036130    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 01:52:35.036871 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036137    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036143    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036148    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036153    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036159    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036163    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036167    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036174    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036179    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036184    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036188    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036192    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036197    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036202    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036206    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036211    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036215    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036219    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036223    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036227    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 01:52:35.037369 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036232    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036236    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036240    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036245    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036249    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036254    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036259    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036263    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036267    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036272    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036276    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036280    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036284    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036289    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036293    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036299    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036305    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036310    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036314    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 01:52:35.038253 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036319    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036324    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036329    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036333    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036338    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036342    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036346    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036350    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036354    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036359    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036363    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036367    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036371    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036376    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036380    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036384    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.036389    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038432    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038444    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 01:52:35.039081 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038449    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038454    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038459    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038463    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038468    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038472    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038476    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038480    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038484    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038489    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038493    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038498    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038502    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038506    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038510    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038516    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038521    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038526    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038531    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038535    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 01:52:35.039923 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038540    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038544    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038556    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038560    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038565    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038569    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038573    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038578    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038582    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038586    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038593    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038598    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038603    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038608    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038612    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038616    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038622    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038627    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038632    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 01:52:35.040804 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038636    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038641    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038645    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038649    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038653    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038657    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038661    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038666    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038671    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038676    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038680    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038685    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038689    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038693    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038697    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038701    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038705    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038709    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038714    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038718    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 01:52:35.041622 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038722    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038726    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038730    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038735    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038739    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038743    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038747    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038751    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038755    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038759    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038764    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038769    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038773    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038778    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038782    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038803    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038810    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038814    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038822    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 01:52:35.042180 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038826    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038831    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038835    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038840    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038845    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038849    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038854    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038858    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038862    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038866    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038871    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038875    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038881    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038886    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038891    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038896    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038900    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038905    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.038909    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039481    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 01:52:35.042696 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039489    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039494    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039499    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039503    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039507    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039511    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039516    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039520    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039529    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039533    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039538    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039543    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039547    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039551    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039555    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039561    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039565    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039569    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039573    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 01:52:35.043293 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039578    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039582    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039586    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039590    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039594    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039599    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039602    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039606    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039611    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039615    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039619    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039623    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039628    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039632    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039637    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039641    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039646    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039651    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039656    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039660    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 01:52:35.043932 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039664    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039670    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039674    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039681    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039687    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039692    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039697    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039702    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039706    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039712    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039717    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039721    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039727    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039733    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039738    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039743    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039748    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039752    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039756    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 01:52:35.044421 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039761    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039765    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039769    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039773    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039777    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039781    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039802    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039807    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039811    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039815    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039820    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039824    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039828    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039832    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039838    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039842    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039846    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039850    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039854    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039861    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 01:52:35.044975 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039865    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039870    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039874    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039879    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039883    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039888    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039892    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039896    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039901    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039905    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039909    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039913    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039919    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039923    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039929    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039934    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039938    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039942    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039946    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.039950    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 01:52:35.045517 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040050    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040095    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040104    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040111    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040117    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040122    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040129    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040136    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040141    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040145    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040151    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040156    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040161    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040165    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040170    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040174    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040181    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040185    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040193    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040197    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040202    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040208    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040213    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040219    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 20 01:52:35.046025 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040225    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040230    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040235    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040241    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040246    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040250    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040255    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040260    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040266    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040271    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040276    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040280    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040285    2565 flags.go:64] FLAG: --enable-server="true"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040289    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040297    2565 flags.go:64] FLAG: --event-burst="100"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040302    2565 flags.go:64] FLAG: --event-qps="50"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040307    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040312    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040317    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040323    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040328    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040333    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040338    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040342    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040347    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 20 01:52:35.046640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040353    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040358    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040363    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040367    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040372    2565 flags.go:64] FLAG: --feature-gates=""
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040378    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040383    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040389    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040394    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040399    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040404    2565 flags.go:64] FLAG: --help="false"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040409    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040414    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040419    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040424    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040429    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040435    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040440    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040444    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040449    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040454    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040458    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040463    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040468    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 20 01:52:35.047347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040473    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040477    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040483    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040487    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040491    2565 flags.go:64] FLAG: --lock-file=""
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040496    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040501    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040506    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040514    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040520    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040524    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040529    2565 flags.go:64] FLAG: --logging-format="text"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040534    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040540    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040544    2565 flags.go:64] FLAG: --manifest-url=""
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040551    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040558    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040562    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040568    2565 flags.go:64] FLAG: --max-pods="110"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040573    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040578    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040582    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040587    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040592    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040597    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 20 01:52:35.048027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040601    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040612    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040617    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040622    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040627    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040631    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040640    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040645    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040650    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040654    2565 flags.go:64] FLAG: --port="10250"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040659    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040663    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd5a7b85e6ef3c26"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040668    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040673    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040678    2565 flags.go:64] FLAG: --register-node="true"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040683    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040688    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040694    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040699    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040703    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040709    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040714    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040720    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040725    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040730    2565 flags.go:64] FLAG: --runonce="false"
Sep 20 01:52:35.048689 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040735    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040739    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040744    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040748    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040753    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040758    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040762    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040767    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040772    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040777    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040782    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040801    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040808    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040813    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040818    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040826    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040830    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040835    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040843    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040847    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040852    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040857    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040861    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040866    2565 flags.go:64] FLAG: --v="2"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040873    2565 flags.go:64] FLAG: --version="false"
Sep 20 01:52:35.049340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040880    2565 flags.go:64] FLAG: --vmodule=""
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040886    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.040892    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041070    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041078    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041083    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041088    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041093    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041098    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041102    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041106    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041111    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041115    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041120    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041125    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041130    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041135    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041139    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041143    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 01:52:35.049977 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041152    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041158    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041163    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041169    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041173    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041177    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041182    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041186    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041191    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041196    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041200    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041205    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041209    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041213    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041219    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041223    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041227    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041234    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041241    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041246    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 01:52:35.050440 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041251    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041256    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041261    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041265    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041269    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041273    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041278    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041282    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041286    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041290    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041294    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041299    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041306    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041310    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041314    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041318    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041323    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041329    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041335    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041340    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 01:52:35.050978 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041347    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041351    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041355    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041360    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041364    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041368    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041372    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041377    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041382    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041388    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041393    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041397    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041402    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041406    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041410    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041415    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041419    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041423    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041427    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041431    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 01:52:35.051476 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041435    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041439    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041443    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041447    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041454    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041458    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041462    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041467    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041471    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041475    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041479    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041483    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041488    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041493    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041497    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041501    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041505    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041509    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041514    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041518    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 01:52:35.052078 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041523    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041529    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.041533    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.041541    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.049760    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.049775    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.050721    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.050728    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050783    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050800    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050804    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050807    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050810    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050813    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 01:52:35.052574 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050816    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050819    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050822    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050825    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050827    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050830    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050833    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050836    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050838    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050841    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050844    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050846    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050849    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050852    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050855    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050857    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050860    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050862    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050867    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 01:52:35.052953 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050871    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050874    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050877    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050879    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050883    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050887    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050891    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050894    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050897    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050900    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050903    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050906    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050909    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050912    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050915    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050917    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050920    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050923    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050926    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 01:52:35.053408 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050928    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050931    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050934    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050936    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050939    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050942    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050944    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050947    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050950    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050952    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050955    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050958    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050960    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050964    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050966    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050969    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050972    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050975    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050978    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050981    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 01:52:35.053904 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050984    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050986    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050989    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050992    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050995    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.050998    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051000    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051003    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051006    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051008    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051011    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051014    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051016    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051020    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051022    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051025    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051027    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051030    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051033    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051035    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 01:52:35.054388 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051038    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051040    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051043    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051046    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051048    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051051    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051053    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051056    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051059    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051062    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051067    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051070    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051073    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051076    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051079    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 01:52:35.054896 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.051084    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051188    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051193    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051197    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051201    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051204    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051207    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051210    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051214    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051217    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051220    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051223    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051226    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051228    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051231    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051233    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051236    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051239    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051241    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 01:52:35.055272 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051244    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051246    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051249    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051251    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051254    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051257    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051260    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051263    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051266    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051269    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051271    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051274    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051277    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051279    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051283    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051286    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051288    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051291    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051294    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 01:52:35.055733 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051296    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051299    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051302    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051304    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051307    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051309    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051312    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051315    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051318    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051320    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051323    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051325    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051329    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051332    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051334    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051337    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051340    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051342    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051345    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051348    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 01:52:35.056216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051352    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051356    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051360    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051362    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051365    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051368    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051370    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051373    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051376    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051378    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051381    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051383    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051386    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051389    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051391    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051394    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051396    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051399    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051402    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051404    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 01:52:35.056708 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051407    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051409    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051412    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051415    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051417    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051420    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051423    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051425    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051429    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051431    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051434    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051437    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051440    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051442    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051445    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051448    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051450    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051453    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051455    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 01:52:35.057202 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051458    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 01:52:35.057682 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051461    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 01:52:35.057682 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:35.051463    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 01:52:35.057682 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.051468    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 01:52:35.057682 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.051564    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 20 01:52:35.057682 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.053904    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 20 01:52:35.057682 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.054966    2565 server.go:1019] "Starting client certificate rotation"
Sep 20 01:52:35.057682 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.055064    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 20 01:52:35.057682 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.055115    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 20 01:52:35.057896 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.057725    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 20 01:52:35.058771 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.058752    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 20 01:52:35.068207 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.068182    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 20 01:52:35.069926 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.069908    2565 log.go:25] "Validated CRI v1 image API"
Sep 20 01:52:35.070651 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.070628    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 20 01:52:35.075237 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.075218    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b5fdd151-2429-4925-b534-b9b473ac6d01:/dev/nvme0n1p3 bd1e4a39-fa28-42d4-ac93-0586247ffef3:/dev/nvme0n1p4]
Sep 20 01:52:35.075310 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.075237    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 20 01:52:35.080117 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.080003    2565 manager.go:216] Machine: {Timestamp:2026-09-20 01:52:35.078583832 +0000 UTC m=+0.363595757 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3074088 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2474171b29bac81539d7fc977db41e SystemUUID:ec247417-1b29-bac8-1539-d7fc977db41e BootID:ff3ec60f-191d-4b4b-9472-ddc024c672c2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d6:de:55:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d6:de:55:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:5f:ce:69:df:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 20 01:52:35.080117 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.080109    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 20 01:52:35.080294 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.080249    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 20 01:52:35.084077 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.084053    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 20 01:52:35.084199 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.084080    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-222.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 20 01:52:35.084955 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.084945    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 20 01:52:35.084989 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.084956    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 20 01:52:35.084989 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.084964    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 20 01:52:35.085809 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.085797    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 20 01:52:35.085877 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.085868    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 20 01:52:35.090497 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.090486    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 20 01:52:35.090615 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.090605    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 20 01:52:35.090648 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.090639    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 20 01:52:35.090674 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.090648    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 20 01:52:35.090674 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.090663    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 20 01:52:35.090674 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.090672    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 20 01:52:35.090754 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.090680    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 20 01:52:35.091020 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.091007    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 20 01:52:35.091067 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.091026    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 20 01:52:35.092979 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.092958    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 20 01:52:35.093348 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.093328    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 20 01:52:35.096276 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.096263    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 20 01:52:35.096372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.096293    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 20 01:52:35.097621 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097608    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 20 01:52:35.097678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097624    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 20 01:52:35.097678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097631    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 20 01:52:35.097678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097637    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 20 01:52:35.097678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097646    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 20 01:52:35.097678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097651    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 20 01:52:35.097678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097665    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 20 01:52:35.097678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097670    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 20 01:52:35.097678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097677    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 20 01:52:35.097678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097682    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 20 01:52:35.097923 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097691    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 20 01:52:35.097923 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.097696    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 20 01:52:35.099706 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.099689    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 20 01:52:35.099825 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.099712    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 20 01:52:35.100772 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.100747    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 20 01:52:35.100772 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.100752    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 20 01:52:35.102216 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.102196    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-222.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 20 01:52:35.104131 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.104111    2565 server.go:1268] "Started kubelet"
Sep 20 01:52:35.104209 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.104185    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 20 01:52:35.104598 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.104253    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 20 01:52:35.104598 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.104325    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 20 01:52:35.104924 ip-10-0-135-222 systemd[1]: Started Kubernetes Kubelet.
Sep 20 01:52:35.106211 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.106195    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 20 01:52:35.106901 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.106887    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 20 01:52:35.110557 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.110522    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 20 01:52:35.114608 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.114582    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 20 01:52:35.115293 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.115277    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 20 01:52:35.115471 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.115433    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:35.115719 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.115698    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7jt8"
Sep 20 01:52:35.116054 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116035    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 20 01:52:35.116195 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116036    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 20 01:52:35.116195 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116078    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 20 01:52:35.116195 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116044    2565 factory.go:55] Registering systemd factory
Sep 20 01:52:35.116195 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116140    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 20 01:52:35.116195 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116185    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 20 01:52:35.116195 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116195    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 20 01:52:35.116449 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116431    2565 factory.go:153] Registering CRI-O factory
Sep 20 01:52:35.116513 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116453    2565 factory.go:223] Registration of the crio container factory successfully
Sep 20 01:52:35.116513 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116505    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 20 01:52:35.116611 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116525    2565 factory.go:103] Registering Raw factory
Sep 20 01:52:35.116611 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.116541    2565 manager.go:1196] Started watching for new ooms in manager
Sep 20 01:52:35.117663 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.117651    2565 manager.go:349] Starting recovery of all containers
Sep 20 01:52:35.117775 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.116410    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-222.ec2.internal.18d6e48370682f6f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-222.ec2.internal,UID:ip-10-0-135-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-222.ec2.internal,},FirstTimestamp:2026-09-20 01:52:35.104075631 +0000 UTC m=+0.389087557,LastTimestamp:2026-09-20 01:52:35.104075631 +0000 UTC m=+0.389087557,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-222.ec2.internal,}"
Sep 20 01:52:35.123042 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.123020    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7jt8"
Sep 20 01:52:35.128407 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.128379    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 20 01:52:35.128535 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.128515    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 20 01:52:35.130609 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.130591    2565 manager.go:354] Recovery completed
Sep 20 01:52:35.136048 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.136033    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 01:52:35.138757 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.138741    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 01:52:35.138843 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.138772    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 01:52:35.138843 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.138802    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientPID"
Sep 20 01:52:35.139580 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.139564    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 20 01:52:35.139580 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.139577    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 20 01:52:35.139693 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.139588    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 01:52:35.139693 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.139594    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 20 01:52:35.140271 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.140255    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 01:52:35.140354 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.140283    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 01:52:35.140354 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.140298    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientPID"
Sep 20 01:52:35.140833 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.140732    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-222.ec2.internal.18d6e48372795f42  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-222.ec2.internal,UID:ip-10-0-135-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-222.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-222.ec2.internal,},FirstTimestamp:2026-09-20 01:52:35.138756418 +0000 UTC m=+0.423768343,LastTimestamp:2026-09-20 01:52:35.138756418 +0000 UTC m=+0.423768343,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-222.ec2.internal,}"
Sep 20 01:52:35.141769 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.141755    2565 policy_none.go:49] "None policy: Start"
Sep 20 01:52:35.141769 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.141771    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 20 01:52:35.141881 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.141782    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 20 01:52:35.143761 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.143745    2565 policy_none.go:47] "Start"
Sep 20 01:52:35.176423 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.176409    2565 manager.go:337] "Starting Device Plugin manager"
Sep 20 01:52:35.196662 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.176450    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 20 01:52:35.196662 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.176460    2565 server.go:87] "Starting device plugin registration server"
Sep 20 01:52:35.196662 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.176712    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 20 01:52:35.196662 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.176725    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 20 01:52:35.196662 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.176844    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 20 01:52:35.196662 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.176960    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 20 01:52:35.196662 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.177031    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 20 01:52:35.196662 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.178458    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 20 01:52:35.196662 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.178494    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:35.212734 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.212700    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 20 01:52:35.214000 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.213975    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 20 01:52:35.214098 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.214015    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 20 01:52:35.214098 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.214035    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 20 01:52:35.214098 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.214071    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 20 01:52:35.216279 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.216262    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 01:52:35.277055 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.276967    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 01:52:35.277858 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.277843    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 01:52:35.277934 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.277871    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 01:52:35.277934 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.277881    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientPID"
Sep 20 01:52:35.277934 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.277903    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.286724 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.286709    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.286775 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.286732    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-222.ec2.internal\": node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:35.308639 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.308619    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:35.314554 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.314533    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal"]
Sep 20 01:52:35.314611 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.314594    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 01:52:35.315949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.315935    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 01:52:35.316028 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.315961    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 01:52:35.316028 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.315972    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientPID"
Sep 20 01:52:35.317069 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.317054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4aa827babbd6793683650147fd95481d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal\" (UID: \"4aa827babbd6793683650147fd95481d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.317118 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.317076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa827babbd6793683650147fd95481d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal\" (UID: \"4aa827babbd6793683650147fd95481d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.318369 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.318357    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 01:52:35.318504 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.318490    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.318542 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.318521    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 01:52:35.319023 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.319009    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 01:52:35.319090 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.319022    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 01:52:35.319090 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.319034    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 01:52:35.319090 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.319044    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 01:52:35.319090 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.319048    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientPID"
Sep 20 01:52:35.319090 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.319057    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientPID"
Sep 20 01:52:35.321312 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.321299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.321387 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.321320    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 01:52:35.321921 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.321905    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 01:52:35.321992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.321926    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 01:52:35.321992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.321935    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeHasSufficientPID"
Sep 20 01:52:35.342344 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.342324    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-222.ec2.internal\" not found" node="ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.345748 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.345733    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-222.ec2.internal\" not found" node="ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.409165 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.409137    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:35.417801 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.417765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4aa827babbd6793683650147fd95481d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal\" (UID: \"4aa827babbd6793683650147fd95481d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.417894 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.417809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa827babbd6793683650147fd95481d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal\" (UID: \"4aa827babbd6793683650147fd95481d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.417894 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.417828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45060ece5796fbf6dec687e90e5bcb28-config\") pod \"kube-apiserver-proxy-ip-10-0-135-222.ec2.internal\" (UID: \"45060ece5796fbf6dec687e90e5bcb28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.417894 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.417870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4aa827babbd6793683650147fd95481d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal\" (UID: \"4aa827babbd6793683650147fd95481d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.417981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.417907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa827babbd6793683650147fd95481d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal\" (UID: \"4aa827babbd6793683650147fd95481d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.510036 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.509984    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:35.518337 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.518301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45060ece5796fbf6dec687e90e5bcb28-config\") pod \"kube-apiserver-proxy-ip-10-0-135-222.ec2.internal\" (UID: \"45060ece5796fbf6dec687e90e5bcb28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.518337 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.518313    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45060ece5796fbf6dec687e90e5bcb28-config\") pod \"kube-apiserver-proxy-ip-10-0-135-222.ec2.internal\" (UID: \"45060ece5796fbf6dec687e90e5bcb28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.610817 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.610720    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:35.646228 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.646205    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.649392 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:35.649373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:35.711563 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.711388    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:35.811926 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.811892    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:35.915442 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:35.915404    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:36.015617 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:36.015576    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:36.055141 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.055113    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 20 01:52:36.055600 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.055301    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 20 01:52:36.116245 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:36.116176    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:36.130960 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.130928    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-19 01:47:35 +0000 UTC" deadline="2028-03-05 22:48:40.606420671 +0000 UTC"
Sep 20 01:52:36.130960 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.130956    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12788h56m4.475467885s"
Sep 20 01:52:36.197683 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:36.197630    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa827babbd6793683650147fd95481d.slice/crio-c5fe3135a351b50e30bea1577a06abee26fe0647bc75200d9370cf2fc3c0e643 WatchSource:0}: Error finding container c5fe3135a351b50e30bea1577a06abee26fe0647bc75200d9370cf2fc3c0e643: Status 404 returned error can't find the container with id c5fe3135a351b50e30bea1577a06abee26fe0647bc75200d9370cf2fc3c0e643
Sep 20 01:52:36.197997 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:36.197972    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45060ece5796fbf6dec687e90e5bcb28.slice/crio-26048a10f2859ed26b019ab769bdf7ca76780140d7320d52d648941be4ad9972 WatchSource:0}: Error finding container 26048a10f2859ed26b019ab769bdf7ca76780140d7320d52d648941be4ad9972: Status 404 returned error can't find the container with id 26048a10f2859ed26b019ab769bdf7ca76780140d7320d52d648941be4ad9972
Sep 20 01:52:36.204920 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.204904    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 01:52:36.216270 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:36.216243    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:36.217095 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.217058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal" event={"ID":"45060ece5796fbf6dec687e90e5bcb28","Type":"ContainerStarted","Data":"26048a10f2859ed26b019ab769bdf7ca76780140d7320d52d648941be4ad9972"}
Sep 20 01:52:36.218268 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.218243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal" event={"ID":"4aa827babbd6793683650147fd95481d","Type":"ContainerStarted","Data":"c5fe3135a351b50e30bea1577a06abee26fe0647bc75200d9370cf2fc3c0e643"}
Sep 20 01:52:36.318349 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:36.318309    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:36.324315 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.324291    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 01:52:36.422103 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:36.422032    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:36.523073 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:36.523036    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-222.ec2.internal\" not found"
Sep 20 01:52:36.621939 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.621233    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 01:52:36.658594 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.658565    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 01:52:36.715538 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.715464    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:36.728217 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.728190    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 20 01:52:36.729406 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.729390    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal"
Sep 20 01:52:36.738858 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:36.738754    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 20 01:52:37.091953 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.091871    2565 apiserver.go:52] "Watching apiserver"
Sep 20 01:52:37.101384 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.101362    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 20 01:52:37.102782 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.102747    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-99klh","openshift-ovn-kubernetes/ovnkube-node-9c4tf","openshift-cluster-node-tuning-operator/tuned-r9lb8","openshift-image-registry/node-ca-2mlf2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal","openshift-multus/multus-rcwvl","openshift-multus/network-metrics-daemon-778g4","openshift-network-operator/iptables-alerter-dqqrd","kube-system/global-pull-secret-syncer-lhndp","kube-system/konnectivity-agent-rltqw","kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb","openshift-dns/node-resolver-6r5rb","openshift-multus/multus-additional-cni-plugins-j8wp8"]
Sep 20 01:52:37.105588 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.105566    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:37.105699 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.105656    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:37.107905 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.107883    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.110277 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.110250    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 20 01:52:37.110384 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.110327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c4f4k\""
Sep 20 01:52:37.110384 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.110333    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.110512 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.110485    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 20 01:52:37.110670 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.110652    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 20 01:52:37.113101 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.113009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.113200 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.113173    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 20 01:52:37.113442 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.113324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8g865\""
Sep 20 01:52:37.113442 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.113397    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 20 01:52:37.115208 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.115188    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 20 01:52:37.115303 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.115245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:37.115370 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.115302    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:37.115428 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.115393    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 20 01:52:37.115616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.115597    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 20 01:52:37.115690 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.115628    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 20 01:52:37.115743 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.115602    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-khpdd\""
Sep 20 01:52:37.117739 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.117719    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.119685 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.119664    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mtz2t\""
Sep 20 01:52:37.120623 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.120206    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 20 01:52:37.120623 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.120274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.120623 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.120280    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 20 01:52:37.120623 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.120319    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 20 01:52:37.120623 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.120346    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:37.120623 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.120541    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 20 01:52:37.123165 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.123147    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.125795 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.125773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.127797    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.127843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.127854    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.128662    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b8kn9\""
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.128673    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.128765    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sjbdm\""
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.128900    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fef8490b-d37b-4739-8cc4-c8f8d3109448-iptables-alerter-script\") pod \"iptables-alerter-dqqrd\" (UID: \"fef8490b-d37b-4739-8cc4-c8f8d3109448\") " pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129365    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-modprobe-d\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-sysctl-d\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-sys\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-tmp\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-var-lib-cni-bin\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plch5\" (UniqueName: \"kubernetes.io/projected/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-kube-api-access-plch5\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-cni-dir\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-kubernetes\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-host\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.129918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129842    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.129844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sczs\" (UniqueName: \"kubernetes.io/projected/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-kube-api-access-7sczs\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-conf-dir\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-daemon-config\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-system-cni-dir\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-run-k8s-cni-cncf-io\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-run-netns\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhktc\" (UniqueName: \"kubernetes.io/projected/204b7d5a-158d-4155-bae7-2a8939c27ce0-kube-api-access-rhktc\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fef8490b-d37b-4739-8cc4-c8f8d3109448-host-slash\") pod \"iptables-alerter-dqqrd\" (UID: \"fef8490b-d37b-4739-8cc4-c8f8d3109448\") " pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6755fbb-4ed1-4026-ae2d-551e789b2e15-serviceca\") pod \"node-ca-2mlf2\" (UID: \"b6755fbb-4ed1-4026-ae2d-551e789b2e15\") " pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-cni-binary-copy\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-hostroot\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-sysctl-conf\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-run\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130639    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 20 01:52:37.131084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130653    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-var-lib-kubelet\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-socket-dir-parent\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-run-multus-certs\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dggtb\" (UniqueName: \"kubernetes.io/projected/fef8490b-d37b-4739-8cc4-c8f8d3109448-kube-api-access-dggtb\") pod \"iptables-alerter-dqqrd\" (UID: \"fef8490b-d37b-4739-8cc4-c8f8d3109448\") " pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-sysconfig\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-systemd\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-tuned\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.130932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6755fbb-4ed1-4026-ae2d-551e789b2e15-host\") pod \"node-ca-2mlf2\" (UID: \"b6755fbb-4ed1-4026-ae2d-551e789b2e15\") " pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.131163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-var-lib-kubelet\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.131205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-etc-kubernetes\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.131333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-lib-modules\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.131370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-cnibin\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.131406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-var-lib-cni-multus\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.131431    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.131444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nrnf\" (UniqueName: \"kubernetes.io/projected/b6755fbb-4ed1-4026-ae2d-551e789b2e15-kube-api-access-6nrnf\") pod \"node-ca-2mlf2\" (UID: \"b6755fbb-4ed1-4026-ae2d-551e789b2e15\") " pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.131539    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 20 01:52:37.131991 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.131795    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r4nnl\""
Sep 20 01:52:37.132831 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.132223    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 20 01:52:37.134106 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.134085    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.136398 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.136143    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5r49k\""
Sep 20 01:52:37.136490 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.136475    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 20 01:52:37.136560 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.136524    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 20 01:52:37.137344 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.136678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.139275 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.139246    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 20 01:52:37.139372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.139307    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 20 01:52:37.139488 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.139468    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 20 01:52:37.139570 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.139529    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-762g8\""
Sep 20 01:52:37.152930 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.152912    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-szmgb"
Sep 20 01:52:37.160902 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.160883    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-szmgb"
Sep 20 01:52:37.216899 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.216872    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 20 01:52:37.232365 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-system-cni-dir\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.232503 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-run-netns\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.232503 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-sys-fs\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.232503 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-ovn-node-metrics-cert\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.232503 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhktc\" (UniqueName: \"kubernetes.io/projected/204b7d5a-158d-4155-bae7-2a8939c27ce0-kube-api-access-rhktc\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:37.232503 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6755fbb-4ed1-4026-ae2d-551e789b2e15-serviceca\") pod \"node-ca-2mlf2\" (UID: \"b6755fbb-4ed1-4026-ae2d-551e789b2e15\") " pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.232503 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-run-netns\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.232806 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-cni-binary-copy\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.232806 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-system-cni-dir\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.232806 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.232806 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-run-systemd\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.232806 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-var-lib-openvswitch\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.232806 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-ovnkube-script-lib\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-sysctl-conf\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-socket-dir-parent\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-system-cni-dir\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-log-socket\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggtb\" (UniqueName: \"kubernetes.io/projected/fef8490b-d37b-4739-8cc4-c8f8d3109448-kube-api-access-dggtb\") pod \"iptables-alerter-dqqrd\" (UID: \"fef8490b-d37b-4739-8cc4-c8f8d3109448\") " pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.232978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-sysconfig\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-etc-kubernetes\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-sysctl-conf\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-registration-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6755fbb-4ed1-4026-ae2d-551e789b2e15-serviceca\") pod \"node-ca-2mlf2\" (UID: \"b6755fbb-4ed1-4026-ae2d-551e789b2e15\") " pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-socket-dir-parent\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-device-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-sysconfig\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-cni-binary-copy\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-lib-modules\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-etc-kubernetes\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-node-log\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-lib-modules\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-cni-netd\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/989cd413-4280-4b83-856d-44f52d0535ad-hosts-file\") pod \"node-resolver-6r5rb\" (UID: \"989cd413-4280-4b83-856d-44f52d0535ad\") " pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nrnf\" (UniqueName: \"kubernetes.io/projected/b6755fbb-4ed1-4026-ae2d-551e789b2e15-kube-api-access-6nrnf\") pod \"node-ca-2mlf2\" (UID: \"b6755fbb-4ed1-4026-ae2d-551e789b2e15\") " pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fef8490b-d37b-4739-8cc4-c8f8d3109448-iptables-alerter-script\") pod \"iptables-alerter-dqqrd\" (UID: \"fef8490b-d37b-4739-8cc4-c8f8d3109448\") " pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-modprobe-d\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-sys\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233479    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-sys\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f55f74b3-998f-4803-8995-148073e16174-kubelet-config\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plch5\" (UniqueName: \"kubernetes.io/projected/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-kube-api-access-plch5\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-modprobe-d\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-host\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f55f74b3-998f-4803-8995-148073e16174-dbus\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.233968 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-host\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kccfp\" (UniqueName: \"kubernetes.io/projected/91e5095b-6772-4f83-8c26-479cb1357cb5-kube-api-access-kccfp\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-kubelet\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-etc-openvswitch\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.233982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-run-k8s-cni-cncf-io\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/486a3522-0cdd-482e-b43b-02a90ec19912-konnectivity-ca\") pod \"konnectivity-agent-rltqw\" (UID: \"486a3522-0cdd-482e-b43b-02a90ec19912\") " pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fef8490b-d37b-4739-8cc4-c8f8d3109448-iptables-alerter-script\") pod \"iptables-alerter-dqqrd\" (UID: \"fef8490b-d37b-4739-8cc4-c8f8d3109448\") " pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-ovnkube-config\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-env-overrides\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-run-k8s-cni-cncf-io\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz9k2\" (UniqueName: \"kubernetes.io/projected/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-kube-api-access-nz9k2\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l695l\" (UniqueName: \"kubernetes.io/projected/989cd413-4280-4b83-856d-44f52d0535ad-kube-api-access-l695l\") pod \"node-resolver-6r5rb\" (UID: \"989cd413-4280-4b83-856d-44f52d0535ad\") " pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fef8490b-d37b-4739-8cc4-c8f8d3109448-host-slash\") pod \"iptables-alerter-dqqrd\" (UID: \"fef8490b-d37b-4739-8cc4-c8f8d3109448\") " pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-hostroot\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-systemd-units\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fef8490b-d37b-4739-8cc4-c8f8d3109448-host-slash\") pod \"iptables-alerter-dqqrd\" (UID: \"fef8490b-d37b-4739-8cc4-c8f8d3109448\") " pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.234767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-run\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-hostroot\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-var-lib-kubelet\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-run-multus-certs\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-var-lib-kubelet\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-run-netns\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-run-multus-certs\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.234982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-run\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.235017    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-run-ovn\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-systemd\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.235169    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs podName:204b7d5a-158d-4155-bae7-2a8939c27ce0 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:37.735136073 +0000 UTC m=+3.020147988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs") pod "network-metrics-daemon-778g4" (UID: "204b7d5a-158d-4155-bae7-2a8939c27ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-tuned\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-systemd\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6755fbb-4ed1-4026-ae2d-551e789b2e15-host\") pod \"node-ca-2mlf2\" (UID: \"b6755fbb-4ed1-4026-ae2d-551e789b2e15\") " pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-var-lib-kubelet\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6755fbb-4ed1-4026-ae2d-551e789b2e15-host\") pod \"node-ca-2mlf2\" (UID: \"b6755fbb-4ed1-4026-ae2d-551e789b2e15\") " pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.235527 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/486a3522-0cdd-482e-b43b-02a90ec19912-agent-certs\") pod \"konnectivity-agent-rltqw\" (UID: \"486a3522-0cdd-482e-b43b-02a90ec19912\") " pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-cnibin\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-var-lib-kubelet\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-cnibin\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-var-lib-cni-multus\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235476    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-var-lib-cni-multus\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235467    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-cnibin\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfpnx\" (UniqueName: \"kubernetes.io/projected/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-kube-api-access-lfpnx\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-socket-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-cni-bin\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989cd413-4280-4b83-856d-44f52d0535ad-tmp-dir\") pod \"node-resolver-6r5rb\" (UID: \"989cd413-4280-4b83-856d-44f52d0535ad\") " pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-sysctl-d\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-tmp\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-var-lib-cni-bin\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-slash\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-run-openvswitch\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-sysctl-d\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-cni-dir\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-host-var-lib-cni-bin\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-kubernetes\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sczs\" (UniqueName: \"kubernetes.io/projected/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-kube-api-access-7sczs\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-run-ovn-kubernetes\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-cni-dir\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.235979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-kubernetes\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.236020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-conf-dir\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.236048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-daemon-config\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.236079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.236561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-daemon-config\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.236992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.236625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-multus-conf-dir\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.240160 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.240136    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 01:52:37.240254 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.240164    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 01:52:37.240254 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.240179    2565 projected.go:196] Error preparing data for projected volume kube-api-access-gmk4b for pod openshift-network-diagnostics/network-check-target-99klh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:37.240254 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.240234    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b podName:048c60e4-1673-4f2c-8471-c12082318f9a nodeName:}" failed. No retries permitted until 2026-09-20 01:52:37.740218092 +0000 UTC m=+3.025230010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gmk4b" (UniqueName: "kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b") pod "network-check-target-99klh" (UID: "048c60e4-1673-4f2c-8471-c12082318f9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:37.240437 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.240346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-etc-tuned\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.240437 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.240369    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-tmp\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.242584 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.242524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhktc\" (UniqueName: \"kubernetes.io/projected/204b7d5a-158d-4155-bae7-2a8939c27ce0-kube-api-access-rhktc\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:37.242766 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.242742    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nrnf\" (UniqueName: \"kubernetes.io/projected/b6755fbb-4ed1-4026-ae2d-551e789b2e15-kube-api-access-6nrnf\") pod \"node-ca-2mlf2\" (UID: \"b6755fbb-4ed1-4026-ae2d-551e789b2e15\") " pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.242912 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.242872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dggtb\" (UniqueName: \"kubernetes.io/projected/fef8490b-d37b-4739-8cc4-c8f8d3109448-kube-api-access-dggtb\") pod \"iptables-alerter-dqqrd\" (UID: \"fef8490b-d37b-4739-8cc4-c8f8d3109448\") " pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.243186 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.243165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plch5\" (UniqueName: \"kubernetes.io/projected/6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946-kube-api-access-plch5\") pod \"tuned-r9lb8\" (UID: \"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946\") " pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.245906 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.245883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sczs\" (UniqueName: \"kubernetes.io/projected/a5c4b8d0-5e19-42e0-96ce-48f9a766c897-kube-api-access-7sczs\") pod \"multus-rcwvl\" (UID: \"a5c4b8d0-5e19-42e0-96ce-48f9a766c897\") " pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.336416 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-registration-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.336616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-device-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.336616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-node-log\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.336616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-device-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.336616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-cni-netd\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.336616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.336616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-registration-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.336616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/989cd413-4280-4b83-856d-44f52d0535ad-hosts-file\") pod \"node-resolver-6r5rb\" (UID: \"989cd413-4280-4b83-856d-44f52d0535ad\") " pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.336616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f55f74b3-998f-4803-8995-148073e16174-kubelet-config\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-cni-netd\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336677    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/989cd413-4280-4b83-856d-44f52d0535ad-hosts-file\") pod \"node-resolver-6r5rb\" (UID: \"989cd413-4280-4b83-856d-44f52d0535ad\") " pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f55f74b3-998f-4803-8995-148073e16174-dbus\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f55f74b3-998f-4803-8995-148073e16174-kubelet-config\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kccfp\" (UniqueName: \"kubernetes.io/projected/91e5095b-6772-4f83-8c26-479cb1357cb5-kube-api-access-kccfp\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-kubelet\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-etc-openvswitch\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/486a3522-0cdd-482e-b43b-02a90ec19912-konnectivity-ca\") pod \"konnectivity-agent-rltqw\" (UID: \"486a3522-0cdd-482e-b43b-02a90ec19912\") " pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-kubelet\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336837    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f55f74b3-998f-4803-8995-148073e16174-dbus\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-etc-openvswitch\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-ovnkube-config\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.336681    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-node-log\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337110 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-env-overrides\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9k2\" (UniqueName: \"kubernetes.io/projected/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-kube-api-access-nz9k2\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l695l\" (UniqueName: \"kubernetes.io/projected/989cd413-4280-4b83-856d-44f52d0535ad-kube-api-access-l695l\") pod \"node-resolver-6r5rb\" (UID: \"989cd413-4280-4b83-856d-44f52d0535ad\") " pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-systemd-units\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-run-netns\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-run-ovn\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/486a3522-0cdd-482e-b43b-02a90ec19912-agent-certs\") pod \"konnectivity-agent-rltqw\" (UID: \"486a3522-0cdd-482e-b43b-02a90ec19912\") " pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-cnibin\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfpnx\" (UniqueName: \"kubernetes.io/projected/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-kube-api-access-lfpnx\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-socket-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/486a3522-0cdd-482e-b43b-02a90ec19912-konnectivity-ca\") pod \"konnectivity-agent-rltqw\" (UID: \"486a3522-0cdd-482e-b43b-02a90ec19912\") " pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-cni-bin\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337501    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-ovnkube-config\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989cd413-4280-4b83-856d-44f52d0535ad-tmp-dir\") pod \"node-resolver-6r5rb\" (UID: \"989cd413-4280-4b83-856d-44f52d0535ad\") " pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-cnibin\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.337970 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-run-ovn\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-slash\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-run-netns\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-run-openvswitch\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-systemd-units\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-run-ovn-kubernetes\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-sys-fs\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-cni-bin\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337737    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-socket-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-env-overrides\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-ovn-node-metrics-cert\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337827    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.338776 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-run-systemd\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-var-lib-openvswitch\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-ovnkube-script-lib\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-system-cni-dir\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.337999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-log-socket\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989cd413-4280-4b83-856d-44f52d0535ad-tmp-dir\") pod \"node-resolver-6r5rb\" (UID: \"989cd413-4280-4b83-856d-44f52d0535ad\") " pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-log-socket\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91e5095b-6772-4f83-8c26-479cb1357cb5-sys-fs\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338103    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-run-systemd\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-run-openvswitch\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-run-ovn-kubernetes\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-var-lib-openvswitch\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.338199    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.338276    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret podName:f55f74b3-998f-4803-8995-148073e16174 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:37.83825702 +0000 UTC m=+3.123268950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret") pod "global-pull-secret-syncer-lhndp" (UID: "f55f74b3-998f-4803-8995-148073e16174") : object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338298    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-host-slash\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.339433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-system-cni-dir\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.340047 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.340047 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.338708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-ovnkube-script-lib\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.340441 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.340418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/486a3522-0cdd-482e-b43b-02a90ec19912-agent-certs\") pod \"konnectivity-agent-rltqw\" (UID: \"486a3522-0cdd-482e-b43b-02a90ec19912\") " pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:52:37.340777 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.340754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-ovn-node-metrics-cert\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.346096 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.346015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kccfp\" (UniqueName: \"kubernetes.io/projected/91e5095b-6772-4f83-8c26-479cb1357cb5-kube-api-access-kccfp\") pod \"aws-ebs-csi-driver-node-h4stb\" (UID: \"91e5095b-6772-4f83-8c26-479cb1357cb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.346414 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.346396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9k2\" (UniqueName: \"kubernetes.io/projected/553bfa8d-b7ce-4970-aefd-223c4b1c6d75-kube-api-access-nz9k2\") pod \"ovnkube-node-9c4tf\" (UID: \"553bfa8d-b7ce-4970-aefd-223c4b1c6d75\") " pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.348089 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.348060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l695l\" (UniqueName: \"kubernetes.io/projected/989cd413-4280-4b83-856d-44f52d0535ad-kube-api-access-l695l\") pod \"node-resolver-6r5rb\" (UID: \"989cd413-4280-4b83-856d-44f52d0535ad\") " pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.348878 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.348851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfpnx\" (UniqueName: \"kubernetes.io/projected/bb65d72f-e202-45f8-a70c-7e2eae3f7ba3-kube-api-access-lfpnx\") pod \"multus-additional-cni-plugins-j8wp8\" (UID: \"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3\") " pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.423041 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.423005    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dqqrd"
Sep 20 01:52:37.430317 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.430292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9lb8"
Sep 20 01:52:37.441532 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.441499    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2mlf2"
Sep 20 01:52:37.447522 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.447502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rcwvl"
Sep 20 01:52:37.453620 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.453600    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6r5rb"
Sep 20 01:52:37.460955 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.460934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:52:37.467514 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.467492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:52:37.474120 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.474096    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j8wp8"
Sep 20 01:52:37.479916 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.479895    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb"
Sep 20 01:52:37.607978 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.607864    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 01:52:37.740435 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.740402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:37.740435 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.740443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:37.740674 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.740571    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:37.740674 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.740614    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 01:52:37.740674 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.740629    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs podName:204b7d5a-158d-4155-bae7-2a8939c27ce0 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:38.740613848 +0000 UTC m=+4.025625783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs") pod "network-metrics-daemon-778g4" (UID: "204b7d5a-158d-4155-bae7-2a8939c27ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:37.740674 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.740645    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 01:52:37.740674 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.740660    2565 projected.go:196] Error preparing data for projected volume kube-api-access-gmk4b for pod openshift-network-diagnostics/network-check-target-99klh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:37.740929 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.740719    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b podName:048c60e4-1673-4f2c-8471-c12082318f9a nodeName:}" failed. No retries permitted until 2026-09-20 01:52:38.740702124 +0000 UTC m=+4.025714054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmk4b" (UniqueName: "kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b") pod "network-check-target-99klh" (UID: "048c60e4-1673-4f2c-8471-c12082318f9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:37.841269 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:37.841229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:37.841428 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.841396    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:37.841481 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:37.841470    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret podName:f55f74b3-998f-4803-8995-148073e16174 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:38.84145161 +0000 UTC m=+4.126463525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret") pod "global-pull-secret-syncer-lhndp" (UID: "f55f74b3-998f-4803-8995-148073e16174") : object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:38.164722 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:38.164674    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-19 01:47:37 +0000 UTC" deadline="2028-04-25 16:22:51.220759789 +0000 UTC"
Sep 20 01:52:38.165255 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:38.164748    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14006h30m13.056049833s"
Sep 20 01:52:38.213892 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:38.213862    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989cd413_4280_4b83_856d_44f52d0535ad.slice/crio-450caae47a7ad387cb1daf44ac2c2df90eaf4cc1a92f1b1fd61c37ef16b2ff4a WatchSource:0}: Error finding container 450caae47a7ad387cb1daf44ac2c2df90eaf4cc1a92f1b1fd61c37ef16b2ff4a: Status 404 returned error can't find the container with id 450caae47a7ad387cb1daf44ac2c2df90eaf4cc1a92f1b1fd61c37ef16b2ff4a
Sep 20 01:52:38.221922 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:38.221899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6r5rb" event={"ID":"989cd413-4280-4b83-856d-44f52d0535ad","Type":"ContainerStarted","Data":"450caae47a7ad387cb1daf44ac2c2df90eaf4cc1a92f1b1fd61c37ef16b2ff4a"}
Sep 20 01:52:38.235016 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:38.234989    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9b0aea_7dd2_4ba1_b4ff_02c3690f6946.slice/crio-f155668f311963e605f1ccf5f19c886e0a93453936fbd9025a4573842d06e83f WatchSource:0}: Error finding container f155668f311963e605f1ccf5f19c886e0a93453936fbd9025a4573842d06e83f: Status 404 returned error can't find the container with id f155668f311963e605f1ccf5f19c886e0a93453936fbd9025a4573842d06e83f
Sep 20 01:52:38.238137 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:38.238114    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c4b8d0_5e19_42e0_96ce_48f9a766c897.slice/crio-8e0d948b50ad585ab1c4be9310fada4d9f1d58040b9f231fa69ce8f2ef658591 WatchSource:0}: Error finding container 8e0d948b50ad585ab1c4be9310fada4d9f1d58040b9f231fa69ce8f2ef658591: Status 404 returned error can't find the container with id 8e0d948b50ad585ab1c4be9310fada4d9f1d58040b9f231fa69ce8f2ef658591
Sep 20 01:52:38.242893 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:38.242867    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb65d72f_e202_45f8_a70c_7e2eae3f7ba3.slice/crio-d4e3b05292c698f7383475ae2e9e408cfff0a2565a404fcf9d229eee780a1077 WatchSource:0}: Error finding container d4e3b05292c698f7383475ae2e9e408cfff0a2565a404fcf9d229eee780a1077: Status 404 returned error can't find the container with id d4e3b05292c698f7383475ae2e9e408cfff0a2565a404fcf9d229eee780a1077
Sep 20 01:52:38.243859 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:38.243810    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486a3522_0cdd_482e_b43b_02a90ec19912.slice/crio-46f667f50ca066dcc7180f9985973cb1d299925408ecfe65d279cf6c3dc9b3d6 WatchSource:0}: Error finding container 46f667f50ca066dcc7180f9985973cb1d299925408ecfe65d279cf6c3dc9b3d6: Status 404 returned error can't find the container with id 46f667f50ca066dcc7180f9985973cb1d299925408ecfe65d279cf6c3dc9b3d6
Sep 20 01:52:38.245006 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:38.244821    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553bfa8d_b7ce_4970_aefd_223c4b1c6d75.slice/crio-05495c7ccb384f3d43a823b9799f7c469628b3a62d063dab44c3fc42f7aa7f9c WatchSource:0}: Error finding container 05495c7ccb384f3d43a823b9799f7c469628b3a62d063dab44c3fc42f7aa7f9c: Status 404 returned error can't find the container with id 05495c7ccb384f3d43a823b9799f7c469628b3a62d063dab44c3fc42f7aa7f9c
Sep 20 01:52:38.245905 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:38.245718    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e5095b_6772_4f83_8c26_479cb1357cb5.slice/crio-189ca01bc92847be19ba7176309df2aa8f92627b0fd7fda6af04f81f0b611856 WatchSource:0}: Error finding container 189ca01bc92847be19ba7176309df2aa8f92627b0fd7fda6af04f81f0b611856: Status 404 returned error can't find the container with id 189ca01bc92847be19ba7176309df2aa8f92627b0fd7fda6af04f81f0b611856
Sep 20 01:52:38.247297 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:38.247248    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef8490b_d37b_4739_8cc4_c8f8d3109448.slice/crio-faa6d16526ae5b08849e67e1ae6fec3ac1fceda72840271e05cd4bd396aca127 WatchSource:0}: Error finding container faa6d16526ae5b08849e67e1ae6fec3ac1fceda72840271e05cd4bd396aca127: Status 404 returned error can't find the container with id faa6d16526ae5b08849e67e1ae6fec3ac1fceda72840271e05cd4bd396aca127
Sep 20 01:52:38.249085 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:52:38.248962    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6755fbb_4ed1_4026_ae2d_551e789b2e15.slice/crio-f947895a15f680b44063ab3c64b11aa11edeef05c581d10826d2978e5ab9bd36 WatchSource:0}: Error finding container f947895a15f680b44063ab3c64b11aa11edeef05c581d10826d2978e5ab9bd36: Status 404 returned error can't find the container with id f947895a15f680b44063ab3c64b11aa11edeef05c581d10826d2978e5ab9bd36
Sep 20 01:52:38.749536 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:38.748681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:38.749536 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:38.748749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:38.749536 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:38.748920    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:38.749536 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:38.748990    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs podName:204b7d5a-158d-4155-bae7-2a8939c27ce0 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:40.748967997 +0000 UTC m=+6.033979938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs") pod "network-metrics-daemon-778g4" (UID: "204b7d5a-158d-4155-bae7-2a8939c27ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:38.749536 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:38.749416    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 01:52:38.749536 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:38.749434    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 01:52:38.749536 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:38.749448    2565 projected.go:196] Error preparing data for projected volume kube-api-access-gmk4b for pod openshift-network-diagnostics/network-check-target-99klh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:38.749536 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:38.749495    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b podName:048c60e4-1673-4f2c-8471-c12082318f9a nodeName:}" failed. No retries permitted until 2026-09-20 01:52:40.749480398 +0000 UTC m=+6.034492312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmk4b" (UniqueName: "kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b") pod "network-check-target-99klh" (UID: "048c60e4-1673-4f2c-8471-c12082318f9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:38.849629 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:38.849535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:38.849795 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:38.849713    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:38.849795 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:38.849783    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret podName:f55f74b3-998f-4803-8995-148073e16174 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:40.849764092 +0000 UTC m=+6.134776009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret") pod "global-pull-secret-syncer-lhndp" (UID: "f55f74b3-998f-4803-8995-148073e16174") : object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:39.165054 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.164909    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-19 01:47:37 +0000 UTC" deadline="2028-06-02 16:22:04.978797476 +0000 UTC"
Sep 20 01:52:39.165054 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.164971    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14918h29m25.813830417s"
Sep 20 01:52:39.215893 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.215448    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:39.215893 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:39.215823    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:39.216921 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.216255    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:39.216921 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:39.216349    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:39.216921 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.216413    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:39.216921 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:39.216495    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:39.246027 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.245994    2565 generic.go:356] "Generic (PLEG): container finished" podID="4aa827babbd6793683650147fd95481d" containerID="1424bcf57dd9bc228d44b3402acd03a8fa624effbf02243ff474e871680874c7" exitCode=0
Sep 20 01:52:39.246195 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.246169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal" event={"ID":"4aa827babbd6793683650147fd95481d","Type":"ContainerDied","Data":"1424bcf57dd9bc228d44b3402acd03a8fa624effbf02243ff474e871680874c7"}
Sep 20 01:52:39.257233 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.257175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dqqrd" event={"ID":"fef8490b-d37b-4739-8cc4-c8f8d3109448","Type":"ContainerStarted","Data":"faa6d16526ae5b08849e67e1ae6fec3ac1fceda72840271e05cd4bd396aca127"}
Sep 20 01:52:39.267316 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.267286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rltqw" event={"ID":"486a3522-0cdd-482e-b43b-02a90ec19912","Type":"ContainerStarted","Data":"46f667f50ca066dcc7180f9985973cb1d299925408ecfe65d279cf6c3dc9b3d6"}
Sep 20 01:52:39.279959 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.279931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rcwvl" event={"ID":"a5c4b8d0-5e19-42e0-96ce-48f9a766c897","Type":"ContainerStarted","Data":"8e0d948b50ad585ab1c4be9310fada4d9f1d58040b9f231fa69ce8f2ef658591"}
Sep 20 01:52:39.302108 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.302043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal" event={"ID":"45060ece5796fbf6dec687e90e5bcb28","Type":"ContainerStarted","Data":"dd9b4fef90426d29f81a0c1b9bb179e3b66b5bfca185466eac26a509c91d1bee"}
Sep 20 01:52:39.316237 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.316176    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-222.ec2.internal" podStartSLOduration=2.316156317 podStartE2EDuration="2.316156317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:52:39.315276839 +0000 UTC m=+4.600288790" watchObservedRunningTime="2026-09-20 01:52:39.316156317 +0000 UTC m=+4.601168260"
Sep 20 01:52:39.324514 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.324484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2mlf2" event={"ID":"b6755fbb-4ed1-4026-ae2d-551e789b2e15","Type":"ContainerStarted","Data":"f947895a15f680b44063ab3c64b11aa11edeef05c581d10826d2978e5ab9bd36"}
Sep 20 01:52:39.344061 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.344032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb" event={"ID":"91e5095b-6772-4f83-8c26-479cb1357cb5","Type":"ContainerStarted","Data":"189ca01bc92847be19ba7176309df2aa8f92627b0fd7fda6af04f81f0b611856"}
Sep 20 01:52:39.346340 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.346312    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" event={"ID":"553bfa8d-b7ce-4970-aefd-223c4b1c6d75","Type":"ContainerStarted","Data":"05495c7ccb384f3d43a823b9799f7c469628b3a62d063dab44c3fc42f7aa7f9c"}
Sep 20 01:52:39.348102 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.348076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8wp8" event={"ID":"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3","Type":"ContainerStarted","Data":"d4e3b05292c698f7383475ae2e9e408cfff0a2565a404fcf9d229eee780a1077"}
Sep 20 01:52:39.350169 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:39.350145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9lb8" event={"ID":"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946","Type":"ContainerStarted","Data":"f155668f311963e605f1ccf5f19c886e0a93453936fbd9025a4573842d06e83f"}
Sep 20 01:52:40.387377 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:40.386971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal" event={"ID":"4aa827babbd6793683650147fd95481d","Type":"ContainerStarted","Data":"dc8c2807dffab48774aad5c414e452de0719b4978cacaed9c929c788831e3b3e"}
Sep 20 01:52:40.765433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:40.765341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:40.765609 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:40.765448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:40.765609 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:40.765596    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 01:52:40.765735 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:40.765621    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 01:52:40.765735 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:40.765634    2565 projected.go:196] Error preparing data for projected volume kube-api-access-gmk4b for pod openshift-network-diagnostics/network-check-target-99klh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:40.765735 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:40.765697    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b podName:048c60e4-1673-4f2c-8471-c12082318f9a nodeName:}" failed. No retries permitted until 2026-09-20 01:52:44.765677531 +0000 UTC m=+10.050689521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmk4b" (UniqueName: "kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b") pod "network-check-target-99klh" (UID: "048c60e4-1673-4f2c-8471-c12082318f9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:40.766170 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:40.766150    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:40.766270 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:40.766210    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs podName:204b7d5a-158d-4155-bae7-2a8939c27ce0 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:44.76619447 +0000 UTC m=+10.051206391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs") pod "network-metrics-daemon-778g4" (UID: "204b7d5a-158d-4155-bae7-2a8939c27ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:40.866601 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:40.866557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:40.866781 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:40.866725    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:40.866860 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:40.866795    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret podName:f55f74b3-998f-4803-8995-148073e16174 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:44.866773067 +0000 UTC m=+10.151784997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret") pod "global-pull-secret-syncer-lhndp" (UID: "f55f74b3-998f-4803-8995-148073e16174") : object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:41.220746 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:41.220653    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:41.221024 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:41.220841    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:41.221116 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:41.221046    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:41.221229 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:41.221204    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:41.221807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:41.221567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:41.221807 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:41.221719    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:43.215347 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:43.215308    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:43.215866 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:43.215439    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:43.215866 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:43.215749    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:43.215866 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:43.215825    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:43.216036 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:43.215979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:43.216090 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:43.216059    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:44.801344 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:44.801300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:44.801853 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:44.801370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:44.801853 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:44.801528    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:44.801853 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:44.801595    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs podName:204b7d5a-158d-4155-bae7-2a8939c27ce0 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:52.801575467 +0000 UTC m=+18.086587401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs") pod "network-metrics-daemon-778g4" (UID: "204b7d5a-158d-4155-bae7-2a8939c27ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:44.801853 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:44.801647    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 01:52:44.801853 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:44.801666    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 01:52:44.801853 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:44.801680    2565 projected.go:196] Error preparing data for projected volume kube-api-access-gmk4b for pod openshift-network-diagnostics/network-check-target-99klh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:44.801853 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:44.801722    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b podName:048c60e4-1673-4f2c-8471-c12082318f9a nodeName:}" failed. No retries permitted until 2026-09-20 01:52:52.801709354 +0000 UTC m=+18.086721285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmk4b" (UniqueName: "kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b") pod "network-check-target-99klh" (UID: "048c60e4-1673-4f2c-8471-c12082318f9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:44.902841 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:44.902228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:44.902841 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:44.902412    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:44.902841 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:44.902483    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret podName:f55f74b3-998f-4803-8995-148073e16174 nodeName:}" failed. No retries permitted until 2026-09-20 01:52:52.902463412 +0000 UTC m=+18.187475345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret") pod "global-pull-secret-syncer-lhndp" (UID: "f55f74b3-998f-4803-8995-148073e16174") : object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:45.216204 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:45.215943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:45.216204 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:45.216057    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:45.216435 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:45.216243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:45.216435 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:45.216343    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:45.216435 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:45.216387    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:45.216591 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:45.216507    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:47.215353 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:47.215159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:47.215353 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:47.215194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:47.215353 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:47.215303    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:47.215934 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:47.215711    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:47.215934 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:47.215769    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:47.215934 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:47.215868    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:49.214811 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:49.214773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:49.214811 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:49.214812    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:49.215224 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:49.214891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:49.215224 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:49.214910    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:49.215224 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:49.214962    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:49.215224 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:49.215023    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:51.214385 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:51.214343    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:51.214875 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:51.214353    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:51.214875 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:51.214492    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:51.214875 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:51.214360    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:51.214875 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:51.214565    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:51.214875 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:51.214648    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:52.859361 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:52.859328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:52.859877 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:52.859378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:52.859877 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:52.859502    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:52.859877 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:52.859516    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 01:52:52.859877 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:52.859544    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 01:52:52.859877 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:52.859558    2565 projected.go:196] Error preparing data for projected volume kube-api-access-gmk4b for pod openshift-network-diagnostics/network-check-target-99klh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:52.859877 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:52.859563    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs podName:204b7d5a-158d-4155-bae7-2a8939c27ce0 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:08.859547014 +0000 UTC m=+34.144558945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs") pod "network-metrics-daemon-778g4" (UID: "204b7d5a-158d-4155-bae7-2a8939c27ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:52:52.859877 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:52.859606    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b podName:048c60e4-1673-4f2c-8471-c12082318f9a nodeName:}" failed. No retries permitted until 2026-09-20 01:53:08.859590684 +0000 UTC m=+34.144602597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmk4b" (UniqueName: "kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b") pod "network-check-target-99klh" (UID: "048c60e4-1673-4f2c-8471-c12082318f9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:52:52.960234 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:52.960197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:52.960397 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:52.960322    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:52.960463 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:52.960395    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret podName:f55f74b3-998f-4803-8995-148073e16174 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:08.960376406 +0000 UTC m=+34.245388319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret") pod "global-pull-secret-syncer-lhndp" (UID: "f55f74b3-998f-4803-8995-148073e16174") : object "kube-system"/"original-pull-secret" not registered
Sep 20 01:52:53.214454 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:53.214378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:53.214454 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:53.214408    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:53.214631 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:53.214388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:53.214631 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:53.214497    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:53.214631 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:53.214555    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:53.214757 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:53.214667    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:55.215214 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:55.215183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:55.215662 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:55.215275    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:55.215662 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:55.215316    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:55.215662 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:55.215318    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:55.215662 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:55.215390    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:55.215662 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:55.215455    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:57.215287 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.215069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:57.216126 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.215069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:57.216126 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:57.215411    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:57.216126 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.215114    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:57.216126 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:57.215474    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:57.216126 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:57.215552    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:57.425433 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.425371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb" event={"ID":"91e5095b-6772-4f83-8c26-479cb1357cb5","Type":"ContainerStarted","Data":"1ace58b1f02d22c93e2d959fc2af209fd292c85da90da86a038d18f74a5b0f9d"}
Sep 20 01:52:57.428413 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.428385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" event={"ID":"553bfa8d-b7ce-4970-aefd-223c4b1c6d75","Type":"ContainerStarted","Data":"2c2108c8a330ff9b1d0f9a4c350abd50374db3c5a1598bfbf7ff18a7db1f2886"}
Sep 20 01:52:57.428520 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.428471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" event={"ID":"553bfa8d-b7ce-4970-aefd-223c4b1c6d75","Type":"ContainerStarted","Data":"d0f051b6029fdc38764694d296d978c206e81284a961bbeeb0e7cae5cbdabbab"}
Sep 20 01:52:57.428582 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.428525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" event={"ID":"553bfa8d-b7ce-4970-aefd-223c4b1c6d75","Type":"ContainerStarted","Data":"0ea473571569cd5fcdbe3e376c4c242a13628763a8268f783dcc2812f25c83d1"}
Sep 20 01:52:57.428582 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.428571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" event={"ID":"553bfa8d-b7ce-4970-aefd-223c4b1c6d75","Type":"ContainerStarted","Data":"66f075eb4dc83a724aa9108beace2f1d5167f0b3d5e8d844008ebddfe9e30e51"}
Sep 20 01:52:57.428683 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.428615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" event={"ID":"553bfa8d-b7ce-4970-aefd-223c4b1c6d75","Type":"ContainerStarted","Data":"ccc96f55ac503602a567f29e54618f3711b30054f9901bf5fe6369d0888fbd2a"}
Sep 20 01:52:57.431987 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.431962    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb65d72f-e202-45f8-a70c-7e2eae3f7ba3" containerID="93c845e2a486453de64b4610d37f5f3e93a2ccc0bb0ada90ce896fc00f4f01a5" exitCode=0
Sep 20 01:52:57.432091 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.432038    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8wp8" event={"ID":"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3","Type":"ContainerDied","Data":"93c845e2a486453de64b4610d37f5f3e93a2ccc0bb0ada90ce896fc00f4f01a5"}
Sep 20 01:52:57.433645 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.433628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9lb8" event={"ID":"6e9b0aea-7dd2-4ba1-b4ff-02c3690f6946","Type":"ContainerStarted","Data":"ad6b0ce44e083efd3509ee2f279bdf3c48c2553cd455a60db8b93ebec1aef191"}
Sep 20 01:52:57.435247 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.435228    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6r5rb" event={"ID":"989cd413-4280-4b83-856d-44f52d0535ad","Type":"ContainerStarted","Data":"290caad3f86d7fee381193fc066540a721e256708fee7366bc105790b483e348"}
Sep 20 01:52:57.436546 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.436524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rltqw" event={"ID":"486a3522-0cdd-482e-b43b-02a90ec19912","Type":"ContainerStarted","Data":"e2a713e0a482cfca97376e04963202da3c46bef51a8a027d5b66ffda12aff7ca"}
Sep 20 01:52:57.437805 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.437746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rcwvl" event={"ID":"a5c4b8d0-5e19-42e0-96ce-48f9a766c897","Type":"ContainerStarted","Data":"b266e0b871b744044b0ab8411b5dc090d2cdcb4c3e681daaf729022b3e571754"}
Sep 20 01:52:57.441932 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.440938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2mlf2" event={"ID":"b6755fbb-4ed1-4026-ae2d-551e789b2e15","Type":"ContainerStarted","Data":"aaab4f530f51674e04645584c3eccf0de682375fc312a68518511150fac7af60"}
Sep 20 01:52:57.452746 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.452705    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-222.ec2.internal" podStartSLOduration=20.452694106 podStartE2EDuration="20.452694106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:52:40.403154187 +0000 UTC m=+5.688166127" watchObservedRunningTime="2026-09-20 01:52:57.452694106 +0000 UTC m=+22.737706041"
Sep 20 01:52:57.464519 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.464480    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2mlf2" podStartSLOduration=2.869900157 podStartE2EDuration="21.464468434s" totalImagesPullingTime="18.594568277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:52:57.464128134 +0000 UTC m=+22.749140061" watchObservedRunningTime="2026-09-20 01:52:57.464468434 +0000 UTC m=+22.749480368"
Sep 20 01:52:57.480367 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.480308    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rcwvl" podStartSLOduration=2.834448368 podStartE2EDuration="21.480288456s" totalImagesPullingTime="18.645840088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:52:57.480288475 +0000 UTC m=+22.765300411" watchObservedRunningTime="2026-09-20 01:52:57.480288456 +0000 UTC m=+22.765300398"
Sep 20 01:52:57.496161 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.496071    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rltqw" podStartSLOduration=6.480625385 podStartE2EDuration="21.496055435s" totalImagesPullingTime="15.01543005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:52:57.495751164 +0000 UTC m=+22.780763101" watchObservedRunningTime="2026-09-20 01:52:57.496055435 +0000 UTC m=+22.781067373"
Sep 20 01:52:57.513557 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.513511    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r9lb8" podStartSLOduration=2.890059083 podStartE2EDuration="21.513493949s" totalImagesPullingTime="18.623434866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:52:57.513404262 +0000 UTC m=+22.798416197" watchObservedRunningTime="2026-09-20 01:52:57.513493949 +0000 UTC m=+22.798505885"
Sep 20 01:52:57.526023 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:57.525929    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6r5rb" podStartSLOduration=2.9144166609999997 podStartE2EDuration="21.525911783s" totalImagesPullingTime="18.611495122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:52:57.525715355 +0000 UTC m=+22.810727289" watchObservedRunningTime="2026-09-20 01:52:57.525911783 +0000 UTC m=+22.810923718"
Sep 20 01:52:58.197456 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:58.197432    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 20 01:52:58.446030 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:58.445945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb" event={"ID":"91e5095b-6772-4f83-8c26-479cb1357cb5","Type":"ContainerStarted","Data":"dd82043bc96a2d20f21fcec23b13f50fd33a4bf8fa2da0b123b43a3cda1f29d2"}
Sep 20 01:52:58.449498 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:58.449461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" event={"ID":"553bfa8d-b7ce-4970-aefd-223c4b1c6d75","Type":"ContainerStarted","Data":"bcb823270d36993a1d66dbdfb7f250497b172694fd9a9257ba2122fd1edf67f3"}
Sep 20 01:52:58.451048 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:58.451025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dqqrd" event={"ID":"fef8490b-d37b-4739-8cc4-c8f8d3109448","Type":"ContainerStarted","Data":"3aeebabd65ab460f8931b5bc3d7e46996b33c663f6ed192b9a5fb3f04c94c518"}
Sep 20 01:52:58.466556 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:58.466520    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dqqrd" podStartSLOduration=3.870663189 podStartE2EDuration="22.466505574s" totalImagesPullingTime="18.595842385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:52:58.466080433 +0000 UTC m=+23.751092368" watchObservedRunningTime="2026-09-20 01:52:58.466505574 +0000 UTC m=+23.751517509"
Sep 20 01:52:59.190834 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:59.190707    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-20T01:52:58.197451676Z","UUID":"b13da058-6d57-4a3b-9621-1b38173e448e","Handler":null,"Name":"","Endpoint":""}
Sep 20 01:52:59.192592 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:59.192572    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 20 01:52:59.192732 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:59.192605    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 20 01:52:59.214444 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:59.214418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:52:59.214573 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:59.214458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:52:59.214573 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:59.214531    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:52:59.214573 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:59.214418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:52:59.214702 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:59.214608    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:52:59.214702 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:52:59.214680    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:52:59.600502 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:59.600464    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:52:59.601066 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:52:59.600999    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:53:00.457894 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:00.457823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb" event={"ID":"91e5095b-6772-4f83-8c26-479cb1357cb5","Type":"ContainerStarted","Data":"eccfda001609b9dffe8506f9d6cb41368e8c08cf9d51a6a251c86370d2e21156"}
Sep 20 01:53:00.461734 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:00.461698    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" event={"ID":"553bfa8d-b7ce-4970-aefd-223c4b1c6d75","Type":"ContainerStarted","Data":"132c9639eb1954c77aaf233bae2e6d1010433d866424f4bc66baff932109dd07"}
Sep 20 01:53:00.461959 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:00.461942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:53:00.462386 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:00.462371    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rltqw"
Sep 20 01:53:00.475616 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:00.475570    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4stb" podStartSLOduration=3.687781253 podStartE2EDuration="24.475551367s" totalImagesPullingTime="20.787770114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:00.47389556 +0000 UTC m=+25.758907494" watchObservedRunningTime="2026-09-20 01:53:00.475551367 +0000 UTC m=+25.760563303"
Sep 20 01:53:01.214497 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:01.214461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:01.214941 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:01.214461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:01.214941 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:01.214582    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:53:01.214941 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:01.214467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:01.214941 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:01.214683    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:53:01.214941 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:01.214735    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:53:02.468285 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:02.468043    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb65d72f-e202-45f8-a70c-7e2eae3f7ba3" containerID="9f61d1cee13fc4d78e2cbaa5390678dae7d0ecfbf2bace7a47da8418abd9d75c" exitCode=0
Sep 20 01:53:02.469129 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:02.468100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8wp8" event={"ID":"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3","Type":"ContainerDied","Data":"9f61d1cee13fc4d78e2cbaa5390678dae7d0ecfbf2bace7a47da8418abd9d75c"}
Sep 20 01:53:02.475411 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:02.475388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" event={"ID":"553bfa8d-b7ce-4970-aefd-223c4b1c6d75","Type":"ContainerStarted","Data":"120127f015542854bccced1a29520957673e3b91db69d0ea56576c980c2861cc"}
Sep 20 01:53:02.475693 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:02.475659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:53:02.490480 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:02.490462    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:53:02.512035 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:02.512001    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf" podStartSLOduration=7.845624905 podStartE2EDuration="26.511989263s" totalImagesPullingTime="18.666364358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:02.510463885 +0000 UTC m=+27.795475844" watchObservedRunningTime="2026-09-20 01:53:02.511989263 +0000 UTC m=+27.797001198"
Sep 20 01:53:03.218451 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.218422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:03.218610 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.218464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:03.218610 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.218422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:03.218610 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:03.218532    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:53:03.218758 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:03.218636    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:53:03.218758 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:03.218688    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:53:03.478269 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.478074    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:53:03.478592 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.478281    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:53:03.493128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.493099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:53:03.700783 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.700758    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhndp"]
Sep 20 01:53:03.700898 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.700874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:03.701010 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:03.700987    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:53:03.704021 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.703997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99klh"]
Sep 20 01:53:03.704184 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.704093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:03.704184 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:03.704167    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:53:03.704699 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.704675    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-778g4"]
Sep 20 01:53:03.704823 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:03.704775    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:03.704917 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:03.704894    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:53:04.481725 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:04.481682    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb65d72f-e202-45f8-a70c-7e2eae3f7ba3" containerID="a53fb484a6852e72d431dd94857c082286928fa09e20798c34f26e20b7fdcb67" exitCode=0
Sep 20 01:53:04.482257 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:04.481753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8wp8" event={"ID":"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3","Type":"ContainerDied","Data":"a53fb484a6852e72d431dd94857c082286928fa09e20798c34f26e20b7fdcb67"}
Sep 20 01:53:05.216866 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:05.216836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:05.216866 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:05.216851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:05.217146 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:05.216837    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:05.217146 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:05.216920    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:53:05.217146 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:05.217007    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:53:05.217146 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:05.217082    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:53:06.489560 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:06.489530    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb65d72f-e202-45f8-a70c-7e2eae3f7ba3" containerID="aa204b2d750ed1d0a4578ecdb6c83e2daa66c200fd5df21a936b381d18b0b601" exitCode=0
Sep 20 01:53:06.489933 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:06.489578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8wp8" event={"ID":"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3","Type":"ContainerDied","Data":"aa204b2d750ed1d0a4578ecdb6c83e2daa66c200fd5df21a936b381d18b0b601"}
Sep 20 01:53:07.218607 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:07.218432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:07.218779 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:07.218468    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:07.218779 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:07.218703    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:53:07.218779 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:07.218477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:07.218943 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:07.218743    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:53:07.218943 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:07.218896    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:53:08.881033 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:08.880999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:08.881562 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:08.881051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:08.881562 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:08.881173    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 01:53:08.881562 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:08.881202    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 01:53:08.881562 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:08.881216    2565 projected.go:196] Error preparing data for projected volume kube-api-access-gmk4b for pod openshift-network-diagnostics/network-check-target-99klh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:53:08.881562 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:08.881264    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b podName:048c60e4-1673-4f2c-8471-c12082318f9a nodeName:}" failed. No retries permitted until 2026-09-20 01:53:40.881250121 +0000 UTC m=+66.166262034 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmk4b" (UniqueName: "kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b") pod "network-check-target-99klh" (UID: "048c60e4-1673-4f2c-8471-c12082318f9a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 01:53:08.881562 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:08.881176    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:53:08.881562 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:08.881301    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs podName:204b7d5a-158d-4155-bae7-2a8939c27ce0 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:40.881292009 +0000 UTC m=+66.166303935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs") pod "network-metrics-daemon-778g4" (UID: "204b7d5a-158d-4155-bae7-2a8939c27ce0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 01:53:08.981508 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:08.981472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:08.981681 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:08.981640    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 01:53:08.981749 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:08.981712    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret podName:f55f74b3-998f-4803-8995-148073e16174 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:40.981694831 +0000 UTC m=+66.266706764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret") pod "global-pull-secret-syncer-lhndp" (UID: "f55f74b3-998f-4803-8995-148073e16174") : object "kube-system"/"original-pull-secret" not registered
Sep 20 01:53:09.218136 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.218066    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:09.218294 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.218071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:09.218294 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:09.218162    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhndp" podUID="f55f74b3-998f-4803-8995-148073e16174"
Sep 20 01:53:09.218294 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.218071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:09.218294 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:09.218254    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99klh" podUID="048c60e4-1673-4f2c-8471-c12082318f9a"
Sep 20 01:53:09.218456 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:09.218336    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-778g4" podUID="204b7d5a-158d-4155-bae7-2a8939c27ce0"
Sep 20 01:53:09.540958 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.540925    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-222.ec2.internal" event="NodeReady"
Sep 20 01:53:09.541128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.541063    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 20 01:53:09.586049 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.586010    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-skzjn"]
Sep 20 01:53:09.591942 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.591913    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d7cqs"]
Sep 20 01:53:09.592085 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.592036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-skzjn"
Sep 20 01:53:09.594566 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.594333    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 20 01:53:09.594566 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.594413    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w9zwc\""
Sep 20 01:53:09.594566 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.594436    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 20 01:53:09.594909 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.594890    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 20 01:53:09.595661 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.595639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-skzjn"]
Sep 20 01:53:09.596330 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.595731    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.598007 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.597947    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 20 01:53:09.598273 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.598256    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fp8gx\""
Sep 20 01:53:09.598364 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.598285    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 20 01:53:09.599667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.599618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d7cqs"]
Sep 20 01:53:09.685611 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.685576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7746\" (UniqueName: \"kubernetes.io/projected/1af618f0-822c-4eb8-b157-be63a25a19ff-kube-api-access-w7746\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.685777 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.685640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1af618f0-822c-4eb8-b157-be63a25a19ff-tmp-dir\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.685777 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.685671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc8781d-3232-4203-985a-d82bbdb4bad8-cert\") pod \"ingress-canary-skzjn\" (UID: \"bfc8781d-3232-4203-985a-d82bbdb4bad8\") " pod="openshift-ingress-canary/ingress-canary-skzjn"
Sep 20 01:53:09.685777 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.685707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.685777 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.685729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1af618f0-822c-4eb8-b157-be63a25a19ff-config-volume\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.685777 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.685745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5kls\" (UniqueName: \"kubernetes.io/projected/bfc8781d-3232-4203-985a-d82bbdb4bad8-kube-api-access-q5kls\") pod \"ingress-canary-skzjn\" (UID: \"bfc8781d-3232-4203-985a-d82bbdb4bad8\") " pod="openshift-ingress-canary/ingress-canary-skzjn"
Sep 20 01:53:09.786837 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.786800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7746\" (UniqueName: \"kubernetes.io/projected/1af618f0-822c-4eb8-b157-be63a25a19ff-kube-api-access-w7746\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.787507 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.787215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1af618f0-822c-4eb8-b157-be63a25a19ff-tmp-dir\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.787507 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.787253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc8781d-3232-4203-985a-d82bbdb4bad8-cert\") pod \"ingress-canary-skzjn\" (UID: \"bfc8781d-3232-4203-985a-d82bbdb4bad8\") " pod="openshift-ingress-canary/ingress-canary-skzjn"
Sep 20 01:53:09.787507 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.787279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.787507 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.787300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1af618f0-822c-4eb8-b157-be63a25a19ff-config-volume\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.787507 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.787322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5kls\" (UniqueName: \"kubernetes.io/projected/bfc8781d-3232-4203-985a-d82bbdb4bad8-kube-api-access-q5kls\") pod \"ingress-canary-skzjn\" (UID: \"bfc8781d-3232-4203-985a-d82bbdb4bad8\") " pod="openshift-ingress-canary/ingress-canary-skzjn"
Sep 20 01:53:09.787770 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:09.787581    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 01:53:09.787770 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:09.787641    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls podName:1af618f0-822c-4eb8-b157-be63a25a19ff nodeName:}" failed. No retries permitted until 2026-09-20 01:53:10.287621647 +0000 UTC m=+35.572633572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls") pod "dns-default-d7cqs" (UID: "1af618f0-822c-4eb8-b157-be63a25a19ff") : secret "dns-default-metrics-tls" not found
Sep 20 01:53:09.787906 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.787844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1af618f0-822c-4eb8-b157-be63a25a19ff-tmp-dir\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.788123 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.788102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1af618f0-822c-4eb8-b157-be63a25a19ff-config-volume\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.791906 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.791850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc8781d-3232-4203-985a-d82bbdb4bad8-cert\") pod \"ingress-canary-skzjn\" (UID: \"bfc8781d-3232-4203-985a-d82bbdb4bad8\") " pod="openshift-ingress-canary/ingress-canary-skzjn"
Sep 20 01:53:09.797395 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.797371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5kls\" (UniqueName: \"kubernetes.io/projected/bfc8781d-3232-4203-985a-d82bbdb4bad8-kube-api-access-q5kls\") pod \"ingress-canary-skzjn\" (UID: \"bfc8781d-3232-4203-985a-d82bbdb4bad8\") " pod="openshift-ingress-canary/ingress-canary-skzjn"
Sep 20 01:53:09.797395 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.797391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7746\" (UniqueName: \"kubernetes.io/projected/1af618f0-822c-4eb8-b157-be63a25a19ff-kube-api-access-w7746\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:09.905530 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:09.905492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-skzjn"
Sep 20 01:53:10.291899 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:10.291863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:10.292076 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:10.292020    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 01:53:10.292124 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:10.292101    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls podName:1af618f0-822c-4eb8-b157-be63a25a19ff nodeName:}" failed. No retries permitted until 2026-09-20 01:53:11.292084025 +0000 UTC m=+36.577095945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls") pod "dns-default-d7cqs" (UID: "1af618f0-822c-4eb8-b157-be63a25a19ff") : secret "dns-default-metrics-tls" not found
Sep 20 01:53:10.774920 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:10.774893    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-skzjn"]
Sep 20 01:53:10.784615 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:10.784581    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc8781d_3232_4203_985a_d82bbdb4bad8.slice/crio-7298c20c7cd60182d7c8e7539b39f1228b71f2ae0667ca0c6604967fc3e3a202 WatchSource:0}: Error finding container 7298c20c7cd60182d7c8e7539b39f1228b71f2ae0667ca0c6604967fc3e3a202: Status 404 returned error can't find the container with id 7298c20c7cd60182d7c8e7539b39f1228b71f2ae0667ca0c6604967fc3e3a202
Sep 20 01:53:11.214430 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.214331    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:11.215080 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.214331    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:11.215080 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.214336    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:11.217031 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.217010    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 20 01:53:11.217147 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.217016    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 20 01:53:11.217973 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.217948    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 20 01:53:11.218041 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.218030    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 20 01:53:11.218084 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.218038    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cvrtw\""
Sep 20 01:53:11.218160 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.218148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjlfs\""
Sep 20 01:53:11.300516 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.300492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:11.300657 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:11.300640    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 01:53:11.300710 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:11.300700    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls podName:1af618f0-822c-4eb8-b157-be63a25a19ff nodeName:}" failed. No retries permitted until 2026-09-20 01:53:13.300683545 +0000 UTC m=+38.585695458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls") pod "dns-default-d7cqs" (UID: "1af618f0-822c-4eb8-b157-be63a25a19ff") : secret "dns-default-metrics-tls" not found
Sep 20 01:53:11.504719 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.504644    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb65d72f-e202-45f8-a70c-7e2eae3f7ba3" containerID="16f0d574fee2853d1af2c8a9200dfa77c49727decec28fa8ccc6f5b08f97ed37" exitCode=0
Sep 20 01:53:11.504719 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.504688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8wp8" event={"ID":"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3","Type":"ContainerDied","Data":"16f0d574fee2853d1af2c8a9200dfa77c49727decec28fa8ccc6f5b08f97ed37"}
Sep 20 01:53:11.506547 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:11.506512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-skzjn" event={"ID":"bfc8781d-3232-4203-985a-d82bbdb4bad8","Type":"ContainerStarted","Data":"7298c20c7cd60182d7c8e7539b39f1228b71f2ae0667ca0c6604967fc3e3a202"}
Sep 20 01:53:12.512284 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:12.512249    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb65d72f-e202-45f8-a70c-7e2eae3f7ba3" containerID="7593e08d6e3495d483334f087d27d3a5445bba4f1bcf3f7b901dffb127aea882" exitCode=0
Sep 20 01:53:12.512655 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:12.512296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8wp8" event={"ID":"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3","Type":"ContainerDied","Data":"7593e08d6e3495d483334f087d27d3a5445bba4f1bcf3f7b901dffb127aea882"}
Sep 20 01:53:13.317734 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:13.317703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:13.317894 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:13.317873    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 01:53:13.317942 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:13.317935    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls podName:1af618f0-822c-4eb8-b157-be63a25a19ff nodeName:}" failed. No retries permitted until 2026-09-20 01:53:17.317920212 +0000 UTC m=+42.602932140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls") pod "dns-default-d7cqs" (UID: "1af618f0-822c-4eb8-b157-be63a25a19ff") : secret "dns-default-metrics-tls" not found
Sep 20 01:53:13.515853 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:13.515820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-skzjn" event={"ID":"bfc8781d-3232-4203-985a-d82bbdb4bad8","Type":"ContainerStarted","Data":"352115c46e6bb9e687fbd80f579d2ea8027db0458da189da47d08e7cbf89dc53"}
Sep 20 01:53:13.519263 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:13.519231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8wp8" event={"ID":"bb65d72f-e202-45f8-a70c-7e2eae3f7ba3","Type":"ContainerStarted","Data":"626520da965a7ee4f81d690696e0953bca1c55e672a1d04c22fec5a272e88e15"}
Sep 20 01:53:13.530613 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:13.530546    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-skzjn" podStartSLOduration=2.349123538 podStartE2EDuration="4.530533244s" totalImagesPullingTime="2.181409706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:13.529934109 +0000 UTC m=+38.814946044" watchObservedRunningTime="2026-09-20 01:53:13.530533244 +0000 UTC m=+38.815545179"
Sep 20 01:53:13.548591 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:13.548555    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j8wp8" podStartSLOduration=8.232002383 podStartE2EDuration="37.548541591s" totalImagesPullingTime="29.316539208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:13.548287123 +0000 UTC m=+38.833299083" watchObservedRunningTime="2026-09-20 01:53:13.548541591 +0000 UTC m=+38.833553525"
Sep 20 01:53:15.946214 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:15.946183    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d4kzj"]
Sep 20 01:53:15.974642 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:15.974612    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d4kzj"]
Sep 20 01:53:15.974769 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:15.974722    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:15.977090 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:15.977066    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 20 01:53:15.977212 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:15.977070    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 20 01:53:15.977212 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:15.977106    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 20 01:53:15.977466 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:15.977451    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 20 01:53:15.977542 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:15.977525    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fcgnp\""
Sep 20 01:53:16.138495 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.138461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f32c860-059e-47dc-8c5c-b64289378a07-data-volume\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.138642 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.138526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr8r5\" (UniqueName: \"kubernetes.io/projected/5f32c860-059e-47dc-8c5c-b64289378a07-kube-api-access-kr8r5\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.138642 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.138564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.138642 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.138605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f32c860-059e-47dc-8c5c-b64289378a07-crio-socket\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.138642 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.138634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.239485 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.239462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f32c860-059e-47dc-8c5c-b64289378a07-crio-socket\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.239597 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.239502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.239597 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.239524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f32c860-059e-47dc-8c5c-b64289378a07-data-volume\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.239597 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.239552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr8r5\" (UniqueName: \"kubernetes.io/projected/5f32c860-059e-47dc-8c5c-b64289378a07-kube-api-access-kr8r5\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.239597 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.239571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.239925 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:16.239616    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:16.239925 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:16.239628    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 01:53:16.239925 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:16.239675    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:16.739662681 +0000 UTC m=+42.024674608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : configmap "kube-rbac-proxy" not found
Sep 20 01:53:16.239925 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:16.239686    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:16.739680962 +0000 UTC m=+42.024692875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:16.239925 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.239696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f32c860-059e-47dc-8c5c-b64289378a07-crio-socket\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.239925 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.239868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f32c860-059e-47dc-8c5c-b64289378a07-data-volume\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.249016 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.248997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr8r5\" (UniqueName: \"kubernetes.io/projected/5f32c860-059e-47dc-8c5c-b64289378a07-kube-api-access-kr8r5\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.744008 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.743979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.744155 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.744048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:16.744155 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:16.744091    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 01:53:16.744155 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:16.744156    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:17.744140444 +0000 UTC m=+43.029152373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : configmap "kube-rbac-proxy" not found
Sep 20 01:53:16.744282 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:16.744157    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:16.744282 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:16.744231    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:17.744213237 +0000 UTC m=+43.029225168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:16.978218 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.978185    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf"]
Sep 20 01:53:16.992214 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.992189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf"]
Sep 20 01:53:16.992342 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.992296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf"
Sep 20 01:53:16.995758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.995701    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 20 01:53:16.995864 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.995811    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zmkx8\""
Sep 20 01:53:16.996462 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:16.996447    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 20 01:53:17.148206 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:17.148173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5qpt\" (UniqueName: \"kubernetes.io/projected/db74a0a6-a5b2-410b-b229-822ab975d7bd-kube-api-access-d5qpt\") pod \"migrator-76794cbd6c-k4jmf\" (UID: \"db74a0a6-a5b2-410b-b229-822ab975d7bd\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf"
Sep 20 01:53:17.249934 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:17.249403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5qpt\" (UniqueName: \"kubernetes.io/projected/db74a0a6-a5b2-410b-b229-822ab975d7bd-kube-api-access-d5qpt\") pod \"migrator-76794cbd6c-k4jmf\" (UID: \"db74a0a6-a5b2-410b-b229-822ab975d7bd\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf"
Sep 20 01:53:17.256961 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:17.256936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5qpt\" (UniqueName: \"kubernetes.io/projected/db74a0a6-a5b2-410b-b229-822ab975d7bd-kube-api-access-d5qpt\") pod \"migrator-76794cbd6c-k4jmf\" (UID: \"db74a0a6-a5b2-410b-b229-822ab975d7bd\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf"
Sep 20 01:53:17.300860 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:17.300828    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf"
Sep 20 01:53:17.351026 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:17.350995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:17.351169 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:17.351149    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 01:53:17.351226 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:17.351217    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls podName:1af618f0-822c-4eb8-b157-be63a25a19ff nodeName:}" failed. No retries permitted until 2026-09-20 01:53:25.351200221 +0000 UTC m=+50.636212149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls") pod "dns-default-d7cqs" (UID: "1af618f0-822c-4eb8-b157-be63a25a19ff") : secret "dns-default-metrics-tls" not found
Sep 20 01:53:17.587943 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:17.587869    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf"]
Sep 20 01:53:17.591165 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:17.591142    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb74a0a6_a5b2_410b_b229_822ab975d7bd.slice/crio-a57716398379f30e8dbba7fc8573206faaf070f6d7b99e7df82b6c660b704968 WatchSource:0}: Error finding container a57716398379f30e8dbba7fc8573206faaf070f6d7b99e7df82b6c660b704968: Status 404 returned error can't find the container with id a57716398379f30e8dbba7fc8573206faaf070f6d7b99e7df82b6c660b704968
Sep 20 01:53:17.697279 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:17.697249    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6r5rb_989cd413-4280-4b83-856d-44f52d0535ad/dns-node-resolver/0.log"
Sep 20 01:53:17.754745 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:17.754716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:17.754914 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:17.754764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:17.754914 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:17.754850    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 01:53:17.754914 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:17.754892    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:17.755045 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:17.754902    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:19.754888839 +0000 UTC m=+45.039900752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : configmap "kube-rbac-proxy" not found
Sep 20 01:53:17.755045 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:17.754963    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:19.754945148 +0000 UTC m=+45.039957063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:18.533725 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:18.533685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf" event={"ID":"db74a0a6-a5b2-410b-b229-822ab975d7bd","Type":"ContainerStarted","Data":"a57716398379f30e8dbba7fc8573206faaf070f6d7b99e7df82b6c660b704968"}
Sep 20 01:53:18.698404 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:18.698371    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2mlf2_b6755fbb-4ed1-4026-ae2d-551e789b2e15/node-ca/0.log"
Sep 20 01:53:19.538079 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:19.538046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf" event={"ID":"db74a0a6-a5b2-410b-b229-822ab975d7bd","Type":"ContainerStarted","Data":"a67f3f2b6630d1997663a68132c5818000395a6c28f104584f987ecd92cdcd56"}
Sep 20 01:53:19.538422 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:19.538099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf" event={"ID":"db74a0a6-a5b2-410b-b229-822ab975d7bd","Type":"ContainerStarted","Data":"0e405c8ec543869c0cc5ee45bef20bb9eed9790a1b1aa8bc8fb4a152dd778701"}
Sep 20 01:53:19.553111 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:19.553073    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k4jmf" podStartSLOduration=1.931118987 podStartE2EDuration="3.553058953s" totalImagesPullingTime="1.621939966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:19.55208072 +0000 UTC m=+44.837092678" watchObservedRunningTime="2026-09-20 01:53:19.553058953 +0000 UTC m=+44.838070887"
Sep 20 01:53:19.699470 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:19.699441    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-skzjn_bfc8781d-3232-4203-985a-d82bbdb4bad8/serve-healthcheck-canary/0.log"
Sep 20 01:53:19.769680 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:19.769642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:19.769856 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:19.769721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:19.769856 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:19.769820    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:19.769922 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:19.769854    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 01:53:19.769922 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:19.769880    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:23.769863968 +0000 UTC m=+49.054875887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:19.769922 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:19.769909    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:23.769897018 +0000 UTC m=+49.054908952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : configmap "kube-rbac-proxy" not found
Sep 20 01:53:23.800548 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:23.800509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:23.800981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:23.800587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:23.800981 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:23.800629    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 01:53:23.800981 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:23.800675    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:23.800981 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:23.800695    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:31.800679052 +0000 UTC m=+57.085690980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : configmap "kube-rbac-proxy" not found
Sep 20 01:53:23.800981 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:23.800715    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls podName:5f32c860-059e-47dc-8c5c-b64289378a07 nodeName:}" failed. No retries permitted until 2026-09-20 01:53:31.800703678 +0000 UTC m=+57.085715618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d4kzj" (UID: "5f32c860-059e-47dc-8c5c-b64289378a07") : secret "insights-runtime-extractor-tls" not found
Sep 20 01:53:25.410715 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:25.410680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:25.412883 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:25.412863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af618f0-822c-4eb8-b157-be63a25a19ff-metrics-tls\") pod \"dns-default-d7cqs\" (UID: \"1af618f0-822c-4eb8-b157-be63a25a19ff\") " pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:25.511756 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:25.511718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:25.830782 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:25.830697    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d7cqs"]
Sep 20 01:53:25.833209 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:25.833184    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af618f0_822c_4eb8_b157_be63a25a19ff.slice/crio-4cb8d4a091faefc5179b4c034149ab7b895d6b50ad6f993113f6553fc3bb4109 WatchSource:0}: Error finding container 4cb8d4a091faefc5179b4c034149ab7b895d6b50ad6f993113f6553fc3bb4109: Status 404 returned error can't find the container with id 4cb8d4a091faefc5179b4c034149ab7b895d6b50ad6f993113f6553fc3bb4109
Sep 20 01:53:26.556266 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:26.556230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7cqs" event={"ID":"1af618f0-822c-4eb8-b157-be63a25a19ff","Type":"ContainerStarted","Data":"4cb8d4a091faefc5179b4c034149ab7b895d6b50ad6f993113f6553fc3bb4109"}
Sep 20 01:53:28.563320 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:28.563286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7cqs" event={"ID":"1af618f0-822c-4eb8-b157-be63a25a19ff","Type":"ContainerStarted","Data":"f98f263efd8fddc7c84fc74f96ce834bc040a93225c9af2c5e5cf6af268bd2d0"}
Sep 20 01:53:28.563695 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:28.563360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7cqs" event={"ID":"1af618f0-822c-4eb8-b157-be63a25a19ff","Type":"ContainerStarted","Data":"0849def1b1b482c9741c054e3f3982285e94653564d481519ad0d627a4154d1b"}
Sep 20 01:53:28.563695 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:28.563423    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:28.582388 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:28.582345    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d7cqs" podStartSLOduration=17.409610612 podStartE2EDuration="19.582332268s" totalImagesPullingTime="2.172721656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:28.581023589 +0000 UTC m=+53.866035526" watchObservedRunningTime="2026-09-20 01:53:28.582332268 +0000 UTC m=+53.867344202"
Sep 20 01:53:31.854910 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:31.854869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:31.855482 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:31.854943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:31.855595 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:31.855571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f32c860-059e-47dc-8c5c-b64289378a07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:31.857156 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:31.857138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f32c860-059e-47dc-8c5c-b64289378a07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4kzj\" (UID: \"5f32c860-059e-47dc-8c5c-b64289378a07\") " pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:31.883101 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:31.883066    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d4kzj"
Sep 20 01:53:32.150997 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:32.150922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d4kzj"]
Sep 20 01:53:32.154186 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:32.154150    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f32c860_059e_47dc_8c5c_b64289378a07.slice/crio-4ba109cfca6c3bbbeaa81bfc5ed77f66d3458e4616690115b8edad38f8904f4d WatchSource:0}: Error finding container 4ba109cfca6c3bbbeaa81bfc5ed77f66d3458e4616690115b8edad38f8904f4d: Status 404 returned error can't find the container with id 4ba109cfca6c3bbbeaa81bfc5ed77f66d3458e4616690115b8edad38f8904f4d
Sep 20 01:53:32.576309 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:32.576275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d4kzj" event={"ID":"5f32c860-059e-47dc-8c5c-b64289378a07","Type":"ContainerStarted","Data":"83994f421e031da70cc896cd832f8d1df41ffd2cdb0c81bb628b6ea23ae0bdce"}
Sep 20 01:53:32.576476 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:32.576329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d4kzj" event={"ID":"5f32c860-059e-47dc-8c5c-b64289378a07","Type":"ContainerStarted","Data":"4ba109cfca6c3bbbeaa81bfc5ed77f66d3458e4616690115b8edad38f8904f4d"}
Sep 20 01:53:33.581285 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:33.581244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d4kzj" event={"ID":"5f32c860-059e-47dc-8c5c-b64289378a07","Type":"ContainerStarted","Data":"32464f60fad82665c4f20b301953191fae1959afcfa154813a57be8ca99c0c34"}
Sep 20 01:53:35.494596 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:35.494563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9c4tf"
Sep 20 01:53:35.589184 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:35.589151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d4kzj" event={"ID":"5f32c860-059e-47dc-8c5c-b64289378a07","Type":"ContainerStarted","Data":"34ac493c52227758450622a354fa449db0d90a090e63914cc1e8ef1f93730127"}
Sep 20 01:53:35.606607 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:35.606561    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d4kzj" podStartSLOduration=17.946575178 podStartE2EDuration="20.606548715s" totalImagesPullingTime="2.659973537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:53:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:35.605868998 +0000 UTC m=+60.890880933" watchObservedRunningTime="2026-09-20 01:53:35.606548715 +0000 UTC m=+60.891560650"
Sep 20 01:53:38.568484 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:38.568453    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d7cqs"
Sep 20 01:53:40.917713 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:40.917673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:40.918123 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:40.917723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:40.920123 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:40.920104    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 20 01:53:40.920925 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:40.920903    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 20 01:53:40.930169 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:40.930143    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 20 01:53:40.930677 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:40.930660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/204b7d5a-158d-4155-bae7-2a8939c27ce0-metrics-certs\") pod \"network-metrics-daemon-778g4\" (UID: \"204b7d5a-158d-4155-bae7-2a8939c27ce0\") " pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:40.940473 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:40.940449    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmk4b\" (UniqueName: \"kubernetes.io/projected/048c60e4-1673-4f2c-8471-c12082318f9a-kube-api-access-gmk4b\") pod \"network-check-target-99klh\" (UID: \"048c60e4-1673-4f2c-8471-c12082318f9a\") " pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:41.009526 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.009488    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"]
Sep 20 01:53:41.018241 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.018193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:41.020941 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.020924    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 20 01:53:41.031390 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.031356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f55f74b3-998f-4803-8995-148073e16174-original-pull-secret\") pod \"global-pull-secret-syncer-lhndp\" (UID: \"f55f74b3-998f-4803-8995-148073e16174\") " pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:41.033113 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.033094    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-4f587"]
Sep 20 01:53:41.033266 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.033246    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"
Sep 20 01:53:41.037495 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.037476    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 20 01:53:41.044361 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.044344    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jlvb4\""
Sep 20 01:53:41.052823 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.052806    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648df7864b-65c4k"]
Sep 20 01:53:41.052922 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.052906    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-4f587"
Sep 20 01:53:41.056662 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.056643    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xzxpt\""
Sep 20 01:53:41.057121 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.057092    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 20 01:53:41.057211 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.057110    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 20 01:53:41.072920 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.072899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"]
Sep 20 01:53:41.072995 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.072929    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-4f587"]
Sep 20 01:53:41.072995 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.072943    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648df7864b-65c4k"]
Sep 20 01:53:41.073101 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.072993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.076604 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.076585    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 20 01:53:41.076691 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.076632    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 20 01:53:41.076749 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.076707    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 20 01:53:41.076818 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.076758    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 20 01:53:41.076965 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.076947    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hhjxq\""
Sep 20 01:53:41.077034 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.076983    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 20 01:53:41.118456 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.118433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f8a5a4e-455f-45ef-b011-f11ddf379434-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-4zzkg\" (UID: \"4f8a5a4e-455f-45ef-b011-f11ddf379434\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"
Sep 20 01:53:41.118544 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.118460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rr8\" (UniqueName: \"kubernetes.io/projected/2be99b1a-29cb-40cc-bb17-c765d5fa7752-kube-api-access-86rr8\") pod \"downloads-6594f4c75-4f587\" (UID: \"2be99b1a-29cb-40cc-bb17-c765d5fa7752\") " pod="openshift-console/downloads-6594f4c75-4f587"
Sep 20 01:53:41.118544 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.118477    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-oauth-config\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.118544 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.118493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-serving-cert\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.118544 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.118519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-config\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.118670 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.118585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-service-ca\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.118670 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.118615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzxjw\" (UniqueName: \"kubernetes.io/projected/aa936fe8-fcfc-4aee-a47c-208eef1c475f-kube-api-access-zzxjw\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.118670 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.118649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-oauth-serving-cert\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.120680 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.120661    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"]
Sep 20 01:53:41.144901 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.144880    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"]
Sep 20 01:53:41.145007 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.144968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.147326 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.147304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 20 01:53:41.147326 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.147318    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k9d2x\""
Sep 20 01:53:41.147480 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.147466    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 20 01:53:41.147646 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.147633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 20 01:53:41.152352 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.152333    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 20 01:53:41.219905 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.219835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bed87565-e264-4348-a8c4-acf47fe8dbf8-registry-tls\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.219905 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.219866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bed87565-e264-4348-a8c4-acf47fe8dbf8-registry-certificates\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.219905 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.219899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rr8\" (UniqueName: \"kubernetes.io/projected/2be99b1a-29cb-40cc-bb17-c765d5fa7752-kube-api-access-86rr8\") pod \"downloads-6594f4c75-4f587\" (UID: \"2be99b1a-29cb-40cc-bb17-c765d5fa7752\") " pod="openshift-console/downloads-6594f4c75-4f587"
Sep 20 01:53:41.220157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.219924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-oauth-config\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.220157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.219949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-serving-cert\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.220157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.219969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thzz6\" (UniqueName: \"kubernetes.io/projected/bed87565-e264-4348-a8c4-acf47fe8dbf8-kube-api-access-thzz6\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.220157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.219994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bed87565-e264-4348-a8c4-acf47fe8dbf8-installation-pull-secrets\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.220157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-config\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.220157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-service-ca\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.220157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bed87565-e264-4348-a8c4-acf47fe8dbf8-bound-sa-token\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.220157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzxjw\" (UniqueName: \"kubernetes.io/projected/aa936fe8-fcfc-4aee-a47c-208eef1c475f-kube-api-access-zzxjw\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.220528 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bed87565-e264-4348-a8c4-acf47fe8dbf8-ca-trust-extracted\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.220528 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bed87565-e264-4348-a8c4-acf47fe8dbf8-image-registry-private-configuration\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.220528 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bed87565-e264-4348-a8c4-acf47fe8dbf8-trusted-ca\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.220528 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-oauth-serving-cert\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.220528 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f8a5a4e-455f-45ef-b011-f11ddf379434-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-4zzkg\" (UID: \"4f8a5a4e-455f-45ef-b011-f11ddf379434\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"
Sep 20 01:53:41.220810 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-service-ca\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.220904 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.220879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-config\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.221019 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.221000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-oauth-serving-cert\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.222783 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.222752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f8a5a4e-455f-45ef-b011-f11ddf379434-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-4zzkg\" (UID: \"4f8a5a4e-455f-45ef-b011-f11ddf379434\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"
Sep 20 01:53:41.222783 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.222764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-oauth-config\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.222935 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.222904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-serving-cert\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.226266 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.226252    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjlfs\""
Sep 20 01:53:41.229720 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.229701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rr8\" (UniqueName: \"kubernetes.io/projected/2be99b1a-29cb-40cc-bb17-c765d5fa7752-kube-api-access-86rr8\") pod \"downloads-6594f4c75-4f587\" (UID: \"2be99b1a-29cb-40cc-bb17-c765d5fa7752\") " pod="openshift-console/downloads-6594f4c75-4f587"
Sep 20 01:53:41.230320 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.230300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzxjw\" (UniqueName: \"kubernetes.io/projected/aa936fe8-fcfc-4aee-a47c-208eef1c475f-kube-api-access-zzxjw\") pod \"console-648df7864b-65c4k\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") " pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.231935 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.231917    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cvrtw\""
Sep 20 01:53:41.233656 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.233638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhndp"
Sep 20 01:53:41.234706 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.234692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-778g4"
Sep 20 01:53:41.239827 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.239814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:41.322121 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.321563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bed87565-e264-4348-a8c4-acf47fe8dbf8-bound-sa-token\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.322121 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.321622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bed87565-e264-4348-a8c4-acf47fe8dbf8-ca-trust-extracted\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.322121 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.321653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bed87565-e264-4348-a8c4-acf47fe8dbf8-image-registry-private-configuration\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.322121 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.321677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bed87565-e264-4348-a8c4-acf47fe8dbf8-trusted-ca\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.322121 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.321718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bed87565-e264-4348-a8c4-acf47fe8dbf8-registry-tls\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.322121 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.321741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bed87565-e264-4348-a8c4-acf47fe8dbf8-registry-certificates\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.322121 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.321774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thzz6\" (UniqueName: \"kubernetes.io/projected/bed87565-e264-4348-a8c4-acf47fe8dbf8-kube-api-access-thzz6\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.324065 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.322872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bed87565-e264-4348-a8c4-acf47fe8dbf8-ca-trust-extracted\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.324065 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.323056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bed87565-e264-4348-a8c4-acf47fe8dbf8-installation-pull-secrets\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.324065 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.323299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bed87565-e264-4348-a8c4-acf47fe8dbf8-trusted-ca\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.324065 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.323745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bed87565-e264-4348-a8c4-acf47fe8dbf8-registry-certificates\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.325284 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.325017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bed87565-e264-4348-a8c4-acf47fe8dbf8-registry-tls\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.325917 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.325766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bed87565-e264-4348-a8c4-acf47fe8dbf8-installation-pull-secrets\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.327184 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.327153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bed87565-e264-4348-a8c4-acf47fe8dbf8-image-registry-private-configuration\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.331353 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.331324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bed87565-e264-4348-a8c4-acf47fe8dbf8-bound-sa-token\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.333954 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.333909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzz6\" (UniqueName: \"kubernetes.io/projected/bed87565-e264-4348-a8c4-acf47fe8dbf8-kube-api-access-thzz6\") pod \"image-registry-c9b7f6b9b-nkh9v\" (UID: \"bed87565-e264-4348-a8c4-acf47fe8dbf8\") " pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.345562 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.345534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"
Sep 20 01:53:41.360528 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.360496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-4f587"
Sep 20 01:53:41.381376 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.381345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:53:41.454392 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.454363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:41.544354 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.544169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhndp"]
Sep 20 01:53:41.547942 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:41.547918    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55f74b3_998f_4803_8995_148073e16174.slice/crio-8b561573789a6ba2afbb2343185b368e280eb12f97fdfb14b6e4999c78e10491 WatchSource:0}: Error finding container 8b561573789a6ba2afbb2343185b368e280eb12f97fdfb14b6e4999c78e10491: Status 404 returned error can't find the container with id 8b561573789a6ba2afbb2343185b368e280eb12f97fdfb14b6e4999c78e10491
Sep 20 01:53:41.589849 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.589825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-778g4"]
Sep 20 01:53:41.606372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.606343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhndp" event={"ID":"f55f74b3-998f-4803-8995-148073e16174","Type":"ContainerStarted","Data":"8b561573789a6ba2afbb2343185b368e280eb12f97fdfb14b6e4999c78e10491"}
Sep 20 01:53:41.607533 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.607504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-778g4" event={"ID":"204b7d5a-158d-4155-bae7-2a8939c27ce0","Type":"ContainerStarted","Data":"9e1ebbb2d8b0ca24bcac97cd39b49d58705782eae97f115e39a45619f384dbc3"}
Sep 20 01:53:41.624012 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.623992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99klh"]
Sep 20 01:53:41.625969 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:41.625944    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048c60e4_1673_4f2c_8471_c12082318f9a.slice/crio-a984f94aaaeaeba44f7bf345cca38791c96c3e89d9bb9249449023144b5d8dd4 WatchSource:0}: Error finding container a984f94aaaeaeba44f7bf345cca38791c96c3e89d9bb9249449023144b5d8dd4: Status 404 returned error can't find the container with id a984f94aaaeaeba44f7bf345cca38791c96c3e89d9bb9249449023144b5d8dd4
Sep 20 01:53:41.646225 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.646201    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"]
Sep 20 01:53:41.649709 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:41.649691    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8a5a4e_455f_45ef_b011_f11ddf379434.slice/crio-4494a66736410a16e72eedda74c9b0d20da8e3fbdf1dd6a546c469831ff1d307 WatchSource:0}: Error finding container 4494a66736410a16e72eedda74c9b0d20da8e3fbdf1dd6a546c469831ff1d307: Status 404 returned error can't find the container with id 4494a66736410a16e72eedda74c9b0d20da8e3fbdf1dd6a546c469831ff1d307
Sep 20 01:53:41.690609 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.690589    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-4f587"]
Sep 20 01:53:41.692629 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:41.692605    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be99b1a_29cb_40cc_bb17_c765d5fa7752.slice/crio-7df8624aad5d68d05d806931baec82448e0578babb91e8be05eeba8eb55b539c WatchSource:0}: Error finding container 7df8624aad5d68d05d806931baec82448e0578babb91e8be05eeba8eb55b539c: Status 404 returned error can't find the container with id 7df8624aad5d68d05d806931baec82448e0578babb91e8be05eeba8eb55b539c
Sep 20 01:53:41.708204 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.708185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648df7864b-65c4k"]
Sep 20 01:53:41.710216 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:41.710192    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa936fe8_fcfc_4aee_a47c_208eef1c475f.slice/crio-e4b9a44bf29a67c5487fb4ba4bfbcc10b5c9e1948fb077c429b8e60859dd70e8 WatchSource:0}: Error finding container e4b9a44bf29a67c5487fb4ba4bfbcc10b5c9e1948fb077c429b8e60859dd70e8: Status 404 returned error can't find the container with id e4b9a44bf29a67c5487fb4ba4bfbcc10b5c9e1948fb077c429b8e60859dd70e8
Sep 20 01:53:41.759775 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:41.759750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"]
Sep 20 01:53:41.762447 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:41.762426    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed87565_e264_4348_a8c4_acf47fe8dbf8.slice/crio-98d4f7310c1c3b4545790d0366c5d9f718b2433ece222548311f835d256ffd91 WatchSource:0}: Error finding container 98d4f7310c1c3b4545790d0366c5d9f718b2433ece222548311f835d256ffd91: Status 404 returned error can't find the container with id 98d4f7310c1c3b4545790d0366c5d9f718b2433ece222548311f835d256ffd91
Sep 20 01:53:42.614369 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:42.614300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99klh" event={"ID":"048c60e4-1673-4f2c-8471-c12082318f9a","Type":"ContainerStarted","Data":"a984f94aaaeaeba44f7bf345cca38791c96c3e89d9bb9249449023144b5d8dd4"}
Sep 20 01:53:42.617300 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:42.616472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v" event={"ID":"bed87565-e264-4348-a8c4-acf47fe8dbf8","Type":"ContainerStarted","Data":"0105aecf8450401496cdabab01b0d212cc2e6fe3926d18e07ac84b5ee7a8254a"}
Sep 20 01:53:42.617300 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:42.616524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v" event={"ID":"bed87565-e264-4348-a8c4-acf47fe8dbf8","Type":"ContainerStarted","Data":"98d4f7310c1c3b4545790d0366c5d9f718b2433ece222548311f835d256ffd91"}
Sep 20 01:53:42.617300 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:42.617234    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:53:42.618724 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:42.618697    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg" event={"ID":"4f8a5a4e-455f-45ef-b011-f11ddf379434","Type":"ContainerStarted","Data":"4494a66736410a16e72eedda74c9b0d20da8e3fbdf1dd6a546c469831ff1d307"}
Sep 20 01:53:42.620837 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:42.620810    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648df7864b-65c4k" event={"ID":"aa936fe8-fcfc-4aee-a47c-208eef1c475f","Type":"ContainerStarted","Data":"e4b9a44bf29a67c5487fb4ba4bfbcc10b5c9e1948fb077c429b8e60859dd70e8"}
Sep 20 01:53:42.622816 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:42.622770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-4f587" event={"ID":"2be99b1a-29cb-40cc-bb17-c765d5fa7752","Type":"ContainerStarted","Data":"7df8624aad5d68d05d806931baec82448e0578babb91e8be05eeba8eb55b539c"}
Sep 20 01:53:42.637602 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:42.637554    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v" podStartSLOduration=1.63753702 podStartE2EDuration="1.63753702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:42.635597445 +0000 UTC m=+67.920609380" watchObservedRunningTime="2026-09-20 01:53:42.63753702 +0000 UTC m=+67.922548949"
Sep 20 01:53:44.654101 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:44.654061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-778g4" event={"ID":"204b7d5a-158d-4155-bae7-2a8939c27ce0","Type":"ContainerStarted","Data":"343be1abcc861222a9e836f92c205367aa3d4a3bc739fc0ad731c6a26586aaad"}
Sep 20 01:53:44.654758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:44.654730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-778g4" event={"ID":"204b7d5a-158d-4155-bae7-2a8939c27ce0","Type":"ContainerStarted","Data":"957268f7b38137c729edca5b76fbc8abec3ca5e0a47a1b012b2ef343caa55029"}
Sep 20 01:53:44.663083 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:44.662986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg" event={"ID":"4f8a5a4e-455f-45ef-b011-f11ddf379434","Type":"ContainerStarted","Data":"8ecd624b055c6c91b52083c32f73c8abd3cff7457bc93eafa7191872047dcc2b"}
Sep 20 01:53:44.663083 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:44.663046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"
Sep 20 01:53:44.670470 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:44.670448    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg"
Sep 20 01:53:44.671762 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:44.671686    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-778g4" podStartSLOduration=66.528145638 podStartE2EDuration="1m8.671670826s" totalImagesPullingTime="2.143525188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:44.670768193 +0000 UTC m=+69.955780129" watchObservedRunningTime="2026-09-20 01:53:44.671670826 +0000 UTC m=+69.956682762"
Sep 20 01:53:44.689139 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:44.688453    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4zzkg" podStartSLOduration=2.610210713 podStartE2EDuration="4.688432688s" totalImagesPullingTime="2.078221975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:44.687952753 +0000 UTC m=+69.972964690" watchObservedRunningTime="2026-09-20 01:53:44.688432688 +0000 UTC m=+69.973444625"
Sep 20 01:53:49.442175 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.442143    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x5h8b"]
Sep 20 01:53:49.457643 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.457614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.462807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.461259    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 20 01:53:49.462807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.461303    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 20 01:53:49.462807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.461461    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 20 01:53:49.462807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.461879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 20 01:53:49.462807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.462145    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 20 01:53:49.462807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.462384    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bclt5\""
Sep 20 01:53:49.462807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.462580    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 20 01:53:49.491472 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.491442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-metrics-client-ca\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.491628 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.491545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-root\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.491628 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.491616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5msjb\" (UniqueName: \"kubernetes.io/projected/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-kube-api-access-5msjb\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.491748 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.491652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.491748 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.491685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-textfile\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.491748 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.491716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-tls\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.491930 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.491741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-wtmp\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.491930 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.491813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.491930 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.491845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-sys\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593043 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-metrics-client-ca\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593212 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-root\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593212 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-root\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593212 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5msjb\" (UniqueName: \"kubernetes.io/projected/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-kube-api-access-5msjb\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593212 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593429 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-textfile\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593429 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-tls\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593429 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-wtmp\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593530 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593530 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-sys\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593599 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-sys\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593632 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593604    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-wtmp\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593632 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-textfile\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593693 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-metrics-client-ca\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.593742 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.593720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.596181 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.596155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.596330 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.596311    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-node-exporter-tls\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.600604 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.600586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5msjb\" (UniqueName: \"kubernetes.io/projected/8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf-kube-api-access-5msjb\") pod \"node-exporter-x5h8b\" (UID: \"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf\") " pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:49.773467 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:49.773430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5h8b"
Sep 20 01:53:50.499726 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.499690    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 01:53:50.507998 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.507971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.510881 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.510446    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 20 01:53:50.510881 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.510445    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 20 01:53:50.510881 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.510610    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tnh7f\""
Sep 20 01:53:50.510881 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.510700    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 20 01:53:50.510881 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.510814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 20 01:53:50.511190 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.510943    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 20 01:53:50.511190 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.510952    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 20 01:53:50.511190 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.510965    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 20 01:53:50.511190 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.510943    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 20 01:53:50.511190 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.511032    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 20 01:53:50.518981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.518955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 01:53:50.603377 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.603569 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-out\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.603569 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.603569 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-volume\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.603744 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.603744 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.603744 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh96j\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-kube-api-access-zh96j\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.603744 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-web-config\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.603744 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.603744 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.604080 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.604080 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.604080 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.603864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.704996 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.704958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705205 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705205 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-out\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705205 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705205 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-volume\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705205 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705205 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705205 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh96j\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-kube-api-access-zh96j\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705526 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-web-config\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705526 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705526 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705526 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705526 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.705762 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.705748    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.707533 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.706228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.707533 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.707492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.708685 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.708651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.709935 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.709882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.710852 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.710807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.711415 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.711372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-web-config\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.712427 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.711967    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-volume\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.712427 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.711970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.712427 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.712347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.712427 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.712386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.713023 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.712996    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-out\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.714238 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.714216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh96j\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-kube-api-access-zh96j\") pod \"alertmanager-main-0\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.821273 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:50.821189    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:53:50.882050 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:50.881994    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8034b0b3_ccfc_4c9a_86b8_fdc16138e6cf.slice/crio-6e778c52b69583437928532029548e971a575528992ce588dc64ba0628d32033 WatchSource:0}: Error finding container 6e778c52b69583437928532029548e971a575528992ce588dc64ba0628d32033: Status 404 returned error can't find the container with id 6e778c52b69583437928532029548e971a575528992ce588dc64ba0628d32033
Sep 20 01:53:51.158460 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.158242    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 01:53:51.161519 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:53:51.161488    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adf3110_59d3_4fd1_b843_dd33cf3feeed.slice/crio-45d27d08cbb9252a609b0b4ae6a095fa9ef11159dc09c8531e1c138a88de4411 WatchSource:0}: Error finding container 45d27d08cbb9252a609b0b4ae6a095fa9ef11159dc09c8531e1c138a88de4411: Status 404 returned error can't find the container with id 45d27d08cbb9252a609b0b4ae6a095fa9ef11159dc09c8531e1c138a88de4411
Sep 20 01:53:51.693842 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.693735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648df7864b-65c4k" event={"ID":"aa936fe8-fcfc-4aee-a47c-208eef1c475f","Type":"ContainerStarted","Data":"b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c"}
Sep 20 01:53:51.695154 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.695122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5h8b" event={"ID":"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf","Type":"ContainerStarted","Data":"6e778c52b69583437928532029548e971a575528992ce588dc64ba0628d32033"}
Sep 20 01:53:51.697208 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.697141    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhndp" event={"ID":"f55f74b3-998f-4803-8995-148073e16174","Type":"ContainerStarted","Data":"ad6ba41212f85e87d858b73388b4de5582a4d0fa24031902cbe19734e1d2083b"}
Sep 20 01:53:51.699120 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.698963    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99klh" event={"ID":"048c60e4-1673-4f2c-8471-c12082318f9a","Type":"ContainerStarted","Data":"3d6198bd7b6868b386bcfb4027f0e1ceda5dc7a3affe30f8bbe59ab878bb7d3d"}
Sep 20 01:53:51.699330 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.699287    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:53:51.700634 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.700611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerStarted","Data":"45d27d08cbb9252a609b0b4ae6a095fa9ef11159dc09c8531e1c138a88de4411"}
Sep 20 01:53:51.723600 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.723475    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-99klh" podStartSLOduration=66.47762768 podStartE2EDuration="1m15.723455131s" totalImagesPullingTime="9.245827451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:51.722637779 +0000 UTC m=+77.007649712" watchObservedRunningTime="2026-09-20 01:53:51.723455131 +0000 UTC m=+77.008467066"
Sep 20 01:53:51.723809 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.723762    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648df7864b-65c4k" podStartSLOduration=2.4793015 podStartE2EDuration="11.723751456s" totalImagesPullingTime="9.244449956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:51.709504672 +0000 UTC m=+76.994516643" watchObservedRunningTime="2026-09-20 01:53:51.723751456 +0000 UTC m=+77.008763394"
Sep 20 01:53:51.736066 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:51.736024    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lhndp" podStartSLOduration=66.411455074 podStartE2EDuration="1m15.736008835s" totalImagesPullingTime="9.324553761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:51.735630802 +0000 UTC m=+77.020642738" watchObservedRunningTime="2026-09-20 01:53:51.736008835 +0000 UTC m=+77.021020771"
Sep 20 01:53:52.708879 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:52.708844    2565 generic.go:356] "Generic (PLEG): container finished" podID="8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf" containerID="be8cf974192dab7a7ae64220a7df470f914c85987e4b78d380053599d5199116" exitCode=0
Sep 20 01:53:52.709316 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:52.708925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5h8b" event={"ID":"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf","Type":"ContainerDied","Data":"be8cf974192dab7a7ae64220a7df470f914c85987e4b78d380053599d5199116"}
Sep 20 01:53:52.710808 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:52.710764    2565 generic.go:356] "Generic (PLEG): container finished" podID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerID="224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590" exitCode=0
Sep 20 01:53:52.710920 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:52.710827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerDied","Data":"224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590"}
Sep 20 01:53:53.719782 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.719742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5h8b" event={"ID":"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf","Type":"ContainerStarted","Data":"2133f04abb137fca605795d5d701259ab120f0135a202e23866bb98d64d95663"}
Sep 20 01:53:53.720234 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.719825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5h8b" event={"ID":"8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf","Type":"ContainerStarted","Data":"be11314dbd1c5d4c8417e024d08c84cfc17555dfc7cae44c74f10034986ccb42"}
Sep 20 01:53:53.725598 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.725220    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-77dd7f697d-bs925"]
Sep 20 01:53:53.728588 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.728565    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.730992 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.730972    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 20 01:53:53.731118 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.731018    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n7tf8\""
Sep 20 01:53:53.731118 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.731080    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 20 01:53:53.731118 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.731102    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 20 01:53:53.731319 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.731305    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 20 01:53:53.731500 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.731479    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-btf4mm4dhkd7u\""
Sep 20 01:53:53.742342 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.740642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77dd7f697d-bs925"]
Sep 20 01:53:53.745434 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.744489    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x5h8b" podStartSLOduration=3.750302522 podStartE2EDuration="4.744468587s" totalImagesPullingTime="923.076067ms" totalInitContainerRuntime="71.089998ms" isStatefulPod=true podCreationTimestamp="2026-09-20 01:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:53:53.742716794 +0000 UTC m=+79.027728729" watchObservedRunningTime="2026-09-20 01:53:53.744468587 +0000 UTC m=+79.029480526"
Sep 20 01:53:53.835773 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.835734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1b1290-0aa9-4794-b968-e6c393f0d59a-client-ca-bundle\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.835950 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.835813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0c1b1290-0aa9-4794-b968-e6c393f0d59a-audit-log\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.835950 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.835874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0c1b1290-0aa9-4794-b968-e6c393f0d59a-metrics-server-audit-profiles\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.836075 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.836027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0c1b1290-0aa9-4794-b968-e6c393f0d59a-secret-metrics-server-client-certs\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.836134 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.836070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0c1b1290-0aa9-4794-b968-e6c393f0d59a-secret-metrics-server-tls\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.836134 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.836101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c1b1290-0aa9-4794-b968-e6c393f0d59a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.836330 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.836303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npvng\" (UniqueName: \"kubernetes.io/projected/0c1b1290-0aa9-4794-b968-e6c393f0d59a-kube-api-access-npvng\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.937707 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.937664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npvng\" (UniqueName: \"kubernetes.io/projected/0c1b1290-0aa9-4794-b968-e6c393f0d59a-kube-api-access-npvng\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.937907 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.937717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1b1290-0aa9-4794-b968-e6c393f0d59a-client-ca-bundle\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.937907 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.937747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0c1b1290-0aa9-4794-b968-e6c393f0d59a-audit-log\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.937907 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.937778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0c1b1290-0aa9-4794-b968-e6c393f0d59a-metrics-server-audit-profiles\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.937907 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.937836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0c1b1290-0aa9-4794-b968-e6c393f0d59a-secret-metrics-server-client-certs\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.937907 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.937861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0c1b1290-0aa9-4794-b968-e6c393f0d59a-secret-metrics-server-tls\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.937907 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.937884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c1b1290-0aa9-4794-b968-e6c393f0d59a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.938517 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.938492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0c1b1290-0aa9-4794-b968-e6c393f0d59a-audit-log\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.938667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.938612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c1b1290-0aa9-4794-b968-e6c393f0d59a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.939049 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.939024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0c1b1290-0aa9-4794-b968-e6c393f0d59a-metrics-server-audit-profiles\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.940674 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.940652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1b1290-0aa9-4794-b968-e6c393f0d59a-client-ca-bundle\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.940969 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.940949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0c1b1290-0aa9-4794-b968-e6c393f0d59a-secret-metrics-server-client-certs\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.941337 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.941315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0c1b1290-0aa9-4794-b968-e6c393f0d59a-secret-metrics-server-tls\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:53.945880 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:53.945859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npvng\" (UniqueName: \"kubernetes.io/projected/0c1b1290-0aa9-4794-b968-e6c393f0d59a-kube-api-access-npvng\") pod \"metrics-server-77dd7f697d-bs925\" (UID: \"0c1b1290-0aa9-4794-b968-e6c393f0d59a\") " pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:54.046533 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.046492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:53:54.211133 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.211099    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"]
Sep 20 01:53:54.214368 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.214344    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648df7864b-65c4k"]
Sep 20 01:53:54.214498 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.214448    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:53:54.216645 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.216623    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-v7fdl\""
Sep 20 01:53:54.216784 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.216624    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 20 01:53:54.222439 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.222386    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"]
Sep 20 01:53:54.340758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.340676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgtmf\" (UniqueName: \"kubernetes.io/projected/f5bcd148-a2a7-43fb-90bf-b13e227837dd-kube-api-access-rgtmf\") pod \"monitoring-plugin-5984459ff8-d59xz\" (UID: \"f5bcd148-a2a7-43fb-90bf-b13e227837dd\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:53:54.340933 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.340764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5bcd148-a2a7-43fb-90bf-b13e227837dd-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-d59xz\" (UID: \"f5bcd148-a2a7-43fb-90bf-b13e227837dd\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:53:54.441532 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.441497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5bcd148-a2a7-43fb-90bf-b13e227837dd-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-d59xz\" (UID: \"f5bcd148-a2a7-43fb-90bf-b13e227837dd\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:53:54.441708 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.441657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgtmf\" (UniqueName: \"kubernetes.io/projected/f5bcd148-a2a7-43fb-90bf-b13e227837dd-kube-api-access-rgtmf\") pod \"monitoring-plugin-5984459ff8-d59xz\" (UID: \"f5bcd148-a2a7-43fb-90bf-b13e227837dd\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:53:54.441708 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:54.441671    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 20 01:53:54.441846 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:53:54.441756    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bcd148-a2a7-43fb-90bf-b13e227837dd-monitoring-plugin-cert podName:f5bcd148-a2a7-43fb-90bf-b13e227837dd nodeName:}" failed. No retries permitted until 2026-09-20 01:53:54.941732138 +0000 UTC m=+80.226744060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f5bcd148-a2a7-43fb-90bf-b13e227837dd-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-d59xz" (UID: "f5bcd148-a2a7-43fb-90bf-b13e227837dd") : secret "monitoring-plugin-cert" not found
Sep 20 01:53:54.450182 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.450155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgtmf\" (UniqueName: \"kubernetes.io/projected/f5bcd148-a2a7-43fb-90bf-b13e227837dd-kube-api-access-rgtmf\") pod \"monitoring-plugin-5984459ff8-d59xz\" (UID: \"f5bcd148-a2a7-43fb-90bf-b13e227837dd\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:53:54.945601 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.945564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5bcd148-a2a7-43fb-90bf-b13e227837dd-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-d59xz\" (UID: \"f5bcd148-a2a7-43fb-90bf-b13e227837dd\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:53:54.948130 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:54.948110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5bcd148-a2a7-43fb-90bf-b13e227837dd-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-d59xz\" (UID: \"f5bcd148-a2a7-43fb-90bf-b13e227837dd\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:53:55.126663 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.126631    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:53:55.602209 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.602178    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 01:53:55.605821 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.605801    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.608545 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.608418    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 20 01:53:55.608735 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.608716    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 20 01:53:55.608810 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.608745    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 20 01:53:55.608810 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.608723    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 20 01:53:55.608929 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.608810    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 20 01:53:55.609555 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.609534    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 20 01:53:55.609644 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.609535    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d25vu9jqu79jg\""
Sep 20 01:53:55.609925 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.609907    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 20 01:53:55.610592 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.610569    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 20 01:53:55.610682 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.610595    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 20 01:53:55.610747 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.610701    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 20 01:53:55.610747 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.610734    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-88zcg\""
Sep 20 01:53:55.612654 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.611257    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 20 01:53:55.612654 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.612354    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 20 01:53:55.613408 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.613387    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 20 01:53:55.615677 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.614978    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 20 01:53:55.631061 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.631031    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 01:53:55.750802 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.750757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.750982 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.750817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.750982 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.750878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-web-config\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.750982 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.750901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config-out\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.750982 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.750920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751177 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.750998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751177 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751177 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751177 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751177 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751410 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74hhp\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-kube-api-access-74hhp\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751410 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751410 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751410 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751410 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751410 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751410 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751668 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751668 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.751668 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.751512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852106 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852106 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74hhp\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-kube-api-access-74hhp\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852226    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852372 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-web-config\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config-out\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.852758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.853260 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.852833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.853351 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.853325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.853864 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.853471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.853864 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.853804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.854052 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.854029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.854124 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.854086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.854705 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.854679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.855873 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.855849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config-out\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.858353 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.856724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.858353 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.857130    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.858353 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.857659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.858353 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.857883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.858353 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.858057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.858353 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.858332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.858697 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.858616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-web-config\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.859308 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.859277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.860068 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.860049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.860602 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.860580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.860905 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.860865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.861195 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.861175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74hhp\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-kube-api-access-74hhp\") pod \"prometheus-k8s-0\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:53:55.918646 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:53:55.918616    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:54:01.342831 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.341943    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"]
Sep 20 01:54:01.344198 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.344084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77dd7f697d-bs925"]
Sep 20 01:54:01.351116 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.350982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 01:54:01.352278 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:54:01.352213    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc977bfc3_3dae_4b04_8a1d_8509c50eb038.slice/crio-d025a37ba1ae8ae4bffcb8fa2565337ea6f504e5f0200fc6a5bf21c35d9e9255 WatchSource:0}: Error finding container d025a37ba1ae8ae4bffcb8fa2565337ea6f504e5f0200fc6a5bf21c35d9e9255: Status 404 returned error can't find the container with id d025a37ba1ae8ae4bffcb8fa2565337ea6f504e5f0200fc6a5bf21c35d9e9255
Sep 20 01:54:01.382498 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.382432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:54:01.762029 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.761994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerStarted","Data":"208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570"}
Sep 20 01:54:01.762376 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.762336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerStarted","Data":"0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6"}
Sep 20 01:54:01.762504 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.762397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerStarted","Data":"ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62"}
Sep 20 01:54:01.762504 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.762437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerStarted","Data":"96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364"}
Sep 20 01:54:01.762504 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.762476    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerStarted","Data":"3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5"}
Sep 20 01:54:01.763649 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.763621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz" event={"ID":"f5bcd148-a2a7-43fb-90bf-b13e227837dd","Type":"ContainerStarted","Data":"c9289dda1c3b232cc772449837c0fb318dee0def2260a842c2d498d1c657cfc4"}
Sep 20 01:54:01.769553 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.769523    2565 generic.go:356] "Generic (PLEG): container finished" podID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerID="5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19" exitCode=0
Sep 20 01:54:01.769685 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.769666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerDied","Data":"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"}
Sep 20 01:54:01.769824 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.769807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerStarted","Data":"d025a37ba1ae8ae4bffcb8fa2565337ea6f504e5f0200fc6a5bf21c35d9e9255"}
Sep 20 01:54:01.772161 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.772033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77dd7f697d-bs925" event={"ID":"0c1b1290-0aa9-4794-b968-e6c393f0d59a","Type":"ContainerStarted","Data":"28f3fa4bb83fc87a0c79178282f9810cf8dbfcc594cda1254e3d9d85f15d7a86"}
Sep 20 01:54:01.774150 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.774040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-4f587" event={"ID":"2be99b1a-29cb-40cc-bb17-c765d5fa7752","Type":"ContainerStarted","Data":"d06bd0fdfe31c045e8257927f82ae7772e5aec439fd0a4e3aea90bcac0352f77"}
Sep 20 01:54:01.774525 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.774502    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-4f587"
Sep 20 01:54:01.787245 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.787217    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-4f587"
Sep 20 01:54:01.810101 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:01.810031    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-4f587" podStartSLOduration=2.442557286 podStartE2EDuration="21.810014684s" totalImagesPullingTime="19.367457398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:54:01.80946675 +0000 UTC m=+87.094478686" watchObservedRunningTime="2026-09-20 01:54:01.810014684 +0000 UTC m=+87.095026619"
Sep 20 01:54:04.668888 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:04.668831    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c9b7f6b9b-nkh9v"
Sep 20 01:54:04.797661 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:04.797639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerStarted","Data":"0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd"}
Sep 20 01:54:05.804893 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:05.804843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz" event={"ID":"f5bcd148-a2a7-43fb-90bf-b13e227837dd","Type":"ContainerStarted","Data":"859533caba6e96ef39975e8931a5a86688bde054bbac758b9068845bbf0454bf"}
Sep 20 01:54:05.805441 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:05.805073    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:54:05.808918 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:05.808887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77dd7f697d-bs925" event={"ID":"0c1b1290-0aa9-4794-b968-e6c393f0d59a","Type":"ContainerStarted","Data":"ce66a27ec02ea626e1938dfa1b5a6365a1b695f43cec187d06ffb855a74a5005"}
Sep 20 01:54:05.810867 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:05.810841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz"
Sep 20 01:54:05.822552 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:05.822499    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-d59xz" podStartSLOduration=8.524238474 podStartE2EDuration="11.822479345s" totalImagesPullingTime="3.298240871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:54:05.821100569 +0000 UTC m=+91.106112506" watchObservedRunningTime="2026-09-20 01:54:05.822479345 +0000 UTC m=+91.107491280"
Sep 20 01:54:05.849555 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:05.849448    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.867114046 podStartE2EDuration="15.849427994s" totalImagesPullingTime="12.959721508s" totalInitContainerRuntime="22.59244ms" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:54:05.848020922 +0000 UTC m=+91.133032860" watchObservedRunningTime="2026-09-20 01:54:05.849427994 +0000 UTC m=+91.134439929"
Sep 20 01:54:05.869561 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:05.866087    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-77dd7f697d-bs925" podStartSLOduration=9.571150274 podStartE2EDuration="12.866065993s" totalImagesPullingTime="3.294915719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:54:05.864866278 +0000 UTC m=+91.149878213" watchObservedRunningTime="2026-09-20 01:54:05.866065993 +0000 UTC m=+91.151077930"
Sep 20 01:54:07.821682 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:07.821530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerStarted","Data":"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"}
Sep 20 01:54:07.821682 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:07.821631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerStarted","Data":"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"}
Sep 20 01:54:09.835614 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:09.835580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerStarted","Data":"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"}
Sep 20 01:54:09.835994 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:09.835659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerStarted","Data":"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"}
Sep 20 01:54:10.842529 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:10.842495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerStarted","Data":"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"}
Sep 20 01:54:10.842940 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:10.842560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerStarted","Data":"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"}
Sep 20 01:54:10.874764 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:10.874698    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.352807574 podStartE2EDuration="15.874675702s" totalImagesPullingTime="7.495240179s" totalInitContainerRuntime="26.627949ms" isStatefulPod=false podCreationTimestamp="2026-09-20 01:53:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:54:10.869271127 +0000 UTC m=+96.154283063" watchObservedRunningTime="2026-09-20 01:54:10.874675702 +0000 UTC m=+96.159687640"
Sep 20 01:54:10.919100 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:10.919065    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:54:14.046871 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:14.046837    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:54:14.047434 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:14.046915    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:54:19.243060 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.243005    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-648df7864b-65c4k" podUID="aa936fe8-fcfc-4aee-a47c-208eef1c475f" containerName="console" containerID="cri-o://b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c" gracePeriod=15
Sep 20 01:54:19.517256 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.517203    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:54:19.571632 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.571601    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-service-ca\") pod \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") "
Sep 20 01:54:19.571820 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.571649    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-oauth-config\") pod \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") "
Sep 20 01:54:19.571820 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.571677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-serving-cert\") pod \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") "
Sep 20 01:54:19.571820 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.571769    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-oauth-serving-cert\") pod \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") "
Sep 20 01:54:19.571962 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.571860    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzxjw\" (UniqueName: \"kubernetes.io/projected/aa936fe8-fcfc-4aee-a47c-208eef1c475f-kube-api-access-zzxjw\") pod \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") "
Sep 20 01:54:19.571962 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.571900    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-config\") pod \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\" (UID: \"aa936fe8-fcfc-4aee-a47c-208eef1c475f\") "
Sep 20 01:54:19.572957 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.572902    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa936fe8-fcfc-4aee-a47c-208eef1c475f" (UID: "aa936fe8-fcfc-4aee-a47c-208eef1c475f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:54:19.573160 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.573132    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-config" (OuterVolumeSpecName: "console-config") pod "aa936fe8-fcfc-4aee-a47c-208eef1c475f" (UID: "aa936fe8-fcfc-4aee-a47c-208eef1c475f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:54:19.573228 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.573166    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-oauth-serving-cert\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:54:19.575459 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.573398    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa936fe8-fcfc-4aee-a47c-208eef1c475f" (UID: "aa936fe8-fcfc-4aee-a47c-208eef1c475f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:54:19.576521 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.575698    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa936fe8-fcfc-4aee-a47c-208eef1c475f" (UID: "aa936fe8-fcfc-4aee-a47c-208eef1c475f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:54:19.576521 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.575813    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa936fe8-fcfc-4aee-a47c-208eef1c475f" (UID: "aa936fe8-fcfc-4aee-a47c-208eef1c475f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:54:19.578953 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.578928    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa936fe8-fcfc-4aee-a47c-208eef1c475f-kube-api-access-zzxjw" (OuterVolumeSpecName: "kube-api-access-zzxjw") pod "aa936fe8-fcfc-4aee-a47c-208eef1c475f" (UID: "aa936fe8-fcfc-4aee-a47c-208eef1c475f"). InnerVolumeSpecName "kube-api-access-zzxjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:54:19.673763 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.673732    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzxjw\" (UniqueName: \"kubernetes.io/projected/aa936fe8-fcfc-4aee-a47c-208eef1c475f-kube-api-access-zzxjw\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:54:19.673763 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.673759    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-config\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:54:19.673763 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.673769    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa936fe8-fcfc-4aee-a47c-208eef1c475f-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:54:19.673984 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.673777    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-oauth-config\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:54:19.673984 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.673810    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa936fe8-fcfc-4aee-a47c-208eef1c475f-console-serving-cert\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:54:19.877234 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.877151    2565 generic.go:356] "Generic (PLEG): container finished" podID="aa936fe8-fcfc-4aee-a47c-208eef1c475f" containerID="b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c" exitCode=0
Sep 20 01:54:19.877234 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.877191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648df7864b-65c4k" event={"ID":"aa936fe8-fcfc-4aee-a47c-208eef1c475f","Type":"ContainerDied","Data":"b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c"}
Sep 20 01:54:19.877234 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.877210    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648df7864b-65c4k"
Sep 20 01:54:19.877539 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.877253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648df7864b-65c4k" event={"ID":"aa936fe8-fcfc-4aee-a47c-208eef1c475f","Type":"ContainerDied","Data":"e4b9a44bf29a67c5487fb4ba4bfbcc10b5c9e1948fb077c429b8e60859dd70e8"}
Sep 20 01:54:19.877539 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.877274    2565 scope.go:117] "RemoveContainer" containerID="b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c"
Sep 20 01:54:19.886307 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.886287    2565 scope.go:117] "RemoveContainer" containerID="b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c"
Sep 20 01:54:19.886585 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:54:19.886565    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c\": container with ID starting with b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c not found: ID does not exist" containerID="b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c"
Sep 20 01:54:19.886640 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.886593    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c"} err="failed to get container status \"b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c\": rpc error: code = NotFound desc = could not find container \"b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c\": container with ID starting with b6b0d7369e9bbbe2b26ac294c3b6c8215a644f1dd8e08a7e670f06eecc45f77c not found: ID does not exist"
Sep 20 01:54:19.897378 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.897357    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648df7864b-65c4k"]
Sep 20 01:54:19.899685 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:19.899666    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-648df7864b-65c4k"]
Sep 20 01:54:21.219460 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:21.219426    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa936fe8-fcfc-4aee-a47c-208eef1c475f" path="/var/lib/kubelet/pods/aa936fe8-fcfc-4aee-a47c-208eef1c475f/volumes"
Sep 20 01:54:22.714048 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:22.714019    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-99klh"
Sep 20 01:54:34.053687 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:34.053656    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:54:34.057476 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:34.057452    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-77dd7f697d-bs925"
Sep 20 01:54:55.919526 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:55.919463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:54:55.938065 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:55.938036    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:54:56.030354 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:54:56.030327    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:09.659366 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:09.659327    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 01:55:09.659951 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:09.659696    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="alertmanager" containerID="cri-o://3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5" gracePeriod=120
Sep 20 01:55:09.659951 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:09.659779    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="prom-label-proxy" containerID="cri-o://0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd" gracePeriod=120
Sep 20 01:55:09.659951 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:09.659843    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="config-reloader" containerID="cri-o://96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364" gracePeriod=120
Sep 20 01:55:09.659951 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:09.659763    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy-metric" containerID="cri-o://208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570" gracePeriod=120
Sep 20 01:55:09.659951 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:09.659843    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy-web" containerID="cri-o://ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62" gracePeriod=120
Sep 20 01:55:09.660195 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:09.659855    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy" containerID="cri-o://0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6" gracePeriod=120
Sep 20 01:55:10.068303 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.068273    2565 generic.go:356] "Generic (PLEG): container finished" podID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerID="0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd" exitCode=0
Sep 20 01:55:10.068303 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.068298    2565 generic.go:356] "Generic (PLEG): container finished" podID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerID="0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6" exitCode=0
Sep 20 01:55:10.068303 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.068304    2565 generic.go:356] "Generic (PLEG): container finished" podID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerID="96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364" exitCode=0
Sep 20 01:55:10.068303 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.068311    2565 generic.go:356] "Generic (PLEG): container finished" podID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerID="3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5" exitCode=0
Sep 20 01:55:10.068552 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.068343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerDied","Data":"0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd"}
Sep 20 01:55:10.068552 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.068407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerDied","Data":"0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6"}
Sep 20 01:55:10.068552 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.068436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerDied","Data":"96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364"}
Sep 20 01:55:10.068552 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.068460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerDied","Data":"3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5"}
Sep 20 01:55:10.912853 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.912828    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:55:10.991675 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.991644    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-out\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.991873 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.991698    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-main-tls\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.991873 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.991725    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh96j\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-kube-api-access-zh96j\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.991873 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.991749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-metrics-client-ca\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.992040 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.991784    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-web-config\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.992040 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.991917    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-trusted-ca-bundle\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.992040 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.991945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-main-db\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.992040 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.991985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-web\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.992040 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.992013    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.992040 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.992040    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-volume\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.992365 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.992113    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.992365 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.992146    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-tls-assets\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.992365 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.992169    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-cluster-tls-config\") pod \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\" (UID: \"8adf3110-59d3-4fd1-b843-dd33cf3feeed\") "
Sep 20 01:55:10.993067 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.992136    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:55:10.993067 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.992308    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:55:10.994128 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.994097    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:55:10.995700 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.995646    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-kube-api-access-zh96j" (OuterVolumeSpecName: "kube-api-access-zh96j") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "kube-api-access-zh96j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:55:10.996062 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.996020    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:10.996174 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.996102    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:55:10.996304 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.996283    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:10.996456 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.996425    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:10.996671 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.996644    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:10.997349 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.997322    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-out" (OuterVolumeSpecName: "config-out") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:55:10.997349 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:10.997335    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-volume" (OuterVolumeSpecName: "config-volume") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:11.000324 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.000298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:11.006862 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.006833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-web-config" (OuterVolumeSpecName: "web-config") pod "8adf3110-59d3-4fd1-b843-dd33cf3feeed" (UID: "8adf3110-59d3-4fd1-b843-dd33cf3feeed"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:11.075155 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.075128    2565 generic.go:356] "Generic (PLEG): container finished" podID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerID="208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570" exitCode=0
Sep 20 01:55:11.075155 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.075151    2565 generic.go:356] "Generic (PLEG): container finished" podID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerID="ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62" exitCode=0
Sep 20 01:55:11.075383 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.075201    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 01:55:11.075383 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.075208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerDied","Data":"208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570"}
Sep 20 01:55:11.075383 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.075296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerDied","Data":"ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62"}
Sep 20 01:55:11.075383 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.075338    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8adf3110-59d3-4fd1-b843-dd33cf3feeed","Type":"ContainerDied","Data":"45d27d08cbb9252a609b0b4ae6a095fa9ef11159dc09c8531e1c138a88de4411"}
Sep 20 01:55:11.075383 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.075361    2565 scope.go:117] "RemoveContainer" containerID="0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd"
Sep 20 01:55:11.082621 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.082605    2565 scope.go:117] "RemoveContainer" containerID="208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570"
Sep 20 01:55:11.089686 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.089667    2565 scope.go:117] "RemoveContainer" containerID="0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6"
Sep 20 01:55:11.092906 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.092889    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-metrics-client-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.092981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.092908    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-web-config\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.092981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.092918    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.092981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.092926    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-alertmanager-main-db\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.092981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.092939    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.092981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.092955    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.092981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.092971    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.093158 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.092983    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.093158 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.092998    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-tls-assets\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.093158 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.093012    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-cluster-tls-config\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.093158 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.093022    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8adf3110-59d3-4fd1-b843-dd33cf3feeed-config-out\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.093158 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.093030    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8adf3110-59d3-4fd1-b843-dd33cf3feeed-secret-alertmanager-main-tls\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.093158 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.093038    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh96j\" (UniqueName: \"kubernetes.io/projected/8adf3110-59d3-4fd1-b843-dd33cf3feeed-kube-api-access-zh96j\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:11.096039 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.096017    2565 scope.go:117] "RemoveContainer" containerID="ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62"
Sep 20 01:55:11.099654 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.099632    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 01:55:11.102611 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.102594    2565 scope.go:117] "RemoveContainer" containerID="96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364"
Sep 20 01:55:11.107703 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.107684    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 01:55:11.110408 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.110395    2565 scope.go:117] "RemoveContainer" containerID="3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5"
Sep 20 01:55:11.117040 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.117026    2565 scope.go:117] "RemoveContainer" containerID="224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590"
Sep 20 01:55:11.123480 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.123404    2565 scope.go:117] "RemoveContainer" containerID="0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd"
Sep 20 01:55:11.123764 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:11.123743    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd\": container with ID starting with 0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd not found: ID does not exist" containerID="0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd"
Sep 20 01:55:11.123850 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.123768    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd"} err="failed to get container status \"0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd\": rpc error: code = NotFound desc = could not find container \"0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd\": container with ID starting with 0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd not found: ID does not exist"
Sep 20 01:55:11.123850 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.123804    2565 scope.go:117] "RemoveContainer" containerID="208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570"
Sep 20 01:55:11.124044 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:11.124024    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570\": container with ID starting with 208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570 not found: ID does not exist" containerID="208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570"
Sep 20 01:55:11.124143 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.124053    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570"} err="failed to get container status \"208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570\": rpc error: code = NotFound desc = could not find container \"208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570\": container with ID starting with 208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570 not found: ID does not exist"
Sep 20 01:55:11.124143 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.124075    2565 scope.go:117] "RemoveContainer" containerID="0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6"
Sep 20 01:55:11.124352 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:11.124334    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6\": container with ID starting with 0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6 not found: ID does not exist" containerID="0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6"
Sep 20 01:55:11.124391 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.124358    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6"} err="failed to get container status \"0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6\": rpc error: code = NotFound desc = could not find container \"0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6\": container with ID starting with 0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6 not found: ID does not exist"
Sep 20 01:55:11.124391 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.124375    2565 scope.go:117] "RemoveContainer" containerID="ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62"
Sep 20 01:55:11.124606 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:11.124590    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62\": container with ID starting with ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62 not found: ID does not exist" containerID="ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62"
Sep 20 01:55:11.124665 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.124613    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62"} err="failed to get container status \"ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62\": rpc error: code = NotFound desc = could not find container \"ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62\": container with ID starting with ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62 not found: ID does not exist"
Sep 20 01:55:11.124665 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.124634    2565 scope.go:117] "RemoveContainer" containerID="96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364"
Sep 20 01:55:11.124858 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:11.124839    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364\": container with ID starting with 96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364 not found: ID does not exist" containerID="96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364"
Sep 20 01:55:11.124906 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.124861    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364"} err="failed to get container status \"96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364\": rpc error: code = NotFound desc = could not find container \"96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364\": container with ID starting with 96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364 not found: ID does not exist"
Sep 20 01:55:11.124906 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.124874    2565 scope.go:117] "RemoveContainer" containerID="3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5"
Sep 20 01:55:11.125078 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:11.125063    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5\": container with ID starting with 3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5 not found: ID does not exist" containerID="3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5"
Sep 20 01:55:11.125122 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.125080    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5"} err="failed to get container status \"3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5\": rpc error: code = NotFound desc = could not find container \"3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5\": container with ID starting with 3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5 not found: ID does not exist"
Sep 20 01:55:11.125122 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.125092    2565 scope.go:117] "RemoveContainer" containerID="224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590"
Sep 20 01:55:11.125274 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:11.125256    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590\": container with ID starting with 224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590 not found: ID does not exist" containerID="224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590"
Sep 20 01:55:11.125310 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.125279    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590"} err="failed to get container status \"224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590\": rpc error: code = NotFound desc = could not find container \"224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590\": container with ID starting with 224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590 not found: ID does not exist"
Sep 20 01:55:11.125310 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.125293    2565 scope.go:117] "RemoveContainer" containerID="0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd"
Sep 20 01:55:11.125525 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.125508    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd"} err="failed to get container status \"0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd\": rpc error: code = NotFound desc = could not find container \"0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd\": container with ID starting with 0cf43769540e8d738369a91fa0bd1faf76931f9920174bb73c69cbc20fb845cd not found: ID does not exist"
Sep 20 01:55:11.125593 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.125527    2565 scope.go:117] "RemoveContainer" containerID="208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570"
Sep 20 01:55:11.125781 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.125762    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570"} err="failed to get container status \"208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570\": rpc error: code = NotFound desc = could not find container \"208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570\": container with ID starting with 208b0ff499cfc4bb042a1aa0401931882adb1fce90fbd955fbce76e60465b570 not found: ID does not exist"
Sep 20 01:55:11.125844 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.125782    2565 scope.go:117] "RemoveContainer" containerID="0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6"
Sep 20 01:55:11.126036 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.126015    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6"} err="failed to get container status \"0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6\": rpc error: code = NotFound desc = could not find container \"0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6\": container with ID starting with 0192ea8c5d171d98204b8564e3ca7e090016dc205eb3e72a9a9f0c0d7f91b8d6 not found: ID does not exist"
Sep 20 01:55:11.126102 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.126036    2565 scope.go:117] "RemoveContainer" containerID="ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62"
Sep 20 01:55:11.126275 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.126258    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62"} err="failed to get container status \"ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62\": rpc error: code = NotFound desc = could not find container \"ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62\": container with ID starting with ddf61f1ce53d449aeaa54db565c5dcf8a3de4cf9a76fce6631a4af3cea124d62 not found: ID does not exist"
Sep 20 01:55:11.126320 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.126276    2565 scope.go:117] "RemoveContainer" containerID="96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364"
Sep 20 01:55:11.126465 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.126446    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364"} err="failed to get container status \"96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364\": rpc error: code = NotFound desc = could not find container \"96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364\": container with ID starting with 96333afca2a5c1bbc05ec5c435f966fcb72a14b4ac072d9cc6d10446ab104364 not found: ID does not exist"
Sep 20 01:55:11.126504 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.126465    2565 scope.go:117] "RemoveContainer" containerID="3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5"
Sep 20 01:55:11.126681 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.126665    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5"} err="failed to get container status \"3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5\": rpc error: code = NotFound desc = could not find container \"3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5\": container with ID starting with 3f0faae80a687561f5fe1c85791902c79458b6ddaf80dc1c8a46f820040b38f5 not found: ID does not exist"
Sep 20 01:55:11.126810 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.126682    2565 scope.go:117] "RemoveContainer" containerID="224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590"
Sep 20 01:55:11.126899 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.126883    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590"} err="failed to get container status \"224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590\": rpc error: code = NotFound desc = could not find container \"224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590\": container with ID starting with 224c00589294850b7dd13927b9c07f1b6f8cc84e86e97fc6bbdf7708983b4590 not found: ID does not exist"
Sep 20 01:55:11.223119 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:11.223075    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" path="/var/lib/kubelet/pods/8adf3110-59d3-4fd1-b843-dd33cf3feeed/volumes"
Sep 20 01:55:14.017585 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.017549    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 01:55:14.018000 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.017849    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="prometheus" containerID="cri-o://4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8" gracePeriod=600
Sep 20 01:55:14.018000 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.017870    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy" containerID="cri-o://146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c" gracePeriod=600
Sep 20 01:55:14.018000 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.017894    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="config-reloader" containerID="cri-o://70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2" gracePeriod=600
Sep 20 01:55:14.018000 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.017950    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5" gracePeriod=600
Sep 20 01:55:14.018234 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.017907    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy-web" containerID="cri-o://2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26" gracePeriod=600
Sep 20 01:55:14.018234 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.017882    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="thanos-sidecar" containerID="cri-o://9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50" gracePeriod=600
Sep 20 01:55:14.261457 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.261432    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:14.318045 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.317958    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-serving-certs-ca-bundle\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318045 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.317999    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-metrics-client-certs\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318045 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-tls-assets\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318054    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-db\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318079    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-kube-rbac-proxy\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318100    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-tls\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318142    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-1\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318168    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-2\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-grpc-tls\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318222    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-trusted-ca-bundle\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318265    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-metrics-client-ca\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318712 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318325    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-web-config\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318712 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318354    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-kubelet-serving-ca-bundle\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318712 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318384    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-thanos-prometheus-http-client-file\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318712 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318399    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:55:14.318712 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318417    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74hhp\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-kube-api-access-74hhp\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318712 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318445    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config-out\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318712 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318469    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318712 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318504    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.318712 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318558    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-0\") pod \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\" (UID: \"c977bfc3-3dae-4b04-8a1d-8509c50eb038\") "
Sep 20 01:55:14.319143 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318892    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.319143 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.318942    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:55:14.319143 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.319108    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:55:14.319297 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.319214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:55:14.319522 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.319494    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:55:14.319601 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.319560    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:55:14.321224 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.321182    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:55:14.321335 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.321240    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:55:14.321943 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.321904    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:55:14.322233 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.322205    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:14.322319 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.322287    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:14.322495 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.322470    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:14.322838 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.322800    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:14.323131 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.323105    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:14.324062 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.324026    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config" (OuterVolumeSpecName: "config") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:14.324176 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.324147    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-kube-api-access-74hhp" (OuterVolumeSpecName: "kube-api-access-74hhp") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "kube-api-access-74hhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:55:14.324303 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.324264    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:14.324412 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.324351    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config-out" (OuterVolumeSpecName: "config-out") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:55:14.325199 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.325174    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:14.331648 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.331629    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-web-config" (OuterVolumeSpecName: "web-config") pod "c977bfc3-3dae-4b04-8a1d-8509c50eb038" (UID: "c977bfc3-3dae-4b04-8a1d-8509c50eb038"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:55:14.419377 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419326    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419377 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419368    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-metrics-client-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419377 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419379    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-web-config\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419377 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419387    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419377 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419397    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419406    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74hhp\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-kube-api-access-74hhp\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419416    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config-out\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419425    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-config\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419432    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419440    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419449    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-metrics-client-certs\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419458    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c977bfc3-3dae-4b04-8a1d-8509c50eb038-tls-assets\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419466    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-db\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419474    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-kube-rbac-proxy\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419482    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419490    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419500    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419508    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c977bfc3-3dae-4b04-8a1d-8509c50eb038-secret-grpc-tls\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:14.419667 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:14.419515    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c977bfc3-3dae-4b04-8a1d-8509c50eb038-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 01:55:15.098303 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098271    2565 generic.go:356] "Generic (PLEG): container finished" podID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerID="b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5" exitCode=0
Sep 20 01:55:15.098303 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098298    2565 generic.go:356] "Generic (PLEG): container finished" podID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerID="146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c" exitCode=0
Sep 20 01:55:15.098303 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098307    2565 generic.go:356] "Generic (PLEG): container finished" podID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerID="2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26" exitCode=0
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098319    2565 generic.go:356] "Generic (PLEG): container finished" podID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerID="9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50" exitCode=0
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098327    2565 generic.go:356] "Generic (PLEG): container finished" podID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerID="70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2" exitCode=0
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098335    2565 generic.go:356] "Generic (PLEG): container finished" podID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerID="4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8" exitCode=0
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerDied","Data":"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"}
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098358    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerDied","Data":"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"}
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerDied","Data":"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"}
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerDied","Data":"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"}
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098490    2565 scope.go:117] "RemoveContainer" containerID="b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerDied","Data":"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"}
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerDied","Data":"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"}
Sep 20 01:55:15.098807 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.098573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c977bfc3-3dae-4b04-8a1d-8509c50eb038","Type":"ContainerDied","Data":"d025a37ba1ae8ae4bffcb8fa2565337ea6f504e5f0200fc6a5bf21c35d9e9255"}
Sep 20 01:55:15.106677 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.106645    2565 scope.go:117] "RemoveContainer" containerID="146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"
Sep 20 01:55:15.113493 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.113479    2565 scope.go:117] "RemoveContainer" containerID="2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"
Sep 20 01:55:15.119861 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.119845    2565 scope.go:117] "RemoveContainer" containerID="9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"
Sep 20 01:55:15.122007 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.121978    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 01:55:15.126131 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.126108    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 01:55:15.127183 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.127164    2565 scope.go:117] "RemoveContainer" containerID="70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"
Sep 20 01:55:15.133408 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.133393    2565 scope.go:117] "RemoveContainer" containerID="4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"
Sep 20 01:55:15.139849 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.139832    2565 scope.go:117] "RemoveContainer" containerID="5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"
Sep 20 01:55:15.145857 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.145840    2565 scope.go:117] "RemoveContainer" containerID="b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"
Sep 20 01:55:15.146122 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:15.146105    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": container with ID starting with b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5 not found: ID does not exist" containerID="b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"
Sep 20 01:55:15.146165 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.146130    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"} err="failed to get container status \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": rpc error: code = NotFound desc = could not find container \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": container with ID starting with b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5 not found: ID does not exist"
Sep 20 01:55:15.146165 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.146150    2565 scope.go:117] "RemoveContainer" containerID="146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"
Sep 20 01:55:15.146364 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:15.146347    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": container with ID starting with 146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c not found: ID does not exist" containerID="146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"
Sep 20 01:55:15.146407 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.146370    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"} err="failed to get container status \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": rpc error: code = NotFound desc = could not find container \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": container with ID starting with 146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c not found: ID does not exist"
Sep 20 01:55:15.146407 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.146384    2565 scope.go:117] "RemoveContainer" containerID="2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"
Sep 20 01:55:15.146589 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:15.146573    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": container with ID starting with 2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26 not found: ID does not exist" containerID="2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"
Sep 20 01:55:15.146631 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.146592    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"} err="failed to get container status \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": rpc error: code = NotFound desc = could not find container \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": container with ID starting with 2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26 not found: ID does not exist"
Sep 20 01:55:15.146631 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.146606    2565 scope.go:117] "RemoveContainer" containerID="9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"
Sep 20 01:55:15.146932 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:15.146915    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": container with ID starting with 9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50 not found: ID does not exist" containerID="9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"
Sep 20 01:55:15.146977 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.146935    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"} err="failed to get container status \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": rpc error: code = NotFound desc = could not find container \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": container with ID starting with 9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50 not found: ID does not exist"
Sep 20 01:55:15.146977 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.146951    2565 scope.go:117] "RemoveContainer" containerID="70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"
Sep 20 01:55:15.147159 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:15.147144    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": container with ID starting with 70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2 not found: ID does not exist" containerID="70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"
Sep 20 01:55:15.147201 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.147163    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"} err="failed to get container status \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": rpc error: code = NotFound desc = could not find container \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": container with ID starting with 70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2 not found: ID does not exist"
Sep 20 01:55:15.147201 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.147177    2565 scope.go:117] "RemoveContainer" containerID="4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"
Sep 20 01:55:15.147378 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:15.147364    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": container with ID starting with 4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8 not found: ID does not exist" containerID="4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"
Sep 20 01:55:15.147420 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.147380    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"} err="failed to get container status \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": rpc error: code = NotFound desc = could not find container \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": container with ID starting with 4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8 not found: ID does not exist"
Sep 20 01:55:15.147420 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.147392    2565 scope.go:117] "RemoveContainer" containerID="5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"
Sep 20 01:55:15.147619 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:55:15.147604    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": container with ID starting with 5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19 not found: ID does not exist" containerID="5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"
Sep 20 01:55:15.147663 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.147623    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"} err="failed to get container status \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": rpc error: code = NotFound desc = could not find container \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": container with ID starting with 5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19 not found: ID does not exist"
Sep 20 01:55:15.147663 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.147636    2565 scope.go:117] "RemoveContainer" containerID="b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"
Sep 20 01:55:15.147859 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.147828    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"} err="failed to get container status \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": rpc error: code = NotFound desc = could not find container \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": container with ID starting with b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5 not found: ID does not exist"
Sep 20 01:55:15.147859 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.147844    2565 scope.go:117] "RemoveContainer" containerID="146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"
Sep 20 01:55:15.148107 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148092    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"} err="failed to get container status \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": rpc error: code = NotFound desc = could not find container \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": container with ID starting with 146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c not found: ID does not exist"
Sep 20 01:55:15.148154 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148107    2565 scope.go:117] "RemoveContainer" containerID="2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"
Sep 20 01:55:15.148331 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148313    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"} err="failed to get container status \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": rpc error: code = NotFound desc = could not find container \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": container with ID starting with 2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26 not found: ID does not exist"
Sep 20 01:55:15.148387 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148332    2565 scope.go:117] "RemoveContainer" containerID="9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"
Sep 20 01:55:15.148522 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148500    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"} err="failed to get container status \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": rpc error: code = NotFound desc = could not find container \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": container with ID starting with 9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50 not found: ID does not exist"
Sep 20 01:55:15.148569 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148525    2565 scope.go:117] "RemoveContainer" containerID="70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"
Sep 20 01:55:15.148762 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148743    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"} err="failed to get container status \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": rpc error: code = NotFound desc = could not find container \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": container with ID starting with 70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2 not found: ID does not exist"
Sep 20 01:55:15.148863 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148776    2565 scope.go:117] "RemoveContainer" containerID="4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"
Sep 20 01:55:15.148988 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148972    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"} err="failed to get container status \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": rpc error: code = NotFound desc = could not find container \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": container with ID starting with 4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8 not found: ID does not exist"
Sep 20 01:55:15.149029 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.148987    2565 scope.go:117] "RemoveContainer" containerID="5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"
Sep 20 01:55:15.149175 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.149159    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"} err="failed to get container status \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": rpc error: code = NotFound desc = could not find container \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": container with ID starting with 5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19 not found: ID does not exist"
Sep 20 01:55:15.149218 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.149175    2565 scope.go:117] "RemoveContainer" containerID="b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"
Sep 20 01:55:15.149387 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.149368    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"} err="failed to get container status \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": rpc error: code = NotFound desc = could not find container \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": container with ID starting with b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5 not found: ID does not exist"
Sep 20 01:55:15.149456 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.149388    2565 scope.go:117] "RemoveContainer" containerID="146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"
Sep 20 01:55:15.149600 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.149584    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"} err="failed to get container status \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": rpc error: code = NotFound desc = could not find container \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": container with ID starting with 146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c not found: ID does not exist"
Sep 20 01:55:15.149661 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.149601    2565 scope.go:117] "RemoveContainer" containerID="2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"
Sep 20 01:55:15.149840 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.149823    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"} err="failed to get container status \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": rpc error: code = NotFound desc = could not find container \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": container with ID starting with 2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26 not found: ID does not exist"
Sep 20 01:55:15.149910 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.149842    2565 scope.go:117] "RemoveContainer" containerID="9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"
Sep 20 01:55:15.150036 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.150020    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"} err="failed to get container status \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": rpc error: code = NotFound desc = could not find container \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": container with ID starting with 9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50 not found: ID does not exist"
Sep 20 01:55:15.150100 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.150036    2565 scope.go:117] "RemoveContainer" containerID="70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"
Sep 20 01:55:15.150286 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.150264    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"} err="failed to get container status \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": rpc error: code = NotFound desc = could not find container \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": container with ID starting with 70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2 not found: ID does not exist"
Sep 20 01:55:15.150342 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.150288    2565 scope.go:117] "RemoveContainer" containerID="4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"
Sep 20 01:55:15.150878 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.150741    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"} err="failed to get container status \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": rpc error: code = NotFound desc = could not find container \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": container with ID starting with 4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8 not found: ID does not exist"
Sep 20 01:55:15.150878 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.150763    2565 scope.go:117] "RemoveContainer" containerID="5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"
Sep 20 01:55:15.151177 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.151140    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"} err="failed to get container status \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": rpc error: code = NotFound desc = could not find container \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": container with ID starting with 5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19 not found: ID does not exist"
Sep 20 01:55:15.151177 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.151166    2565 scope.go:117] "RemoveContainer" containerID="b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"
Sep 20 01:55:15.151444 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.151420    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"} err="failed to get container status \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": rpc error: code = NotFound desc = could not find container \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": container with ID starting with b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5 not found: ID does not exist"
Sep 20 01:55:15.151499 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.151446    2565 scope.go:117] "RemoveContainer" containerID="146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"
Sep 20 01:55:15.151714 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.151697    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"} err="failed to get container status \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": rpc error: code = NotFound desc = could not find container \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": container with ID starting with 146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c not found: ID does not exist"
Sep 20 01:55:15.151763 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.151715    2565 scope.go:117] "RemoveContainer" containerID="2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"
Sep 20 01:55:15.151975 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.151956    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"} err="failed to get container status \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": rpc error: code = NotFound desc = could not find container \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": container with ID starting with 2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26 not found: ID does not exist"
Sep 20 01:55:15.152037 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.151976    2565 scope.go:117] "RemoveContainer" containerID="9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"
Sep 20 01:55:15.152203 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152180    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"} err="failed to get container status \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": rpc error: code = NotFound desc = could not find container \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": container with ID starting with 9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50 not found: ID does not exist"
Sep 20 01:55:15.152248 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152205    2565 scope.go:117] "RemoveContainer" containerID="70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"
Sep 20 01:55:15.152395 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152381    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 01:55:15.152444 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152426    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"} err="failed to get container status \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": rpc error: code = NotFound desc = could not find container \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": container with ID starting with 70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2 not found: ID does not exist"
Sep 20 01:55:15.152481 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152447    2565 scope.go:117] "RemoveContainer" containerID="4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"
Sep 20 01:55:15.152644 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152629    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="init-config-reloader"
Sep 20 01:55:15.152698 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152647    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="init-config-reloader"
Sep 20 01:55:15.152698 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152659    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy-metric"
Sep 20 01:55:15.152698 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152664    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy-metric"
Sep 20 01:55:15.152698 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152670    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="thanos-sidecar"
Sep 20 01:55:15.152698 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152676    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="thanos-sidecar"
Sep 20 01:55:15.152698 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152695    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="config-reloader"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152702    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="config-reloader"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152709    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="alertmanager"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152714    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="alertmanager"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152720    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="init-config-reloader"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152725    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="init-config-reloader"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152730    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy-thanos"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152735    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy-thanos"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152667    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"} err="failed to get container status \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": rpc error: code = NotFound desc = could not find container \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": container with ID starting with 4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8 not found: ID does not exist"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152764    2565 scope.go:117] "RemoveContainer" containerID="5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152744    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152811    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152823    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="config-reloader"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152832    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="config-reloader"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152840    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy-web"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152846    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy-web"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152853    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa936fe8-fcfc-4aee-a47c-208eef1c475f" containerName="console"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152858    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa936fe8-fcfc-4aee-a47c-208eef1c475f" containerName="console"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152866    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152871    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152878    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="prom-label-proxy"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152886    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="prom-label-proxy"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152894    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy-web"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152902    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy-web"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152912    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="prometheus"
Sep 20 01:55:15.152949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152920    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="prometheus"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152978    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa936fe8-fcfc-4aee-a47c-208eef1c475f" containerName="console"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152988    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="config-reloader"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152994    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="alertmanager"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152998    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="config-reloader"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153003    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="prom-label-proxy"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153014    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153019    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy-thanos"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153025    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153030    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="kube-rbac-proxy-web"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153034    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="thanos-sidecar"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153040    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy-web"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153044    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" containerName="prometheus"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153051    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adf3110-59d3-4fd1-b843-dd33cf3feeed" containerName="kube-rbac-proxy-metric"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.152998    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"} err="failed to get container status \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": rpc error: code = NotFound desc = could not find container \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": container with ID starting with 5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19 not found: ID does not exist"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153087    2565 scope.go:117] "RemoveContainer" containerID="b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153280    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"} err="failed to get container status \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": rpc error: code = NotFound desc = could not find container \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": container with ID starting with b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5 not found: ID does not exist"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153299    2565 scope.go:117] "RemoveContainer" containerID="146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153550    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"} err="failed to get container status \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": rpc error: code = NotFound desc = could not find container \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": container with ID starting with 146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c not found: ID does not exist"
Sep 20 01:55:15.153709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.153564    2565 scope.go:117] "RemoveContainer" containerID="2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"
Sep 20 01:55:15.158859 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.158831    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"} err="failed to get container status \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": rpc error: code = NotFound desc = could not find container \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": container with ID starting with 2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26 not found: ID does not exist"
Sep 20 01:55:15.158949 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.158860    2565 scope.go:117] "RemoveContainer" containerID="9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"
Sep 20 01:55:15.159183 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.159160    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"} err="failed to get container status \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": rpc error: code = NotFound desc = could not find container \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": container with ID starting with 9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50 not found: ID does not exist"
Sep 20 01:55:15.159250 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.159183    2565 scope.go:117] "RemoveContainer" containerID="70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"
Sep 20 01:55:15.159449 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.159431    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"} err="failed to get container status \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": rpc error: code = NotFound desc = could not find container \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": container with ID starting with 70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2 not found: ID does not exist"
Sep 20 01:55:15.159514 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.159450    2565 scope.go:117] "RemoveContainer" containerID="4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"
Sep 20 01:55:15.159514 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.159466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.159812 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.159767    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"} err="failed to get container status \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": rpc error: code = NotFound desc = could not find container \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": container with ID starting with 4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8 not found: ID does not exist"
Sep 20 01:55:15.159922 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.159812    2565 scope.go:117] "RemoveContainer" containerID="5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"
Sep 20 01:55:15.160186 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.160152    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"} err="failed to get container status \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": rpc error: code = NotFound desc = could not find container \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": container with ID starting with 5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19 not found: ID does not exist"
Sep 20 01:55:15.160272 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.160191    2565 scope.go:117] "RemoveContainer" containerID="b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"
Sep 20 01:55:15.160544 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.160519    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5"} err="failed to get container status \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": rpc error: code = NotFound desc = could not find container \"b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5\": container with ID starting with b5062d7ba3770760b17db61309cc8b51d5e176c23f10222b8cb2924924cbe7a5 not found: ID does not exist"
Sep 20 01:55:15.160620 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.160551    2565 scope.go:117] "RemoveContainer" containerID="146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"
Sep 20 01:55:15.160875 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.160850    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c"} err="failed to get container status \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": rpc error: code = NotFound desc = could not find container \"146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c\": container with ID starting with 146ac2c3681540d736b378ed7e8ed5667c5cdf4f4621a0207990ed0683ed5d5c not found: ID does not exist"
Sep 20 01:55:15.160931 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.160882    2565 scope.go:117] "RemoveContainer" containerID="2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"
Sep 20 01:55:15.161199 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.161166    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26"} err="failed to get container status \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": rpc error: code = NotFound desc = could not find container \"2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26\": container with ID starting with 2cf5badd7de8af65733f8a9803cb6dbb7bb6d1e37a7e00c78fa2b3dbba7dfc26 not found: ID does not exist"
Sep 20 01:55:15.161271 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.161236    2565 scope.go:117] "RemoveContainer" containerID="9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"
Sep 20 01:55:15.161522 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.161502    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50"} err="failed to get container status \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": rpc error: code = NotFound desc = could not find container \"9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50\": container with ID starting with 9080a7909be42fca7d6a53b0ffde7d36eff6c08109d91e75b577222752698c50 not found: ID does not exist"
Sep 20 01:55:15.161589 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.161523    2565 scope.go:117] "RemoveContainer" containerID="70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"
Sep 20 01:55:15.161759 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.161738    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2"} err="failed to get container status \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": rpc error: code = NotFound desc = could not find container \"70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2\": container with ID starting with 70792b9a8291f833432afdeb4be6a44f7e30ddb5c3d03b8a55e1f57b95fa38d2 not found: ID does not exist"
Sep 20 01:55:15.161759 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.161758    2565 scope.go:117] "RemoveContainer" containerID="4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"
Sep 20 01:55:15.162040 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162019    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 20 01:55:15.162040 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 20 01:55:15.162193 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162046    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8"} err="failed to get container status \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": rpc error: code = NotFound desc = could not find container \"4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8\": container with ID starting with 4f6190cf23262fb3e824d88771eca8882baa92a2bd7a011de8d502269bf050b8 not found: ID does not exist"
Sep 20 01:55:15.162193 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162067    2565 scope.go:117] "RemoveContainer" containerID="5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"
Sep 20 01:55:15.162193 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162173    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 20 01:55:15.162339 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162277    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 20 01:55:15.162437 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162411    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19"} err="failed to get container status \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": rpc error: code = NotFound desc = could not find container \"5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19\": container with ID starting with 5d24f7bf583fa12ac8b470a51ce503a7ad4e5a34e354150d50192a19da1a3b19 not found: ID does not exist"
Sep 20 01:55:15.162561 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162547    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 20 01:55:15.162612 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162580    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 20 01:55:15.162767 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162755    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 20 01:55:15.162910 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162869    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 20 01:55:15.162994 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.162949    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 20 01:55:15.163115 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.163102    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 20 01:55:15.163248 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.163228    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 20 01:55:15.163361 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.163346    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 20 01:55:15.163408 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.163352    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d25vu9jqu79jg\""
Sep 20 01:55:15.163774 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.163761    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-88zcg\""
Sep 20 01:55:15.166221 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.166202    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 20 01:55:15.168562 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.168542    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 20 01:55:15.174299 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.174279    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 01:55:15.219046 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.219015    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c977bfc3-3dae-4b04-8a1d-8509c50eb038" path="/var/lib/kubelet/pods/c977bfc3-3dae-4b04-8a1d-8509c50eb038/volumes"
Sep 20 01:55:15.225215 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225215 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225361 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225361 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-config\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225361 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/670bc865-51ba-401f-abac-bfda88c161b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225361 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225575 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225575 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn5qn\" (UniqueName: \"kubernetes.io/projected/670bc865-51ba-401f-abac-bfda88c161b5-kube-api-access-mn5qn\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225575 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225575 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/670bc865-51ba-401f-abac-bfda88c161b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225575 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225575 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225575 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225870 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225870 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225870 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225870 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225870 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225870 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.225870 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.225737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327028 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.326952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/670bc865-51ba-401f-abac-bfda88c161b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327028 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.326986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327028 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327028 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327287 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327287 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327287 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327445 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327445 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327445 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327445 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327445 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327445 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327732 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327732 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327732 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-config\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327732 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/670bc865-51ba-401f-abac-bfda88c161b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327732 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327732 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327732 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn5qn\" (UniqueName: \"kubernetes.io/projected/670bc865-51ba-401f-abac-bfda88c161b5-kube-api-access-mn5qn\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.327732 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.327674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.328222 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.328010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.329886 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.329859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/670bc865-51ba-401f-abac-bfda88c161b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.330077 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.330056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331261 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.330345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331261 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.330359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331261 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.330657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331261 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.330896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331261 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.330931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/670bc865-51ba-401f-abac-bfda88c161b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331261 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.330980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331261 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.331196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331261 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.331233    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331711 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.331272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.331711 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.331554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/670bc865-51ba-401f-abac-bfda88c161b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.332157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.332130    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.332448 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.332424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.333448 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.333420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.333523 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.333503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.333613 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.333596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/670bc865-51ba-401f-abac-bfda88c161b5-config\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.337983 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.337963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn5qn\" (UniqueName: \"kubernetes.io/projected/670bc865-51ba-401f-abac-bfda88c161b5-kube-api-access-mn5qn\") pod \"prometheus-k8s-0\" (UID: \"670bc865-51ba-401f-abac-bfda88c161b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.470206 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.470158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:55:15.753919 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:15.753890    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 01:55:15.756223 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:55:15.756201    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670bc865_51ba_401f_abac_bfda88c161b5.slice/crio-c7adf9d449780032606396a9f1957463959b91b27c5a93c6dbcde7051ad574ef WatchSource:0}: Error finding container c7adf9d449780032606396a9f1957463959b91b27c5a93c6dbcde7051ad574ef: Status 404 returned error can't find the container with id c7adf9d449780032606396a9f1957463959b91b27c5a93c6dbcde7051ad574ef
Sep 20 01:55:16.104773 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:16.104700    2565 generic.go:356] "Generic (PLEG): container finished" podID="670bc865-51ba-401f-abac-bfda88c161b5" containerID="c6765eaad15cd71ae80d1f4c2dce58f2f778e353bec63dfa0035cc6fc0e6b696" exitCode=0
Sep 20 01:55:16.104773 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:16.104743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"670bc865-51ba-401f-abac-bfda88c161b5","Type":"ContainerDied","Data":"c6765eaad15cd71ae80d1f4c2dce58f2f778e353bec63dfa0035cc6fc0e6b696"}
Sep 20 01:55:16.105194 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:16.104839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"670bc865-51ba-401f-abac-bfda88c161b5","Type":"ContainerStarted","Data":"c7adf9d449780032606396a9f1957463959b91b27c5a93c6dbcde7051ad574ef"}
Sep 20 01:55:17.111881 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:17.111840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"670bc865-51ba-401f-abac-bfda88c161b5","Type":"ContainerStarted","Data":"9d317bdfb251739383858b8f0cc81c01e5f9bf1eaaf85eadc414121133e494d6"}
Sep 20 01:55:17.112267 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:17.111956    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"670bc865-51ba-401f-abac-bfda88c161b5","Type":"ContainerStarted","Data":"678402498d037a0cf4ee447f776a94af8a340ad76be7a7ba0534ee69aea78bf5"}
Sep 20 01:55:17.112267 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:17.112001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"670bc865-51ba-401f-abac-bfda88c161b5","Type":"ContainerStarted","Data":"2bf6e536b0fa97e97b6c33d74eac6f2607645e7344568837e50c1a05e47e96f1"}
Sep 20 01:55:17.112267 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:17.112036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"670bc865-51ba-401f-abac-bfda88c161b5","Type":"ContainerStarted","Data":"7f2dc8f20146ec0967e2089be4cc0366dc80d0a74e2921419a9bb8cd227d9a73"}
Sep 20 01:55:17.112267 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:17.112073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"670bc865-51ba-401f-abac-bfda88c161b5","Type":"ContainerStarted","Data":"42fe9b41207bd6ff6cf1974801cb061ce996953ada3b52a50eab5b09c78c41a9"}
Sep 20 01:55:17.112267 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:17.112109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"670bc865-51ba-401f-abac-bfda88c161b5","Type":"ContainerStarted","Data":"23bc4d6c1d0fce792b7f84a5edc7d4e798fa2908ebdde88e2c2bb326c5481889"}
Sep 20 01:55:17.138623 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:17.138566    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.121058571 podStartE2EDuration="2.138550248s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.491677ms" isStatefulPod=false podCreationTimestamp="2026-09-20 01:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:55:17.137370264 +0000 UTC m=+162.422382200" watchObservedRunningTime="2026-09-20 01:55:17.138550248 +0000 UTC m=+162.423562180"
Sep 20 01:55:20.470709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:55:20.470673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:56:15.470707 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:56:15.470668    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:56:15.485472 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:56:15.485446    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:56:16.324226 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:56:16.324199    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 01:57:35.136993 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:57:35.136965    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 20 01:58:55.110919 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.110884    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xdjp2"]
Sep 20 01:58:55.114086 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.114069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xdjp2"
Sep 20 01:58:55.116286 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.116261    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lgnmc\""
Sep 20 01:58:55.116286 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.116267    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 20 01:58:55.117161 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.117143    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 20 01:58:55.123673 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.123654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xdjp2"]
Sep 20 01:58:55.251146 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.251112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32563228-de80-4493-9969-c6586c4f617e-bound-sa-token\") pod \"cert-manager-55b4d954d5-xdjp2\" (UID: \"32563228-de80-4493-9969-c6586c4f617e\") " pod="cert-manager/cert-manager-55b4d954d5-xdjp2"
Sep 20 01:58:55.251306 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.251155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jslv\" (UniqueName: \"kubernetes.io/projected/32563228-de80-4493-9969-c6586c4f617e-kube-api-access-5jslv\") pod \"cert-manager-55b4d954d5-xdjp2\" (UID: \"32563228-de80-4493-9969-c6586c4f617e\") " pod="cert-manager/cert-manager-55b4d954d5-xdjp2"
Sep 20 01:58:55.352562 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.352525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32563228-de80-4493-9969-c6586c4f617e-bound-sa-token\") pod \"cert-manager-55b4d954d5-xdjp2\" (UID: \"32563228-de80-4493-9969-c6586c4f617e\") " pod="cert-manager/cert-manager-55b4d954d5-xdjp2"
Sep 20 01:58:55.352562 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.352570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jslv\" (UniqueName: \"kubernetes.io/projected/32563228-de80-4493-9969-c6586c4f617e-kube-api-access-5jslv\") pod \"cert-manager-55b4d954d5-xdjp2\" (UID: \"32563228-de80-4493-9969-c6586c4f617e\") " pod="cert-manager/cert-manager-55b4d954d5-xdjp2"
Sep 20 01:58:55.360609 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.360583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32563228-de80-4493-9969-c6586c4f617e-bound-sa-token\") pod \"cert-manager-55b4d954d5-xdjp2\" (UID: \"32563228-de80-4493-9969-c6586c4f617e\") " pod="cert-manager/cert-manager-55b4d954d5-xdjp2"
Sep 20 01:58:55.360736 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.360683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jslv\" (UniqueName: \"kubernetes.io/projected/32563228-de80-4493-9969-c6586c4f617e-kube-api-access-5jslv\") pod \"cert-manager-55b4d954d5-xdjp2\" (UID: \"32563228-de80-4493-9969-c6586c4f617e\") " pod="cert-manager/cert-manager-55b4d954d5-xdjp2"
Sep 20 01:58:55.435041 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.434957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xdjp2"
Sep 20 01:58:55.703781 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.703696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xdjp2"]
Sep 20 01:58:55.709570 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:58:55.709544    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32563228_de80_4493_9969_c6586c4f617e.slice/crio-c84173abbcc0ca411dd3cfd3415227ca316c8c173955bf4649043ed210a7e16e WatchSource:0}: Error finding container c84173abbcc0ca411dd3cfd3415227ca316c8c173955bf4649043ed210a7e16e: Status 404 returned error can't find the container with id c84173abbcc0ca411dd3cfd3415227ca316c8c173955bf4649043ed210a7e16e
Sep 20 01:58:55.711504 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.711487    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 01:58:55.871206 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:55.871169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xdjp2" event={"ID":"32563228-de80-4493-9969-c6586c4f617e","Type":"ContainerStarted","Data":"c84173abbcc0ca411dd3cfd3415227ca316c8c173955bf4649043ed210a7e16e"}
Sep 20 01:58:58.885380 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:58.885288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xdjp2" event={"ID":"32563228-de80-4493-9969-c6586c4f617e","Type":"ContainerStarted","Data":"ff69a3427602cd245b9e9acd0ce0e20cbf83914f6df8fac983afcd265d2355be"}
Sep 20 01:58:58.901278 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:58:58.901229    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xdjp2" podStartSLOduration=1.058903076 podStartE2EDuration="3.901210993s" totalImagesPullingTime="2.842307917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:58:58.899987021 +0000 UTC m=+384.184998977" watchObservedRunningTime="2026-09-20 01:58:58.901210993 +0000 UTC m=+384.186222927"
Sep 20 01:59:20.125758 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.125727    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"]
Sep 20 01:59:20.132131 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.132115    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.135036 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.135013    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 20 01:59:20.136121 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.136099    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 20 01:59:20.136222 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.136110    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9h799\""
Sep 20 01:59:20.136222 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.136137    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 20 01:59:20.136222 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.136136    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 20 01:59:20.136222 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.136137    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 20 01:59:20.140274 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.140253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92j5p\" (UniqueName: \"kubernetes.io/projected/fd817840-74d1-4d75-9bb3-43c8490ba917-kube-api-access-92j5p\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.140370 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.140314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd817840-74d1-4d75-9bb3-43c8490ba917-cert\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.140370 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.140345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd817840-74d1-4d75-9bb3-43c8490ba917-metrics-cert\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.140476 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.140390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fd817840-74d1-4d75-9bb3-43c8490ba917-manager-config\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.145629 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.145608    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"]
Sep 20 01:59:20.241080 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.241043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fd817840-74d1-4d75-9bb3-43c8490ba917-manager-config\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.241272 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.241107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92j5p\" (UniqueName: \"kubernetes.io/projected/fd817840-74d1-4d75-9bb3-43c8490ba917-kube-api-access-92j5p\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.241272 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.241144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd817840-74d1-4d75-9bb3-43c8490ba917-cert\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.241272 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.241164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd817840-74d1-4d75-9bb3-43c8490ba917-metrics-cert\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.241809 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.241762    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fd817840-74d1-4d75-9bb3-43c8490ba917-manager-config\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.243696 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.243676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd817840-74d1-4d75-9bb3-43c8490ba917-cert\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.243759 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.243738    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd817840-74d1-4d75-9bb3-43c8490ba917-metrics-cert\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.249068 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.249044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92j5p\" (UniqueName: \"kubernetes.io/projected/fd817840-74d1-4d75-9bb3-43c8490ba917-kube-api-access-92j5p\") pod \"lws-controller-manager-6bdfb9dff9-vqv95\" (UID: \"fd817840-74d1-4d75-9bb3-43c8490ba917\") " pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.441325 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.441243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:20.714325 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.714254    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"]
Sep 20 01:59:20.717691 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:59:20.717668    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd817840_74d1_4d75_9bb3_43c8490ba917.slice/crio-8ab8f159fc05f6bec5adfa9e882fe8d114857f7635b6015cd9b9955fcf31c3f0 WatchSource:0}: Error finding container 8ab8f159fc05f6bec5adfa9e882fe8d114857f7635b6015cd9b9955fcf31c3f0: Status 404 returned error can't find the container with id 8ab8f159fc05f6bec5adfa9e882fe8d114857f7635b6015cd9b9955fcf31c3f0
Sep 20 01:59:20.961628 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:20.961592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95" event={"ID":"fd817840-74d1-4d75-9bb3-43c8490ba917","Type":"ContainerStarted","Data":"8ab8f159fc05f6bec5adfa9e882fe8d114857f7635b6015cd9b9955fcf31c3f0"}
Sep 20 01:59:21.043618 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.043583    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"]
Sep 20 01:59:21.048720 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.048702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.052396 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.052375    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 20 01:59:21.052603 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.052587    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l7wm4\""
Sep 20 01:59:21.052853 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.052826    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 20 01:59:21.053524 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.053508    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 20 01:59:21.053825 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.053810    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 20 01:59:21.073190 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.073166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"]
Sep 20 01:59:21.148045 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.148013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-tmp\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.148402 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.148064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.148402 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.148144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.148402 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.148173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-manifests\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.148402 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.148194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw9k2\" (UniqueName: \"kubernetes.io/projected/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-kube-api-access-pw9k2\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.249182 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.249154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.249295 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.249192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.249295 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.249208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-manifests\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.249295 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.249225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw9k2\" (UniqueName: \"kubernetes.io/projected/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-kube-api-access-pw9k2\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.249295 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.249285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-tmp\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.249637 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.249616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-manifests\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.251925 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.251902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.253765 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.253741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-tmp\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.254155 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.254135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.262091 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.262069    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw9k2\" (UniqueName: \"kubernetes.io/projected/3ae84d85-67eb-4cc5-bc27-94a40b6bac5d-kube-api-access-pw9k2\") pod \"opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw\" (UID: \"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d\") " pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.358782 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.358713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:21.666822 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:59:21.666766    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae84d85_67eb_4cc5_bc27_94a40b6bac5d.slice/crio-67c63a52b55b5d6119611c9fddc687d213439d04f69a66736d1d0d5734c4440b WatchSource:0}: Error finding container 67c63a52b55b5d6119611c9fddc687d213439d04f69a66736d1d0d5734c4440b: Status 404 returned error can't find the container with id 67c63a52b55b5d6119611c9fddc687d213439d04f69a66736d1d0d5734c4440b
Sep 20 01:59:21.673803 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.673767    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"]
Sep 20 01:59:21.967217 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:21.967144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw" event={"ID":"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d","Type":"ContainerStarted","Data":"67c63a52b55b5d6119611c9fddc687d213439d04f69a66736d1d0d5734c4440b"}
Sep 20 01:59:25.990816 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:25.990762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw" event={"ID":"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d","Type":"ContainerStarted","Data":"8e99ef5b44fd4a39f49eb8c2d8a43326fb4dff848b165daa867994d574964c8d"}
Sep 20 01:59:25.992387 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:25.992361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95" event={"ID":"fd817840-74d1-4d75-9bb3-43c8490ba917","Type":"ContainerStarted","Data":"de33aa2d33bc37bdf0f560d8fa30cfa29abcd83c524be8d6f82749df920b2213"}
Sep 20 01:59:25.992499 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:25.992432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:26.028601 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:26.028559    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95" podStartSLOduration=1.573300169 podStartE2EDuration="6.028543345s" totalImagesPullingTime="4.455243176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:59:26.027832188 +0000 UTC m=+411.312844124" watchObservedRunningTime="2026-09-20 01:59:26.028543345 +0000 UTC m=+411.313555281"
Sep 20 01:59:26.998082 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:26.998053    2565 generic.go:356] "Generic (PLEG): container finished" podID="3ae84d85-67eb-4cc5-bc27-94a40b6bac5d" containerID="8e99ef5b44fd4a39f49eb8c2d8a43326fb4dff848b165daa867994d574964c8d" exitCode=0
Sep 20 01:59:26.998535 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:26.998127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw" event={"ID":"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d","Type":"ContainerDied","Data":"8e99ef5b44fd4a39f49eb8c2d8a43326fb4dff848b165daa867994d574964c8d"}
Sep 20 01:59:28.005981 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:28.005939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw" event={"ID":"3ae84d85-67eb-4cc5-bc27-94a40b6bac5d","Type":"ContainerStarted","Data":"0b5a13c14fa36c669b0f51f5af410eab59d02ac13692a1ce4acb4f7cab594be6"}
Sep 20 01:59:28.006352 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:28.006061    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:28.029749 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:28.029684    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw" podStartSLOduration=3.048075093 podStartE2EDuration="8.029664192s" totalImagesPullingTime="3.922036936s" totalInitContainerRuntime="1.059552163s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:59:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:59:28.028307141 +0000 UTC m=+413.313319102" watchObservedRunningTime="2026-09-20 01:59:28.029664192 +0000 UTC m=+413.314676127"
Sep 20 01:59:37.000535 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:37.000502    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bdfb9dff9-vqv95"
Sep 20 01:59:39.012374 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:39.012337    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw"
Sep 20 01:59:48.014157 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.014117    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"]
Sep 20 01:59:48.023038 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.023013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.025481 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.025452    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 20 01:59:48.025481 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.025470    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 20 01:59:48.025659 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.025509    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 20 01:59:48.025768 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.025740    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gjw7f\""
Sep 20 01:59:48.028978 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.028957    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"]
Sep 20 01:59:48.155881 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.155847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.155881 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.155880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84cbc648-0538-45fb-99f2-d7596e112005-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.156092 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.155898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84cbc648-0538-45fb-99f2-d7596e112005-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.156092 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.155918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8p9r\" (UniqueName: \"kubernetes.io/projected/84cbc648-0538-45fb-99f2-d7596e112005-kube-api-access-l8p9r\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.156092 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.156008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.156092 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.156044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.156092 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.156060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.156092 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.156083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84cbc648-0538-45fb-99f2-d7596e112005-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.156279 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.156127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.257557 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.257520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.257557 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.257557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.257818 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.257575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.257818 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.257594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84cbc648-0538-45fb-99f2-d7596e112005-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.257818 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.257716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.257818 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.257772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.257818 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.257813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84cbc648-0538-45fb-99f2-d7596e112005-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.258071 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.257837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84cbc648-0538-45fb-99f2-d7596e112005-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.258071 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.257871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8p9r\" (UniqueName: \"kubernetes.io/projected/84cbc648-0538-45fb-99f2-d7596e112005-kube-api-access-l8p9r\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.258071 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.258025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.258071 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.258035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.258270 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.258179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.258410 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.258385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.258516 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.258477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84cbc648-0538-45fb-99f2-d7596e112005-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.260017 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.259997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84cbc648-0538-45fb-99f2-d7596e112005-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.260164 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.260147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84cbc648-0538-45fb-99f2-d7596e112005-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.265213 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.265167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84cbc648-0538-45fb-99f2-d7596e112005-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.265521 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.265500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8p9r\" (UniqueName: \"kubernetes.io/projected/84cbc648-0538-45fb-99f2-d7596e112005-kube-api-access-l8p9r\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs\" (UID: \"84cbc648-0538-45fb-99f2-d7596e112005\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.336296 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.336251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:48.611696 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:48.611616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"]
Sep 20 01:59:48.615472 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:59:48.615440    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84cbc648_0538_45fb_99f2_d7596e112005.slice/crio-5120bce5b236cdac94580d91f04ef7360abd51edf85496c36de3da83a475bf4b WatchSource:0}: Error finding container 5120bce5b236cdac94580d91f04ef7360abd51edf85496c36de3da83a475bf4b: Status 404 returned error can't find the container with id 5120bce5b236cdac94580d91f04ef7360abd51edf85496c36de3da83a475bf4b
Sep 20 01:59:49.089860 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:49.089820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs" event={"ID":"84cbc648-0538-45fb-99f2-d7596e112005","Type":"ContainerStarted","Data":"5120bce5b236cdac94580d91f04ef7360abd51edf85496c36de3da83a475bf4b"}
Sep 20 01:59:51.700709 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.700671    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mkhdd"]
Sep 20 01:59:51.707958 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.707931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:51.710300 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.710273    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 20 01:59:51.710423 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.710324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7fxlj\""
Sep 20 01:59:51.713551 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.713525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mkhdd"]
Sep 20 01:59:51.787570 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.787515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgfld\" (UniqueName: \"kubernetes.io/projected/db2d4122-2147-4e94-8bad-1e8821760679-kube-api-access-lgfld\") pod \"odh-model-controller-7998c67dc4-mkhdd\" (UID: \"db2d4122-2147-4e94-8bad-1e8821760679\") " pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:51.787570 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.787561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db2d4122-2147-4e94-8bad-1e8821760679-cert\") pod \"odh-model-controller-7998c67dc4-mkhdd\" (UID: \"db2d4122-2147-4e94-8bad-1e8821760679\") " pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:51.888763 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.888728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgfld\" (UniqueName: \"kubernetes.io/projected/db2d4122-2147-4e94-8bad-1e8821760679-kube-api-access-lgfld\") pod \"odh-model-controller-7998c67dc4-mkhdd\" (UID: \"db2d4122-2147-4e94-8bad-1e8821760679\") " pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:51.888763 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.888776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db2d4122-2147-4e94-8bad-1e8821760679-cert\") pod \"odh-model-controller-7998c67dc4-mkhdd\" (UID: \"db2d4122-2147-4e94-8bad-1e8821760679\") " pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:51.889009 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:59:51.888920    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 20 01:59:51.889009 ip-10-0-135-222 kubenswrapper[2565]: E0920 01:59:51.888995    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2d4122-2147-4e94-8bad-1e8821760679-cert podName:db2d4122-2147-4e94-8bad-1e8821760679 nodeName:}" failed. No retries permitted until 2026-09-20 01:59:52.388974814 +0000 UTC m=+437.673986730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db2d4122-2147-4e94-8bad-1e8821760679-cert") pod "odh-model-controller-7998c67dc4-mkhdd" (UID: "db2d4122-2147-4e94-8bad-1e8821760679") : secret "odh-model-controller-webhook-cert" not found
Sep 20 01:59:51.899447 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.899418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgfld\" (UniqueName: \"kubernetes.io/projected/db2d4122-2147-4e94-8bad-1e8821760679-kube-api-access-lgfld\") pod \"odh-model-controller-7998c67dc4-mkhdd\" (UID: \"db2d4122-2147-4e94-8bad-1e8821760679\") " pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:51.995669 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.995630    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 01:59:51.995738 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.995707    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 01:59:51.995778 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:51.995741    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 01:59:52.105842 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.105784    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs" event={"ID":"84cbc648-0538-45fb-99f2-d7596e112005","Type":"ContainerStarted","Data":"8191a1cda6876705ed043bbcc94d88583d882a7042943e7b24ea3b47d391ba11"}
Sep 20 01:59:52.126447 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.126397    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs" podStartSLOduration=1.748883937 podStartE2EDuration="5.126378091s" totalImagesPullingTime="3.377494154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:59:52.124322746 +0000 UTC m=+437.409334681" watchObservedRunningTime="2026-09-20 01:59:52.126378091 +0000 UTC m=+437.411390029"
Sep 20 01:59:52.226494 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.226465    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wz2f7"]
Sep 20 01:59:52.229692 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.229676    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 01:59:52.232287 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.232263    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 20 01:59:52.232418 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.232358    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-7tg66\""
Sep 20 01:59:52.239693 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.239670    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wz2f7"]
Sep 20 01:59:52.293130 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.293059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26417512-ed68-41e2-9486-2e2d4ee07afa-tls-certs\") pod \"model-serving-api-54d89bd5fc-wz2f7\" (UID: \"26417512-ed68-41e2-9486-2e2d4ee07afa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 01:59:52.293130 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.293101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd6pw\" (UniqueName: \"kubernetes.io/projected/26417512-ed68-41e2-9486-2e2d4ee07afa-kube-api-access-jd6pw\") pod \"model-serving-api-54d89bd5fc-wz2f7\" (UID: \"26417512-ed68-41e2-9486-2e2d4ee07afa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 01:59:52.337285 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.337258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:52.393779 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.393751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db2d4122-2147-4e94-8bad-1e8821760679-cert\") pod \"odh-model-controller-7998c67dc4-mkhdd\" (UID: \"db2d4122-2147-4e94-8bad-1e8821760679\") " pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:52.393937 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.393843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26417512-ed68-41e2-9486-2e2d4ee07afa-tls-certs\") pod \"model-serving-api-54d89bd5fc-wz2f7\" (UID: \"26417512-ed68-41e2-9486-2e2d4ee07afa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 01:59:52.393937 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.393877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd6pw\" (UniqueName: \"kubernetes.io/projected/26417512-ed68-41e2-9486-2e2d4ee07afa-kube-api-access-jd6pw\") pod \"model-serving-api-54d89bd5fc-wz2f7\" (UID: \"26417512-ed68-41e2-9486-2e2d4ee07afa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 01:59:52.396406 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.396378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db2d4122-2147-4e94-8bad-1e8821760679-cert\") pod \"odh-model-controller-7998c67dc4-mkhdd\" (UID: \"db2d4122-2147-4e94-8bad-1e8821760679\") " pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:52.396406 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.396395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26417512-ed68-41e2-9486-2e2d4ee07afa-tls-certs\") pod \"model-serving-api-54d89bd5fc-wz2f7\" (UID: \"26417512-ed68-41e2-9486-2e2d4ee07afa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 01:59:52.401236 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.401211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd6pw\" (UniqueName: \"kubernetes.io/projected/26417512-ed68-41e2-9486-2e2d4ee07afa-kube-api-access-jd6pw\") pod \"model-serving-api-54d89bd5fc-wz2f7\" (UID: \"26417512-ed68-41e2-9486-2e2d4ee07afa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 01:59:52.539710 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.539679    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 01:59:52.622314 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.622179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:52.810350 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.810327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wz2f7"]
Sep 20 01:59:52.812259 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:59:52.812233    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26417512_ed68_41e2_9486_2e2d4ee07afa.slice/crio-c2ab1caa5b97161ffef0efa204070f2c22a0c4071b307f11db9f25ebdf712df9 WatchSource:0}: Error finding container c2ab1caa5b97161ffef0efa204070f2c22a0c4071b307f11db9f25ebdf712df9: Status 404 returned error can't find the container with id c2ab1caa5b97161ffef0efa204070f2c22a0c4071b307f11db9f25ebdf712df9
Sep 20 01:59:52.903266 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:52.903237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mkhdd"]
Sep 20 01:59:52.906452 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:59:52.906430    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2d4122_2147_4e94_8bad_1e8821760679.slice/crio-e59717de650c763e3be954da3b2022fdeee5f590861240eef4613f3ddb4cbdaa WatchSource:0}: Error finding container e59717de650c763e3be954da3b2022fdeee5f590861240eef4613f3ddb4cbdaa: Status 404 returned error can't find the container with id e59717de650c763e3be954da3b2022fdeee5f590861240eef4613f3ddb4cbdaa
Sep 20 01:59:53.111159 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:53.111072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd" event={"ID":"db2d4122-2147-4e94-8bad-1e8821760679","Type":"ContainerStarted","Data":"e59717de650c763e3be954da3b2022fdeee5f590861240eef4613f3ddb4cbdaa"}
Sep 20 01:59:53.112250 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:53.112223    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7" event={"ID":"26417512-ed68-41e2-9486-2e2d4ee07afa","Type":"ContainerStarted","Data":"c2ab1caa5b97161ffef0efa204070f2c22a0c4071b307f11db9f25ebdf712df9"}
Sep 20 01:59:53.341678 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:53.341645    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:54.118519 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:54.118486    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:54.119621 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:54.119596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs"
Sep 20 01:59:57.132028 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:57.131984    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd" event={"ID":"db2d4122-2147-4e94-8bad-1e8821760679","Type":"ContainerStarted","Data":"8204e4e7e79e91f5a4f445f130f027008360a310c610999f5556a41882a0da6a"}
Sep 20 01:59:57.132693 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:57.132077    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 01:59:57.133495 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:57.133473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7" event={"ID":"26417512-ed68-41e2-9486-2e2d4ee07afa","Type":"ContainerStarted","Data":"0d0cbe77829116b5489bb65fd74d99b85134278fbd8b031d041b604a21d4f0d1"}
Sep 20 01:59:57.133668 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:57.133520    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 01:59:57.155132 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:57.155076    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd" podStartSLOduration=2.517793858 podStartE2EDuration="6.155060386s" totalImagesPullingTime="3.637266528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:59:57.15492417 +0000 UTC m=+442.439936106" watchObservedRunningTime="2026-09-20 01:59:57.155060386 +0000 UTC m=+442.440072324"
Sep 20 01:59:57.172978 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:57.172929    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7" podStartSLOduration=1.48505843 podStartE2EDuration="5.172915242s" totalImagesPullingTime="3.687856812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:59:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:59:57.171401166 +0000 UTC m=+442.456413102" watchObservedRunningTime="2026-09-20 01:59:57.172915242 +0000 UTC m=+442.457927176"
Sep 20 01:59:58.163520 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.163441    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"]
Sep 20 01:59:58.166737 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.166720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.169100 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.169081    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 20 01:59:58.169274 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.169261    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 20 01:59:58.169375 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.169354    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-s579t\""
Sep 20 01:59:58.169422 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.169386    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 20 01:59:58.180209 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.180184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"]
Sep 20 01:59:58.248470 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.248442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.248599 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.248496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.248599 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.248524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h229\" (UniqueName: \"kubernetes.io/projected/323c9baf-f1aa-4fac-a993-85d0ed4fce36-kube-api-access-6h229\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.248750 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.248715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/323c9baf-f1aa-4fac-a993-85d0ed4fce36-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.248903 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.248846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.248903 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.248894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/323c9baf-f1aa-4fac-a993-85d0ed4fce36-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.249034 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.248928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.349644 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.349612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h229\" (UniqueName: \"kubernetes.io/projected/323c9baf-f1aa-4fac-a993-85d0ed4fce36-kube-api-access-6h229\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.349817 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.349652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/323c9baf-f1aa-4fac-a993-85d0ed4fce36-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.349817 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.349668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.349817 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.349686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/323c9baf-f1aa-4fac-a993-85d0ed4fce36-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.349817 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.349704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.349817 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.349741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.349817 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.349783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.350511 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.350483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.351924 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.351894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/323c9baf-f1aa-4fac-a993-85d0ed4fce36-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.352107 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.352087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.352163 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.352094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/323c9baf-f1aa-4fac-a993-85d0ed4fce36-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.352163 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.352140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.358076 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.358049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/323c9baf-f1aa-4fac-a993-85d0ed4fce36-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.358908 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.358884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h229\" (UniqueName: \"kubernetes.io/projected/323c9baf-f1aa-4fac-a993-85d0ed4fce36-kube-api-access-6h229\") pod \"istiod-openshift-gateway-5677ccb49b-l7zjx\" (UID: \"323c9baf-f1aa-4fac-a993-85d0ed4fce36\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.475911 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.475831    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 01:59:58.750943 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:58.750905    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"]
Sep 20 01:59:58.755759 ip-10-0-135-222 kubenswrapper[2565]: W0920 01:59:58.755732    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323c9baf_f1aa_4fac_a993_85d0ed4fce36.slice/crio-683a4bd142dfab3a19c2ba180cbe40a700923893f2ad901e36c314759ea0a433 WatchSource:0}: Error finding container 683a4bd142dfab3a19c2ba180cbe40a700923893f2ad901e36c314759ea0a433: Status 404 returned error can't find the container with id 683a4bd142dfab3a19c2ba180cbe40a700923893f2ad901e36c314759ea0a433
Sep 20 01:59:59.143172 ip-10-0-135-222 kubenswrapper[2565]: I0920 01:59:59.143096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx" event={"ID":"323c9baf-f1aa-4fac-a993-85d0ed4fce36","Type":"ContainerStarted","Data":"683a4bd142dfab3a19c2ba180cbe40a700923893f2ad901e36c314759ea0a433"}
Sep 20 02:00:01.529138 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:01.529100    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:00:01.529503 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:01.529181    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:00:02.157939 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:02.157898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx" event={"ID":"323c9baf-f1aa-4fac-a993-85d0ed4fce36","Type":"ContainerStarted","Data":"009c82359c97cd7840f1e7e5301db357581d815e53fd50fb079d06d8e433ecd5"}
Sep 20 02:00:02.158142 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:02.158077    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 02:00:02.159479 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:02.159446    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-l7zjx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 20 02:00:02.159586 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:02.159492    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx" podUID="323c9baf-f1aa-4fac-a993-85d0ed4fce36" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 02:00:02.180515 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:02.180454    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx" podStartSLOduration=1.409980287 podStartE2EDuration="4.180438887s" totalImagesPullingTime="2.7704586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:00:02.178895334 +0000 UTC m=+447.463907270" watchObservedRunningTime="2026-09-20 02:00:02.180438887 +0000 UTC m=+447.465450822"
Sep 20 02:00:03.163101 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:03.163071    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx"
Sep 20 02:00:08.139689 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:08.139655    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mkhdd"
Sep 20 02:00:08.141504 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:00:08.141483    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wz2f7"
Sep 20 02:02:08.148736 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.148682    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"]
Sep 20 02:02:08.151979 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.151959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.154295 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.154275    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-t7lll\""
Sep 20 02:02:08.162591 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.162568    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"]
Sep 20 02:02:08.254759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.254723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.254759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.254763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtnvz\" (UniqueName: \"kubernetes.io/projected/d9a422bb-fdbb-4f7a-a837-a69d24e76069-kube-api-access-gtnvz\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.255024 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.254857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.255024 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.254907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.255024 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.254942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.255145 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.255024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.255145 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.255087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.255145 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.255121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.255256 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.255149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.355688 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.355653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.355916 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.355702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.355916 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.355731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.355916 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.355748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.355916 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.355860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.355916 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.355907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.356183 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.355931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnvz\" (UniqueName: \"kubernetes.io/projected/d9a422bb-fdbb-4f7a-a837-a69d24e76069-kube-api-access-gtnvz\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.356183 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.355988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.356183 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.356025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.356183 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.356150    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.356364 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.356240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.356364 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.356313    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.356364 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.356329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.356682 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.356666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.358046 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.358025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.358301 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.358281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.363657 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.363628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9a422bb-fdbb-4f7a-a837-a69d24e76069-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.363782 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.363766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtnvz\" (UniqueName: \"kubernetes.io/projected/d9a422bb-fdbb-4f7a-a837-a69d24e76069-kube-api-access-gtnvz\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7ncht\" (UID: \"d9a422bb-fdbb-4f7a-a837-a69d24e76069\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.463391 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.463298    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:08.740917 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.740892    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"]
Sep 20 02:02:08.742949 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:02:08.742922    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a422bb_fdbb_4f7a_a837_a69d24e76069.slice/crio-f93ee94aa95b6e56a45dcc62a55efef890df7b75fe74e82c0835ee72df0cba51 WatchSource:0}: Error finding container f93ee94aa95b6e56a45dcc62a55efef890df7b75fe74e82c0835ee72df0cba51: Status 404 returned error can't find the container with id f93ee94aa95b6e56a45dcc62a55efef890df7b75fe74e82c0835ee72df0cba51
Sep 20 02:02:08.745117 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.745081    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:02:08.745224 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.745162    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:02:08.745224 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:08.745206    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:02:09.668655 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:09.668618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" event={"ID":"d9a422bb-fdbb-4f7a-a837-a69d24e76069","Type":"ContainerStarted","Data":"478aadd24f4eb8961522b76a35926a6675d8679cb1344672631ba08ea529fe59"}
Sep 20 02:02:09.669083 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:09.668670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" event={"ID":"d9a422bb-fdbb-4f7a-a837-a69d24e76069","Type":"ContainerStarted","Data":"f93ee94aa95b6e56a45dcc62a55efef890df7b75fe74e82c0835ee72df0cba51"}
Sep 20 02:02:09.688875 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:09.688829    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" podStartSLOduration=1.688813331 podStartE2EDuration="1.688813331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:02:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:02:09.687376189 +0000 UTC m=+574.972388128" watchObservedRunningTime="2026-09-20 02:02:09.688813331 +0000 UTC m=+574.973825286"
Sep 20 02:02:10.463484 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:10.463443    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:10.468155 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:10.468132    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:10.673132 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:10.673103    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:02:10.673990 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:02:10.673971    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:03:42.805006 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.804973    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"]
Sep 20 02:03:42.808334 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.808314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:42.810921 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.810903    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 20 02:03:42.829425 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.829401    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"]
Sep 20 02:03:42.872843 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.872811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4dfr\" (UniqueName: \"kubernetes.io/projected/7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04-kube-api-access-g4dfr\") pod \"payload-processing-5b54b7fbb7-5vxjh\" (UID: \"7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:42.872975 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.872903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5vxjh\" (UID: \"7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:42.973918 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.973884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5vxjh\" (UID: \"7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:42.974105 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.973941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4dfr\" (UniqueName: \"kubernetes.io/projected/7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04-kube-api-access-g4dfr\") pod \"payload-processing-5b54b7fbb7-5vxjh\" (UID: \"7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:42.974700 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.974673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-5vxjh\" (UID: \"7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:42.981553 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:42.981529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4dfr\" (UniqueName: \"kubernetes.io/projected/7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04-kube-api-access-g4dfr\") pod \"payload-processing-5b54b7fbb7-5vxjh\" (UID: \"7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:43.118269 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:43.118185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:43.389384 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:43.389354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"]
Sep 20 02:03:43.392120 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:03:43.392092    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1fd2e0_d54b_4234_b8cf_5e54b4d8bf04.slice/crio-08fc2b19842aa930cc7957973ec0e729e81d40c7b39c5bb3ddd43b43e717d115 WatchSource:0}: Error finding container 08fc2b19842aa930cc7957973ec0e729e81d40c7b39c5bb3ddd43b43e717d115: Status 404 returned error can't find the container with id 08fc2b19842aa930cc7957973ec0e729e81d40c7b39c5bb3ddd43b43e717d115
Sep 20 02:03:44.075407 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:44.075365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh" event={"ID":"7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04","Type":"ContainerStarted","Data":"08fc2b19842aa930cc7957973ec0e729e81d40c7b39c5bb3ddd43b43e717d115"}
Sep 20 02:03:45.081841 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:45.081726    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh" event={"ID":"7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04","Type":"ContainerStarted","Data":"c37f3cbb4f627daf8d75da81d8fd5977479ebe268bceae2e6308e75b2f48f3a7"}
Sep 20 02:03:45.081841 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:45.081833    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:45.097431 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:45.097387    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh" podStartSLOduration=1.661487294 podStartE2EDuration="3.097372536s" totalImagesPullingTime="1.435885242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:03:45.0962439 +0000 UTC m=+670.381255836" watchObservedRunningTime="2026-09-20 02:03:45.097372536 +0000 UTC m=+670.382384471"
Sep 20 02:03:52.115772 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:52.115734    2565 generic.go:356] "Generic (PLEG): container finished" podID="d9a422bb-fdbb-4f7a-a837-a69d24e76069" containerID="478aadd24f4eb8961522b76a35926a6675d8679cb1344672631ba08ea529fe59" exitCode=0
Sep 20 02:03:52.116220 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:52.115816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" event={"ID":"d9a422bb-fdbb-4f7a-a837-a69d24e76069","Type":"ContainerDied","Data":"478aadd24f4eb8961522b76a35926a6675d8679cb1344672631ba08ea529fe59"}
Sep 20 02:03:52.116220 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:52.116176    2565 scope.go:117] "RemoveContainer" containerID="478aadd24f4eb8961522b76a35926a6675d8679cb1344672631ba08ea529fe59"
Sep 20 02:03:52.117147 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:52.117123    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:03:52.117205 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:52.117192    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:03:52.117243 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:52.117227    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:03:53.122414 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:53.122381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" event={"ID":"d9a422bb-fdbb-4f7a-a837-a69d24e76069","Type":"ContainerStarted","Data":"15af8f49775537a4cb7fa6bc9b3dfa831269915cf961c44049a3715588f15132"}
Sep 20 02:03:53.464782 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:53.464684    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:03:53.465877 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:53.465846    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7ncht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 20 02:03:53.466011 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:53.465914    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" podUID="d9a422bb-fdbb-4f7a-a837-a69d24e76069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 20 02:03:54.464461 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:54.464417    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7ncht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 20 02:03:54.465470 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:54.465056    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" podUID="d9a422bb-fdbb-4f7a-a837-a69d24e76069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 20 02:03:55.463748 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:55.463698    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7ncht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 20 02:03:55.463968 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:55.463811    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" podUID="d9a422bb-fdbb-4f7a-a837-a69d24e76069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 20 02:03:55.673073 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:55.673030    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:03:56.088756 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:56.088723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-5vxjh"
Sep 20 02:03:56.464708 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:56.464604    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7ncht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 20 02:03:56.464708 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:56.464689    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" podUID="d9a422bb-fdbb-4f7a-a837-a69d24e76069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 20 02:03:57.465175 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:57.465137    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7ncht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 20 02:03:57.465748 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:57.465717    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht" podUID="d9a422bb-fdbb-4f7a-a837-a69d24e76069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 20 02:03:58.467994 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:58.467967    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:03:58.469062 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:03:58.469045    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht"
Sep 20 02:04:26.416629 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.416595    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"]
Sep 20 02:04:26.420262 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.420239    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.422719 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.422698    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 20 02:04:26.423644 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.423627    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ln8ck\""
Sep 20 02:04:26.423724 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.423627    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 20 02:04:26.423724 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.423629    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 20 02:04:26.428271 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.428249    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"]
Sep 20 02:04:26.463126 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.463092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqgtf\" (UniqueName: \"kubernetes.io/projected/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-kube-api-access-rqgtf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.463282 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.463131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.463282 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.463169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.463282 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.463221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.463282 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.463276    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.463450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.463330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.564199 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.564162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.564384 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.564205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.564384 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.564246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqgtf\" (UniqueName: \"kubernetes.io/projected/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-kube-api-access-rqgtf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.564384 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.564266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.564384 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.564291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.564384 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.564319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.564814 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.564761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.564902 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.564767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.564902 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.564833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.566466 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.566445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.566826 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.566801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.573147 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.573125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqgtf\" (UniqueName: \"kubernetes.io/projected/e12eb8f9-3a7c-4cda-b0b1-0d601794d811-kube-api-access-rqgtf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lgmv\" (UID: \"e12eb8f9-3a7c-4cda-b0b1-0d601794d811\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:26.731212 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:26.731121    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:27.000336 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:27.000307    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"]
Sep 20 02:04:27.002264 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:04:27.002240    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12eb8f9_3a7c_4cda_b0b1_0d601794d811.slice/crio-8ba59e0ee9d78a3e2184a4a1c17b4c3ba5baad8bb4f2b710ed28116997966ad4 WatchSource:0}: Error finding container 8ba59e0ee9d78a3e2184a4a1c17b4c3ba5baad8bb4f2b710ed28116997966ad4: Status 404 returned error can't find the container with id 8ba59e0ee9d78a3e2184a4a1c17b4c3ba5baad8bb4f2b710ed28116997966ad4
Sep 20 02:04:27.003527 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:27.003509    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 02:04:27.274529 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:27.274445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv" event={"ID":"e12eb8f9-3a7c-4cda-b0b1-0d601794d811","Type":"ContainerStarted","Data":"8ba59e0ee9d78a3e2184a4a1c17b4c3ba5baad8bb4f2b710ed28116997966ad4"}
Sep 20 02:04:28.280767 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:28.280733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv" event={"ID":"e12eb8f9-3a7c-4cda-b0b1-0d601794d811","Type":"ContainerStarted","Data":"9c3cb343db96e206d2c45a7e5c49c8084345f86b6098e26e2e5b8f98203f8081"}
Sep 20 02:04:28.298207 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:28.298160    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv" podStartSLOduration=1.32563938 podStartE2EDuration="2.298143562s" totalImagesPullingTime="972.504182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:04:28.29664937 +0000 UTC m=+713.581661306" watchObservedRunningTime="2026-09-20 02:04:28.298143562 +0000 UTC m=+713.583155495"
Sep 20 02:04:36.731394 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:36.731354    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:36.731824 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:36.731466    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:36.743972 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:36.743944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:37.336958 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:37.336923    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lgmv"
Sep 20 02:04:54.614390 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.614356    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"]
Sep 20 02:04:54.618752 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.618731    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.621505 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.621480    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 20 02:04:54.629173 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.629151    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"]
Sep 20 02:04:54.714673 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.714636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.714673 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.714675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.714915 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.714764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.714915 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.714838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9h4r\" (UniqueName: \"kubernetes.io/projected/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-kube-api-access-z9h4r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.714915 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.714878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.714915 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.714908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.815676 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.815639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.815676 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.815690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.815941 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.815713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.815941 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.815739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.815941 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.815815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.815941 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.815847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9h4r\" (UniqueName: \"kubernetes.io/projected/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-kube-api-access-z9h4r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.816147 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.816123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.816197 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.816172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.816197 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.816184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.818182 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.818161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.818303 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.818284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.823755 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.823731    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9h4r\" (UniqueName: \"kubernetes.io/projected/3c0cafe2-a7c9-4119-9c50-0ac4dfb11278-kube-api-access-z9h4r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb\" (UID: \"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:54.929030 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:54.928936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:04:55.200424 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:55.200400    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"]
Sep 20 02:04:55.209205 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:04:55.203413    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0cafe2_a7c9_4119_9c50_0ac4dfb11278.slice/crio-642bfd60d6f8f2166c3e6cc975fada9179dee2523527890b648523b58e2f668f WatchSource:0}: Error finding container 642bfd60d6f8f2166c3e6cc975fada9179dee2523527890b648523b58e2f668f: Status 404 returned error can't find the container with id 642bfd60d6f8f2166c3e6cc975fada9179dee2523527890b648523b58e2f668f
Sep 20 02:04:55.404546 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:55.404507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb" event={"ID":"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278","Type":"ContainerStarted","Data":"642bfd60d6f8f2166c3e6cc975fada9179dee2523527890b648523b58e2f668f"}
Sep 20 02:04:56.411018 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:56.410982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb" event={"ID":"3c0cafe2-a7c9-4119-9c50-0ac4dfb11278","Type":"ContainerStarted","Data":"188a7a3177d01a78f6505a2256858df9444986ffbf05a495847aa94e85cf964f"}
Sep 20 02:04:56.430852 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:56.430784    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb" podStartSLOduration=2.272963831 podStartE2EDuration="2.43076913s" totalImagesPullingTime="157.805299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:04:56.429218738 +0000 UTC m=+741.714230676" watchObservedRunningTime="2026-09-20 02:04:56.43076913 +0000 UTC m=+741.715781065"
Sep 20 02:04:59.220365 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.220326    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"]
Sep 20 02:04:59.223281 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.223257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.226249 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.226227    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 20 02:04:59.226440 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.226418    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"]
Sep 20 02:04:59.356087 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.356046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/554e4ba0-63a2-4198-8a60-6ff620afedba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.356087 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.356088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.356279 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.356158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.356279 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.356193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.356279 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.356210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.356388 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.356294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xsxb\" (UniqueName: \"kubernetes.io/projected/554e4ba0-63a2-4198-8a60-6ff620afedba-kube-api-access-6xsxb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.457279 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.457240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xsxb\" (UniqueName: \"kubernetes.io/projected/554e4ba0-63a2-4198-8a60-6ff620afedba-kube-api-access-6xsxb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.457443 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.457383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/554e4ba0-63a2-4198-8a60-6ff620afedba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.457443 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.457406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.457443 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.457430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.457565 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.457451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.457565 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.457468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.457921 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.457894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.458072 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.457926    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.458072 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.457953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.459698 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.459680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/554e4ba0-63a2-4198-8a60-6ff620afedba-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.459893 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.459875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/554e4ba0-63a2-4198-8a60-6ff620afedba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.464969 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.464946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xsxb\" (UniqueName: \"kubernetes.io/projected/554e4ba0-63a2-4198-8a60-6ff620afedba-kube-api-access-6xsxb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dxndd\" (UID: \"554e4ba0-63a2-4198-8a60-6ff620afedba\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.535161 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.535126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:04:59.805039 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:04:59.805010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"]
Sep 20 02:04:59.807019 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:04:59.806996    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554e4ba0_63a2_4198_8a60_6ff620afedba.slice/crio-747d8b4daeaa64fe67d2c6d62f68f6542f241bd285293fef6fc4b66319668f17 WatchSource:0}: Error finding container 747d8b4daeaa64fe67d2c6d62f68f6542f241bd285293fef6fc4b66319668f17: Status 404 returned error can't find the container with id 747d8b4daeaa64fe67d2c6d62f68f6542f241bd285293fef6fc4b66319668f17
Sep 20 02:05:00.429884 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:00.429844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd" event={"ID":"554e4ba0-63a2-4198-8a60-6ff620afedba","Type":"ContainerStarted","Data":"4dfed5c8f56d61f8d135960378bc8a3a38c05602a1f7e7c03eb3e42a20e9202f"}
Sep 20 02:05:00.430318 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:00.429904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd" event={"ID":"554e4ba0-63a2-4198-8a60-6ff620afedba","Type":"ContainerStarted","Data":"747d8b4daeaa64fe67d2c6d62f68f6542f241bd285293fef6fc4b66319668f17"}
Sep 20 02:05:00.446684 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:00.446639    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd" podStartSLOduration=1.275394592 podStartE2EDuration="1.446622775s" totalImagesPullingTime="171.228183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:05:00.445121427 +0000 UTC m=+745.730133390" watchObservedRunningTime="2026-09-20 02:05:00.446622775 +0000 UTC m=+745.731634709"
Sep 20 02:05:04.929521 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:04.929482    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:05:04.930024 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:04.929554    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:05:04.942114 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:04.942085    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:05:05.463515 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:05.463485    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb"
Sep 20 02:05:09.535719 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:09.535687    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:05:09.536107 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:09.535746    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:05:09.547850 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:09.547824    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:05:10.485612 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:05:10.485583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dxndd"
Sep 20 02:06:55.415483 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.415451    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"]
Sep 20 02:06:55.419003 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.418980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.421658 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.421632    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-b15051-openshift-default-dockercfg-zgg7c\""
Sep 20 02:06:55.431447 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.431420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"]
Sep 20 02:06:55.486315 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.486282    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"]
Sep 20 02:06:55.489662 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.489640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.492267 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.492238    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-8195ba-openshift-default-dockercfg-zs5qj\""
Sep 20 02:06:55.502671 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.502644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"]
Sep 20 02:06:55.506700 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.506672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-envoy\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.506831 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.506726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-certs\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.506831 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.506769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-podinfo\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.506831 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.506820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-token\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.506979 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.506864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istiod-ca-cert\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.506979 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.506957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-socket\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.507081 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.506999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-data\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.507081 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.507029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f42bt\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-kube-api-access-f42bt\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.507158 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.507080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-credential-socket\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608173 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-data\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.608173 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-podinfo\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.608427 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx86n\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-kube-api-access-fx86n\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.608427 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-socket\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608427 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-data\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608427 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f42bt\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-kube-api-access-f42bt\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608427 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-socket\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.608427 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-envoy\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.608427 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-credential-socket\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608427 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-token\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-certs\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-envoy\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-certs\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-credential-socket\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-podinfo\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7786c5a5-53cd-44d0-b129-f79742ba4723-istiod-ca-cert\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-token\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-socket\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-credential-socket\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608813    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-data\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-certs\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.608954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.608873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istiod-ca-cert\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.609543 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.609477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istiod-ca-cert\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.610951 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.610930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-envoy\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.611421 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.611405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-podinfo\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.616286 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.616266    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-token\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.616521 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.616500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f42bt\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-kube-api-access-f42bt\") pod \"e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") " pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.709909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.709818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-data\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.709909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.709860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-podinfo\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.709909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.709878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx86n\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-kube-api-access-fx86n\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.709909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.709898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-socket\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710250 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.709919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-envoy\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710250 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.709965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-token\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710250 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.709995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-certs\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710250 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.710037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-credential-socket\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710250 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.710204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7786c5a5-53cd-44d0-b129-f79742ba4723-istiod-ca-cert\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710461 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.710293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-data\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710461 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.710331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-socket\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710461 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.710450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-credential-socket\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710630 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.710607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-certs\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.710891 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.710875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7786c5a5-53cd-44d0-b129-f79742ba4723-istiod-ca-cert\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.712345 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.712316    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-envoy\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.712561 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.712539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-podinfo\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.717996 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.717965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-token\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.718361 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.718341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx86n\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-kube-api-access-fx86n\") pod \"e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") " pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:55.731267 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.731240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:55.801587 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:55.801190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:56.014521 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.014494    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"]
Sep 20 02:06:56.016440 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:06:56.016413    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6cbadf_4c23_4a1c_9f8c_c3ad9cab7430.slice/crio-e33301acd5af77031de09b743089710b357ec659d25cb1023798f869fb6ba05e WatchSource:0}: Error finding container e33301acd5af77031de09b743089710b357ec659d25cb1023798f869fb6ba05e: Status 404 returned error can't find the container with id e33301acd5af77031de09b743089710b357ec659d25cb1023798f869fb6ba05e
Sep 20 02:06:56.018578 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.018528    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:06:56.018673 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.018623    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:06:56.018734 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.018668    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:06:56.079336 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.079314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"]
Sep 20 02:06:56.081188 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:06:56.081165    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7786c5a5_53cd_44d0_b129_f79742ba4723.slice/crio-b9bbafd4261e046edf2c02afa053756dc32143dc45797037dfdbbd0925710c3b WatchSource:0}: Error finding container b9bbafd4261e046edf2c02afa053756dc32143dc45797037dfdbbd0925710c3b: Status 404 returned error can't find the container with id b9bbafd4261e046edf2c02afa053756dc32143dc45797037dfdbbd0925710c3b
Sep 20 02:06:56.083386 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.083357    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:06:56.083436 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.083422    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:06:56.083474 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.083454    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:06:56.942165 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.942125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" event={"ID":"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430","Type":"ContainerStarted","Data":"dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae"}
Sep 20 02:06:56.942606 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.942184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" event={"ID":"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430","Type":"ContainerStarted","Data":"e33301acd5af77031de09b743089710b357ec659d25cb1023798f869fb6ba05e"}
Sep 20 02:06:56.943644 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.943623    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" event={"ID":"7786c5a5-53cd-44d0-b129-f79742ba4723","Type":"ContainerStarted","Data":"f25ab95a91cfb1c5e0a856c44fc1a39577f621d05c4262086704bb0c24998e16"}
Sep 20 02:06:56.943730 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.943664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" event={"ID":"7786c5a5-53cd-44d0-b129-f79742ba4723","Type":"ContainerStarted","Data":"b9bbafd4261e046edf2c02afa053756dc32143dc45797037dfdbbd0925710c3b"}
Sep 20 02:06:56.986618 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:56.986563    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" podStartSLOduration=1.9865465100000002 podStartE2EDuration="1.98654651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:06:56.982908658 +0000 UTC m=+862.267920594" watchObservedRunningTime="2026-09-20 02:06:56.98654651 +0000 UTC m=+862.271558448"
Sep 20 02:06:57.031198 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:57.031148    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" podStartSLOduration=2.031133316 podStartE2EDuration="2.031133316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:06:57.030342032 +0000 UTC m=+862.315353968" watchObservedRunningTime="2026-09-20 02:06:57.031133316 +0000 UTC m=+862.316145251"
Sep 20 02:06:57.731934 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:57.731891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:57.736623 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:57.736598    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:57.802022 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:57.801988    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:57.806771 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:57.806744    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:57.948464 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:57.948419    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:57.948888 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:57.948478    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:06:57.949403 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:57.949378    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:06:57.949523 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:06:57.949512    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:07:03.309622 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.309584    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"]
Sep 20 02:07:03.312977 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.312960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:03.315894 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.315865    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-8195ba\""
Sep 20 02:07:03.327112 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.327086    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"]
Sep 20 02:07:03.341751 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.341724    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"]
Sep 20 02:07:03.346351 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.346331    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:03.348650 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.348626    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-8195ba-dockercfg-hw6m9\""
Sep 20 02:07:03.356219 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.356199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"]
Sep 20 02:07:03.386993 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.386954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqldl\" (UniqueName: \"kubernetes.io/projected/a9653942-e600-49d5-8bf8-dab0b1e7a167-kube-api-access-sqldl\") pod \"payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m\" (UID: \"a9653942-e600-49d5-8bf8-dab0b1e7a167\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:03.387151 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.387015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9653942-e600-49d5-8bf8-dab0b1e7a167-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m\" (UID: \"a9653942-e600-49d5-8bf8-dab0b1e7a167\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:03.487908 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.487869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqldl\" (UniqueName: \"kubernetes.io/projected/a9653942-e600-49d5-8bf8-dab0b1e7a167-kube-api-access-sqldl\") pod \"payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m\" (UID: \"a9653942-e600-49d5-8bf8-dab0b1e7a167\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:03.488079 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.487933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9653942-e600-49d5-8bf8-dab0b1e7a167-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m\" (UID: \"a9653942-e600-49d5-8bf8-dab0b1e7a167\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:03.488079 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.487971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45w6k\" (UniqueName: \"kubernetes.io/projected/c4007c92-8a1a-4000-84cd-089129df49c3-kube-api-access-45w6k\") pod \"payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg\" (UID: \"c4007c92-8a1a-4000-84cd-089129df49c3\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:03.488079 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.488048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4007c92-8a1a-4000-84cd-089129df49c3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg\" (UID: \"c4007c92-8a1a-4000-84cd-089129df49c3\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:03.488711 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.488683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9653942-e600-49d5-8bf8-dab0b1e7a167-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m\" (UID: \"a9653942-e600-49d5-8bf8-dab0b1e7a167\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:03.496887 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.496857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqldl\" (UniqueName: \"kubernetes.io/projected/a9653942-e600-49d5-8bf8-dab0b1e7a167-kube-api-access-sqldl\") pod \"payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m\" (UID: \"a9653942-e600-49d5-8bf8-dab0b1e7a167\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:03.589392 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.589291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45w6k\" (UniqueName: \"kubernetes.io/projected/c4007c92-8a1a-4000-84cd-089129df49c3-kube-api-access-45w6k\") pod \"payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg\" (UID: \"c4007c92-8a1a-4000-84cd-089129df49c3\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:03.589392 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.589378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4007c92-8a1a-4000-84cd-089129df49c3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg\" (UID: \"c4007c92-8a1a-4000-84cd-089129df49c3\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:03.590193 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.590173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4007c92-8a1a-4000-84cd-089129df49c3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg\" (UID: \"c4007c92-8a1a-4000-84cd-089129df49c3\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:03.597056 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.597028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45w6k\" (UniqueName: \"kubernetes.io/projected/c4007c92-8a1a-4000-84cd-089129df49c3-kube-api-access-45w6k\") pod \"payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg\" (UID: \"c4007c92-8a1a-4000-84cd-089129df49c3\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:03.625441 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.625415    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:03.657350 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.657324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:03.903831 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.903722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"]
Sep 20 02:07:03.905347 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:07:03.905197    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9653942_e600_49d5_8bf8_dab0b1e7a167.slice/crio-d0d4cfc5773f400180e73cce301fed4b5734438aea1f9a0b0cbdf02beed2e3e7 WatchSource:0}: Error finding container d0d4cfc5773f400180e73cce301fed4b5734438aea1f9a0b0cbdf02beed2e3e7: Status 404 returned error can't find the container with id d0d4cfc5773f400180e73cce301fed4b5734438aea1f9a0b0cbdf02beed2e3e7
Sep 20 02:07:03.935444 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.935402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"]
Sep 20 02:07:03.939053 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:07:03.939022    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4007c92_8a1a_4000_84cd_089129df49c3.slice/crio-641a5127c65c42cf7958cde9643925e838b09db7f757b1f7738513a01ff934ab WatchSource:0}: Error finding container 641a5127c65c42cf7958cde9643925e838b09db7f757b1f7738513a01ff934ab: Status 404 returned error can't find the container with id 641a5127c65c42cf7958cde9643925e838b09db7f757b1f7738513a01ff934ab
Sep 20 02:07:03.979741 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.979714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg" event={"ID":"c4007c92-8a1a-4000-84cd-089129df49c3","Type":"ContainerStarted","Data":"641a5127c65c42cf7958cde9643925e838b09db7f757b1f7738513a01ff934ab"}
Sep 20 02:07:03.981438 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.981414    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m" event={"ID":"a9653942-e600-49d5-8bf8-dab0b1e7a167","Type":"ContainerStarted","Data":"1f881e0ac44487bdec5f70834d9e18354505a41eeece0826c0d5effe4e2bf18a"}
Sep 20 02:07:03.981523 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.981464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m" event={"ID":"a9653942-e600-49d5-8bf8-dab0b1e7a167","Type":"ContainerStarted","Data":"d0d4cfc5773f400180e73cce301fed4b5734438aea1f9a0b0cbdf02beed2e3e7"}
Sep 20 02:07:03.981581 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.981559    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:03.999247 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:03.999185    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m" podStartSLOduration=0.999165596 podStartE2EDuration="999.165596ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:07:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:07:03.997130697 +0000 UTC m=+869.282142646" watchObservedRunningTime="2026-09-20 02:07:03.999165596 +0000 UTC m=+869.284177530"
Sep 20 02:07:04.988662 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:04.988621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg" event={"ID":"c4007c92-8a1a-4000-84cd-089129df49c3","Type":"ContainerStarted","Data":"7af39ca2c98395e96cef9283a704456d4d54c082817f65920e3f7cca671db4d9"}
Sep 20 02:07:05.007647 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:05.007594    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg" podStartSLOduration=2.007578428 podStartE2EDuration="2.007578428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:07:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:07:05.005282586 +0000 UTC m=+870.290294523" watchObservedRunningTime="2026-09-20 02:07:05.007578428 +0000 UTC m=+870.292590364"
Sep 20 02:07:05.992761 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:05.992729    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:06.846682 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:06.846648    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"]
Sep 20 02:07:06.849974 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:06.849958    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:06.852667 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:06.852649    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-04a2fd\""
Sep 20 02:07:06.876837 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:06.876780    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"]
Sep 20 02:07:06.900807 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:06.896079    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"]
Sep 20 02:07:06.901587 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:06.901556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:06.904534 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:06.904512    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-04a2fd-dockercfg-twfqb\""
Sep 20 02:07:06.908442 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:06.908420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"]
Sep 20 02:07:07.024746 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.024695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b2ceeed-7d83-401e-bd47-961f11d30853-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz\" (UID: \"0b2ceeed-7d83-401e-bd47-961f11d30853\") " pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:07.024746 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.024748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zv94\" (UniqueName: \"kubernetes.io/projected/0b2ceeed-7d83-401e-bd47-961f11d30853-kube-api-access-9zv94\") pod \"payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz\" (UID: \"0b2ceeed-7d83-401e-bd47-961f11d30853\") " pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:07.025156 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.024895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251d0dc7-5e09-4e11-aa75-d42586faf07a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2\" (UID: \"251d0dc7-5e09-4e11-aa75-d42586faf07a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:07.025156 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.024917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqdxg\" (UniqueName: \"kubernetes.io/projected/251d0dc7-5e09-4e11-aa75-d42586faf07a-kube-api-access-gqdxg\") pod \"payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2\" (UID: \"251d0dc7-5e09-4e11-aa75-d42586faf07a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:07.126130 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.126038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b2ceeed-7d83-401e-bd47-961f11d30853-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz\" (UID: \"0b2ceeed-7d83-401e-bd47-961f11d30853\") " pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:07.126130 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.126076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zv94\" (UniqueName: \"kubernetes.io/projected/0b2ceeed-7d83-401e-bd47-961f11d30853-kube-api-access-9zv94\") pod \"payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz\" (UID: \"0b2ceeed-7d83-401e-bd47-961f11d30853\") " pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:07.126357 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.126150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251d0dc7-5e09-4e11-aa75-d42586faf07a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2\" (UID: \"251d0dc7-5e09-4e11-aa75-d42586faf07a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:07.126357 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.126166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqdxg\" (UniqueName: \"kubernetes.io/projected/251d0dc7-5e09-4e11-aa75-d42586faf07a-kube-api-access-gqdxg\") pod \"payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2\" (UID: \"251d0dc7-5e09-4e11-aa75-d42586faf07a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:07.126817 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.126764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b2ceeed-7d83-401e-bd47-961f11d30853-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz\" (UID: \"0b2ceeed-7d83-401e-bd47-961f11d30853\") " pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:07.126939 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.126920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251d0dc7-5e09-4e11-aa75-d42586faf07a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2\" (UID: \"251d0dc7-5e09-4e11-aa75-d42586faf07a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:07.139391 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.139359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zv94\" (UniqueName: \"kubernetes.io/projected/0b2ceeed-7d83-401e-bd47-961f11d30853-kube-api-access-9zv94\") pod \"payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz\" (UID: \"0b2ceeed-7d83-401e-bd47-961f11d30853\") " pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:07.145343 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.145319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqdxg\" (UniqueName: \"kubernetes.io/projected/251d0dc7-5e09-4e11-aa75-d42586faf07a-kube-api-access-gqdxg\") pod \"payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2\" (UID: \"251d0dc7-5e09-4e11-aa75-d42586faf07a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:07.160472 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.160444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:07.212989 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.212960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:07.436482 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.436453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"]
Sep 20 02:07:07.438866 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:07:07.438837    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251d0dc7_5e09_4e11_aa75_d42586faf07a.slice/crio-d172e0f6e6b4a3de38de007ba1fd945c9de9a09063f3cd287a99361b46e27124 WatchSource:0}: Error finding container d172e0f6e6b4a3de38de007ba1fd945c9de9a09063f3cd287a99361b46e27124: Status 404 returned error can't find the container with id d172e0f6e6b4a3de38de007ba1fd945c9de9a09063f3cd287a99361b46e27124
Sep 20 02:07:07.494340 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:07.494316    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"]
Sep 20 02:07:07.497370 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:07:07.497346    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2ceeed_7d83_401e_bd47_961f11d30853.slice/crio-51116d0d44841426449f2bfd0f2c8db7b201066dd5cbfe91de08cb1c8a4c29b9 WatchSource:0}: Error finding container 51116d0d44841426449f2bfd0f2c8db7b201066dd5cbfe91de08cb1c8a4c29b9: Status 404 returned error can't find the container with id 51116d0d44841426449f2bfd0f2c8db7b201066dd5cbfe91de08cb1c8a4c29b9
Sep 20 02:07:08.008317 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:08.008275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz" event={"ID":"0b2ceeed-7d83-401e-bd47-961f11d30853","Type":"ContainerStarted","Data":"631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec"}
Sep 20 02:07:08.008495 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:08.008344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz" event={"ID":"0b2ceeed-7d83-401e-bd47-961f11d30853","Type":"ContainerStarted","Data":"51116d0d44841426449f2bfd0f2c8db7b201066dd5cbfe91de08cb1c8a4c29b9"}
Sep 20 02:07:08.008495 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:08.008401    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:08.010403 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:08.010370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2" event={"ID":"251d0dc7-5e09-4e11-aa75-d42586faf07a","Type":"ContainerStarted","Data":"015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7"}
Sep 20 02:07:08.010525 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:08.010427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2" event={"ID":"251d0dc7-5e09-4e11-aa75-d42586faf07a","Type":"ContainerStarted","Data":"d172e0f6e6b4a3de38de007ba1fd945c9de9a09063f3cd287a99361b46e27124"}
Sep 20 02:07:08.010631 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:08.010608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:08.026519 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:08.026462    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz" podStartSLOduration=2.026444376 podStartE2EDuration="2.026444376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:07:08.025499948 +0000 UTC m=+873.310511883" watchObservedRunningTime="2026-09-20 02:07:08.026444376 +0000 UTC m=+873.311456312"
Sep 20 02:07:08.044838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:08.044770    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2" podStartSLOduration=2.044751042 podStartE2EDuration="2.044751042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:07:08.042458011 +0000 UTC m=+873.327469951" watchObservedRunningTime="2026-09-20 02:07:08.044751042 +0000 UTC m=+873.329762982"
Sep 20 02:07:14.991230 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:14.991199    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:07:17.002509 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.002256    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:07:17.283283 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.283248    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"]
Sep 20 02:07:17.287884 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.287859    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:17.290441 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.290416    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c4557f0d\""
Sep 20 02:07:17.290903 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.290882    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c4557f0d-dockercfg-wv9hp\""
Sep 20 02:07:17.296996 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.296958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"]
Sep 20 02:07:17.343678 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.343636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwhc\" (UniqueName: \"kubernetes.io/projected/b213d034-3974-4a50-9143-1def1b8a7408-kube-api-access-fgwhc\") pod \"payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w\" (UID: \"b213d034-3974-4a50-9143-1def1b8a7408\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:17.344017 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.343996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b213d034-3974-4a50-9143-1def1b8a7408-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w\" (UID: \"b213d034-3974-4a50-9143-1def1b8a7408\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:17.386411 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.386371    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"]
Sep 20 02:07:17.396504 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.396473    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:17.414961 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.404898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"]
Sep 20 02:07:17.446412 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.446375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b213d034-3974-4a50-9143-1def1b8a7408-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w\" (UID: \"b213d034-3974-4a50-9143-1def1b8a7408\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:17.446574 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.446471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbcpb\" (UniqueName: \"kubernetes.io/projected/f5269a36-4340-4870-ad04-9b3dca948ec0-kube-api-access-mbcpb\") pod \"payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc\" (UID: \"f5269a36-4340-4870-ad04-9b3dca948ec0\") " pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:17.446574 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.446530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5269a36-4340-4870-ad04-9b3dca948ec0-plugins-config-volume\") pod \"payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc\" (UID: \"f5269a36-4340-4870-ad04-9b3dca948ec0\") " pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:17.446574 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.446563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwhc\" (UniqueName: \"kubernetes.io/projected/b213d034-3974-4a50-9143-1def1b8a7408-kube-api-access-fgwhc\") pod \"payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w\" (UID: \"b213d034-3974-4a50-9143-1def1b8a7408\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:17.447762 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.447733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b213d034-3974-4a50-9143-1def1b8a7408-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w\" (UID: \"b213d034-3974-4a50-9143-1def1b8a7408\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:17.456029 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.455997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwhc\" (UniqueName: \"kubernetes.io/projected/b213d034-3974-4a50-9143-1def1b8a7408-kube-api-access-fgwhc\") pod \"payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w\" (UID: \"b213d034-3974-4a50-9143-1def1b8a7408\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:17.547342 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.547251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbcpb\" (UniqueName: \"kubernetes.io/projected/f5269a36-4340-4870-ad04-9b3dca948ec0-kube-api-access-mbcpb\") pod \"payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc\" (UID: \"f5269a36-4340-4870-ad04-9b3dca948ec0\") " pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:17.547342 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.547323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5269a36-4340-4870-ad04-9b3dca948ec0-plugins-config-volume\") pod \"payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc\" (UID: \"f5269a36-4340-4870-ad04-9b3dca948ec0\") " pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:17.548279 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.548259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5269a36-4340-4870-ad04-9b3dca948ec0-plugins-config-volume\") pod \"payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc\" (UID: \"f5269a36-4340-4870-ad04-9b3dca948ec0\") " pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:17.559963 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.557749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbcpb\" (UniqueName: \"kubernetes.io/projected/f5269a36-4340-4870-ad04-9b3dca948ec0-kube-api-access-mbcpb\") pod \"payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc\" (UID: \"f5269a36-4340-4870-ad04-9b3dca948ec0\") " pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:17.608189 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.608153    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:17.746016 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.745968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:17.899148 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:17.899113    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"]
Sep 20 02:07:17.900923 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:07:17.900893    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb213d034_3974_4a50_9143_1def1b8a7408.slice/crio-1f238dad752473d6f8943f7507f0032a448593182e2a0b192e5aca9088061e11 WatchSource:0}: Error finding container 1f238dad752473d6f8943f7507f0032a448593182e2a0b192e5aca9088061e11: Status 404 returned error can't find the container with id 1f238dad752473d6f8943f7507f0032a448593182e2a0b192e5aca9088061e11
Sep 20 02:07:18.042976 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:18.042949    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"]
Sep 20 02:07:18.045147 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:07:18.045100    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5269a36_4340_4870_ad04_9b3dca948ec0.slice/crio-d33d9de0702a902070d4f3c0cd1a5cd6801068744afedd2c46b000c815e2fe3c WatchSource:0}: Error finding container d33d9de0702a902070d4f3c0cd1a5cd6801068744afedd2c46b000c815e2fe3c: Status 404 returned error can't find the container with id d33d9de0702a902070d4f3c0cd1a5cd6801068744afedd2c46b000c815e2fe3c
Sep 20 02:07:18.067687 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:18.067649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc" event={"ID":"f5269a36-4340-4870-ad04-9b3dca948ec0","Type":"ContainerStarted","Data":"d33d9de0702a902070d4f3c0cd1a5cd6801068744afedd2c46b000c815e2fe3c"}
Sep 20 02:07:18.070608 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:18.070581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w" event={"ID":"b213d034-3974-4a50-9143-1def1b8a7408","Type":"ContainerStarted","Data":"e25c8ee94ead3d52db3608aa4b9700e88136fe7c0deddee367339e955979ace0"}
Sep 20 02:07:18.070731 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:18.070638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w" event={"ID":"b213d034-3974-4a50-9143-1def1b8a7408","Type":"ContainerStarted","Data":"1f238dad752473d6f8943f7507f0032a448593182e2a0b192e5aca9088061e11"}
Sep 20 02:07:18.070731 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:18.070666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:18.088494 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:18.088427    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w" podStartSLOduration=1.088404152 podStartE2EDuration="1.088404152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:07:18.08592014 +0000 UTC m=+883.370932076" watchObservedRunningTime="2026-09-20 02:07:18.088404152 +0000 UTC m=+883.373416087"
Sep 20 02:07:19.017868 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.017835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:07:19.018089 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.017913    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:07:19.079886 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.079568    2565 generic.go:356] "Generic (PLEG): container finished" podID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerID="dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae" exitCode=0
Sep 20 02:07:19.079886 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.079644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" event={"ID":"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430","Type":"ContainerDied","Data":"dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae"}
Sep 20 02:07:19.081653 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.081264    2565 scope.go:117] "RemoveContainer" containerID="dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae"
Sep 20 02:07:19.083336 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.082805    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:07:19.083336 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.082898    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:07:19.083336 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.082946    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:07:19.084610 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.084430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc" event={"ID":"f5269a36-4340-4870-ad04-9b3dca948ec0","Type":"ContainerStarted","Data":"d08b5adb177f72d1c326a170861e32cf0b78d858dddc344e28b282d2909268e1"}
Sep 20 02:07:19.084676 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.084666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:19.173096 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:19.173019    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc" podStartSLOduration=2.172024663 podStartE2EDuration="2.172024663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:07:19.171035628 +0000 UTC m=+884.456047566" watchObservedRunningTime="2026-09-20 02:07:19.172024663 +0000 UTC m=+884.457036599"
Sep 20 02:07:20.091201 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.091168    2565 generic.go:356] "Generic (PLEG): container finished" podID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerID="f25ab95a91cfb1c5e0a856c44fc1a39577f621d05c4262086704bb0c24998e16" exitCode=0
Sep 20 02:07:20.091597 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.091241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" event={"ID":"7786c5a5-53cd-44d0-b129-f79742ba4723","Type":"ContainerDied","Data":"f25ab95a91cfb1c5e0a856c44fc1a39577f621d05c4262086704bb0c24998e16"}
Sep 20 02:07:20.091723 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.091706    2565 scope.go:117] "RemoveContainer" containerID="f25ab95a91cfb1c5e0a856c44fc1a39577f621d05c4262086704bb0c24998e16"
Sep 20 02:07:20.093016 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.092986    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:07:20.093114 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.093053    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:07:20.093114 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.093085    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:07:20.093446 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.093426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" event={"ID":"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430","Type":"ContainerStarted","Data":"3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96"}
Sep 20 02:07:20.732256 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.732214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:07:20.732487 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.732448    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 20 02:07:20.732617 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:20.732518    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 20 02:07:21.103557 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:21.103512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" event={"ID":"7786c5a5-53cd-44d0-b129-f79742ba4723","Type":"ContainerStarted","Data":"4771022fb01a97960580af8f222a4dde11e5f74dff55be3e4d5089f3df580558"}
Sep 20 02:07:21.732105 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:21.732059    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 20 02:07:21.732315 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:21.732134    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 20 02:07:21.802088 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:21.802054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:07:21.802273 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:21.802221    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 20 02:07:21.802347 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:21.802274    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 20 02:07:22.731653 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:22.731594    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 20 02:07:22.732053 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:22.731676    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 20 02:07:22.802530 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:22.802485    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 20 02:07:22.802725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:22.802565    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 20 02:07:23.731989 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:23.731942    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 20 02:07:23.732389 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:23.732010    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 20 02:07:23.802112 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:23.802079    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 20 02:07:23.802356 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:23.802332    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 20 02:07:24.732308 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.732211    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 20 02:07:24.732308 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.732276    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 20 02:07:24.800727 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.800683    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"]
Sep 20 02:07:24.802508 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.802485    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 20 02:07:24.802591 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.802529    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 20 02:07:24.804611 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.804596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:24.807068 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.807046    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-703998\""
Sep 20 02:07:24.813503 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.813477    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"]
Sep 20 02:07:24.823532 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.823453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5677da80-2d94-4d80-b043-cbda9386a640-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk\" (UID: \"5677da80-2d94-4d80-b043-cbda9386a640\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:24.823628 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.823545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6gm\" (UniqueName: \"kubernetes.io/projected/5677da80-2d94-4d80-b043-cbda9386a640-kube-api-access-4b6gm\") pod \"payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk\" (UID: \"5677da80-2d94-4d80-b043-cbda9386a640\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:24.926832 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.924860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5677da80-2d94-4d80-b043-cbda9386a640-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk\" (UID: \"5677da80-2d94-4d80-b043-cbda9386a640\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:24.926832 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.924987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6gm\" (UniqueName: \"kubernetes.io/projected/5677da80-2d94-4d80-b043-cbda9386a640-kube-api-access-4b6gm\") pod \"payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk\" (UID: \"5677da80-2d94-4d80-b043-cbda9386a640\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:24.926832 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.926025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5677da80-2d94-4d80-b043-cbda9386a640-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk\" (UID: \"5677da80-2d94-4d80-b043-cbda9386a640\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:24.933497 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:24.933445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6gm\" (UniqueName: \"kubernetes.io/projected/5677da80-2d94-4d80-b043-cbda9386a640-kube-api-access-4b6gm\") pod \"payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk\" (UID: \"5677da80-2d94-4d80-b043-cbda9386a640\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:25.139402 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:25.139358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:25.430090 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:25.430059    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"]
Sep 20 02:07:25.431944 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:07:25.431917    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5677da80_2d94_4d80_b043_cbda9386a640.slice/crio-181eebe1d186815ade30c91a16339eb43eb29b64377dc7a8cfb572ed6a74fbcf WatchSource:0}: Error finding container 181eebe1d186815ade30c91a16339eb43eb29b64377dc7a8cfb572ed6a74fbcf: Status 404 returned error can't find the container with id 181eebe1d186815ade30c91a16339eb43eb29b64377dc7a8cfb572ed6a74fbcf
Sep 20 02:07:25.736560 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:25.736490    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:07:25.736980 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:25.736863    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:07:25.737580 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:25.737559    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:07:25.802054 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:25.802019    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 20 02:07:25.802362 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:25.802312    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 20 02:07:26.130890 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:26.130855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk" event={"ID":"5677da80-2d94-4d80-b043-cbda9386a640","Type":"ContainerStarted","Data":"057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce"}
Sep 20 02:07:26.131090 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:26.130915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk" event={"ID":"5677da80-2d94-4d80-b043-cbda9386a640","Type":"ContainerStarted","Data":"181eebe1d186815ade30c91a16339eb43eb29b64377dc7a8cfb572ed6a74fbcf"}
Sep 20 02:07:26.132167 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:26.132145    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:26.155531 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:26.155474    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk" podStartSLOduration=2.155455013 podStartE2EDuration="2.155455013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:07:26.155020763 +0000 UTC m=+891.440032713" watchObservedRunningTime="2026-09-20 02:07:26.155455013 +0000 UTC m=+891.440466949"
Sep 20 02:07:26.802095 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:26.802059    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 20 02:07:26.802510 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:26.802129    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 20 02:07:27.806517 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:27.806438    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:07:27.806959 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:27.806719    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:07:27.807347 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:27.807331    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:07:29.086640 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:29.086608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:31.107583 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:31.107551    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:37.584499 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:37.584459    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"]
Sep 20 02:07:37.588251 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:37.588232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"
Sep 20 02:07:37.590756 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:37.590735    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:07:37.590990 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:37.590972    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:07:37.596266 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:37.596241    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"]
Sep 20 02:07:37.652609 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:37.652570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755c1765-943f-4906-9b11-f41de84b974b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz\" (UID: \"755c1765-943f-4906-9b11-f41de84b974b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"
Sep 20 02:07:37.753431 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:37.753393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755c1765-943f-4906-9b11-f41de84b974b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz\" (UID: \"755c1765-943f-4906-9b11-f41de84b974b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"
Sep 20 02:07:37.754052 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:37.754029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755c1765-943f-4906-9b11-f41de84b974b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz\" (UID: \"755c1765-943f-4906-9b11-f41de84b974b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"
Sep 20 02:07:37.899836 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:37.899734    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"
Sep 20 02:07:38.142558 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:38.142528    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:07:38.181479 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:38.181449    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"]
Sep 20 02:07:38.185096 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:07:38.185055    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755c1765_943f_4906_9b11_f41de84b974b.slice/crio-bd2927c28065711e08987dfb7d0da0a853a73b89bb489e606a3bfd4dcc15a52f WatchSource:0}: Error finding container bd2927c28065711e08987dfb7d0da0a853a73b89bb489e606a3bfd4dcc15a52f: Status 404 returned error can't find the container with id bd2927c28065711e08987dfb7d0da0a853a73b89bb489e606a3bfd4dcc15a52f
Sep 20 02:07:38.193919 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:38.193890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz" event={"ID":"755c1765-943f-4906-9b11-f41de84b974b","Type":"ContainerStarted","Data":"bd2927c28065711e08987dfb7d0da0a853a73b89bb489e606a3bfd4dcc15a52f"}
Sep 20 02:07:41.210675 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:41.210639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz" event={"ID":"755c1765-943f-4906-9b11-f41de84b974b","Type":"ContainerStarted","Data":"eab30143df6449ca5a26fa16bf8066871abb15993bba0fc8343f7f0279ebafb1"}
Sep 20 02:07:41.227111 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:41.227064    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz" podStartSLOduration=1.799511464 podStartE2EDuration="4.227049117s" totalImagesPullingTime="2.427537653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:07:41.225976297 +0000 UTC m=+906.510988233" watchObservedRunningTime="2026-09-20 02:07:41.227049117 +0000 UTC m=+906.512061052"
Sep 20 02:07:42.216492 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:42.216460    2565 generic.go:356] "Generic (PLEG): container finished" podID="755c1765-943f-4906-9b11-f41de84b974b" containerID="eab30143df6449ca5a26fa16bf8066871abb15993bba0fc8343f7f0279ebafb1" exitCode=0
Sep 20 02:07:42.216974 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:42.216549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz" event={"ID":"755c1765-943f-4906-9b11-f41de84b974b","Type":"ContainerDied","Data":"eab30143df6449ca5a26fa16bf8066871abb15993bba0fc8343f7f0279ebafb1"}
Sep 20 02:07:43.358403 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:43.358372    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"
Sep 20 02:07:43.521835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:43.521797    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755c1765-943f-4906-9b11-f41de84b974b-maas-api-service-ca\") pod \"755c1765-943f-4906-9b11-f41de84b974b\" (UID: \"755c1765-943f-4906-9b11-f41de84b974b\") "
Sep 20 02:07:43.522084 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:43.522061    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755c1765-943f-4906-9b11-f41de84b974b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "755c1765-943f-4906-9b11-f41de84b974b" (UID: "755c1765-943f-4906-9b11-f41de84b974b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:07:43.623125 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:43.623083    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/755c1765-943f-4906-9b11-f41de84b974b-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:07:44.227952 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:44.227922    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"
Sep 20 02:07:44.228133 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:44.227918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz" event={"ID":"755c1765-943f-4906-9b11-f41de84b974b","Type":"ContainerDied","Data":"bd2927c28065711e08987dfb7d0da0a853a73b89bb489e606a3bfd4dcc15a52f"}
Sep 20 02:07:44.228133 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:44.228056    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd2927c28065711e08987dfb7d0da0a853a73b89bb489e606a3bfd4dcc15a52f"
Sep 20 02:07:54.069083 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.069046    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"]
Sep 20 02:07:54.069504 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.069290    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc" podUID="f5269a36-4340-4870-ad04-9b3dca948ec0" containerName="payload-processing" containerID="cri-o://d08b5adb177f72d1c326a170861e32cf0b78d858dddc344e28b282d2909268e1" gracePeriod=30
Sep 20 02:07:54.075489 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.075457    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"]
Sep 20 02:07:54.075750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.075691    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w" podUID="b213d034-3974-4a50-9143-1def1b8a7408" containerName="payload-pre-processing" containerID="cri-o://e25c8ee94ead3d52db3608aa4b9700e88136fe7c0deddee367339e955979ace0" gracePeriod=30
Sep 20 02:07:54.226219 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.226188    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"]
Sep 20 02:07:54.229383 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.229350    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c4557f0d-l86hz"]
Sep 20 02:07:54.289537 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.289456    2565 generic.go:356] "Generic (PLEG): container finished" podID="f5269a36-4340-4870-ad04-9b3dca948ec0" containerID="d08b5adb177f72d1c326a170861e32cf0b78d858dddc344e28b282d2909268e1" exitCode=0
Sep 20 02:07:54.289696 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.289536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc" event={"ID":"f5269a36-4340-4870-ad04-9b3dca948ec0","Type":"ContainerDied","Data":"d08b5adb177f72d1c326a170861e32cf0b78d858dddc344e28b282d2909268e1"}
Sep 20 02:07:54.291489 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.291464    2565 generic.go:356] "Generic (PLEG): container finished" podID="b213d034-3974-4a50-9143-1def1b8a7408" containerID="e25c8ee94ead3d52db3608aa4b9700e88136fe7c0deddee367339e955979ace0" exitCode=0
Sep 20 02:07:54.291629 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.291543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w" event={"ID":"b213d034-3974-4a50-9143-1def1b8a7408","Type":"ContainerDied","Data":"e25c8ee94ead3d52db3608aa4b9700e88136fe7c0deddee367339e955979ace0"}
Sep 20 02:07:54.372188 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.372145    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:54.383507 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.383480    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:54.526065 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.526026    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5269a36-4340-4870-ad04-9b3dca948ec0-plugins-config-volume\") pod \"f5269a36-4340-4870-ad04-9b3dca948ec0\" (UID: \"f5269a36-4340-4870-ad04-9b3dca948ec0\") "
Sep 20 02:07:54.526260 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.526075    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbcpb\" (UniqueName: \"kubernetes.io/projected/f5269a36-4340-4870-ad04-9b3dca948ec0-kube-api-access-mbcpb\") pod \"f5269a36-4340-4870-ad04-9b3dca948ec0\" (UID: \"f5269a36-4340-4870-ad04-9b3dca948ec0\") "
Sep 20 02:07:54.526260 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.526107    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b213d034-3974-4a50-9143-1def1b8a7408-plugins-config-volume\") pod \"b213d034-3974-4a50-9143-1def1b8a7408\" (UID: \"b213d034-3974-4a50-9143-1def1b8a7408\") "
Sep 20 02:07:54.526260 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.526148    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgwhc\" (UniqueName: \"kubernetes.io/projected/b213d034-3974-4a50-9143-1def1b8a7408-kube-api-access-fgwhc\") pod \"b213d034-3974-4a50-9143-1def1b8a7408\" (UID: \"b213d034-3974-4a50-9143-1def1b8a7408\") "
Sep 20 02:07:54.526443 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.526394    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5269a36-4340-4870-ad04-9b3dca948ec0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5269a36-4340-4870-ad04-9b3dca948ec0" (UID: "f5269a36-4340-4870-ad04-9b3dca948ec0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:07:54.526552 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.526530    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b213d034-3974-4a50-9143-1def1b8a7408-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b213d034-3974-4a50-9143-1def1b8a7408" (UID: "b213d034-3974-4a50-9143-1def1b8a7408"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:07:54.528448 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.528419    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b213d034-3974-4a50-9143-1def1b8a7408-kube-api-access-fgwhc" (OuterVolumeSpecName: "kube-api-access-fgwhc") pod "b213d034-3974-4a50-9143-1def1b8a7408" (UID: "b213d034-3974-4a50-9143-1def1b8a7408"). InnerVolumeSpecName "kube-api-access-fgwhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:07:54.528523 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.528420    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5269a36-4340-4870-ad04-9b3dca948ec0-kube-api-access-mbcpb" (OuterVolumeSpecName: "kube-api-access-mbcpb") pod "f5269a36-4340-4870-ad04-9b3dca948ec0" (UID: "f5269a36-4340-4870-ad04-9b3dca948ec0"). InnerVolumeSpecName "kube-api-access-mbcpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:07:54.627243 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.627162    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgwhc\" (UniqueName: \"kubernetes.io/projected/b213d034-3974-4a50-9143-1def1b8a7408-kube-api-access-fgwhc\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:07:54.627243 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.627190    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5269a36-4340-4870-ad04-9b3dca948ec0-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:07:54.627243 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.627199    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbcpb\" (UniqueName: \"kubernetes.io/projected/f5269a36-4340-4870-ad04-9b3dca948ec0-kube-api-access-mbcpb\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:07:54.627243 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:54.627209    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b213d034-3974-4a50-9143-1def1b8a7408-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:07:55.221736 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.221701    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="755c1765-943f-4906-9b11-f41de84b974b" path="/var/lib/kubelet/pods/755c1765-943f-4906-9b11-f41de84b974b/volumes"
Sep 20 02:07:55.298111 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.298083    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"
Sep 20 02:07:55.298111 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.298091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc" event={"ID":"f5269a36-4340-4870-ad04-9b3dca948ec0","Type":"ContainerDied","Data":"d33d9de0702a902070d4f3c0cd1a5cd6801068744afedd2c46b000c815e2fe3c"}
Sep 20 02:07:55.298308 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.298150    2565 scope.go:117] "RemoveContainer" containerID="d08b5adb177f72d1c326a170861e32cf0b78d858dddc344e28b282d2909268e1"
Sep 20 02:07:55.299545 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.299522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w" event={"ID":"b213d034-3974-4a50-9143-1def1b8a7408","Type":"ContainerDied","Data":"1f238dad752473d6f8943f7507f0032a448593182e2a0b192e5aca9088061e11"}
Sep 20 02:07:55.299663 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.299527    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"
Sep 20 02:07:55.307170 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.307148    2565 scope.go:117] "RemoveContainer" containerID="e25c8ee94ead3d52db3608aa4b9700e88136fe7c0deddee367339e955979ace0"
Sep 20 02:07:55.316203 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.316182    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"]
Sep 20 02:07:55.322682 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.322659    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w"]
Sep 20 02:07:55.335553 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.335528    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"]
Sep 20 02:07:55.337279 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:55.337261    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc"]
Sep 20 02:07:57.223208 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:57.223172    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b213d034-3974-4a50-9143-1def1b8a7408" path="/var/lib/kubelet/pods/b213d034-3974-4a50-9143-1def1b8a7408/volumes"
Sep 20 02:07:57.223592 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:07:57.223549    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5269a36-4340-4870-ad04-9b3dca948ec0" path="/var/lib/kubelet/pods/f5269a36-4340-4870-ad04-9b3dca948ec0/volumes"
Sep 20 02:08:00.197618 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.197582    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"]
Sep 20 02:08:00.198095 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.198022    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b213d034-3974-4a50-9143-1def1b8a7408" containerName="payload-pre-processing"
Sep 20 02:08:00.198095 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.198036    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b213d034-3974-4a50-9143-1def1b8a7408" containerName="payload-pre-processing"
Sep 20 02:08:00.198095 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.198052    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755c1765-943f-4906-9b11-f41de84b974b" containerName="revoke-keys"
Sep 20 02:08:00.198095 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.198057    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="755c1765-943f-4906-9b11-f41de84b974b" containerName="revoke-keys"
Sep 20 02:08:00.198095 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.198067    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5269a36-4340-4870-ad04-9b3dca948ec0" containerName="payload-processing"
Sep 20 02:08:00.198095 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.198073    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5269a36-4340-4870-ad04-9b3dca948ec0" containerName="payload-processing"
Sep 20 02:08:00.198288 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.198130    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5269a36-4340-4870-ad04-9b3dca948ec0" containerName="payload-processing"
Sep 20 02:08:00.198288 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.198139    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b213d034-3974-4a50-9143-1def1b8a7408" containerName="payload-pre-processing"
Sep 20 02:08:00.198288 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.198146    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="755c1765-943f-4906-9b11-f41de84b974b" containerName="revoke-keys"
Sep 20 02:08:00.202606 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.202589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:00.205509 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.205479    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-34c720e3\""
Sep 20 02:08:00.205509 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.205492    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-34c720e3-dockercfg-vczjt\""
Sep 20 02:08:00.206129 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.206107    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"]
Sep 20 02:08:00.209628 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.209603    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:00.210806 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.210434    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"]
Sep 20 02:08:00.224122 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.224097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"]
Sep 20 02:08:00.278858 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.278816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-plugins-config-volume\") pod \"payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt\" (UID: \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\") " pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:00.279043 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.278887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9pb2\" (UniqueName: \"kubernetes.io/projected/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-kube-api-access-f9pb2\") pod \"payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt\" (UID: \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\") " pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:00.279043 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.278943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d928aeaa-19b9-463f-b862-8dd02ea9c453-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh\" (UID: \"d928aeaa-19b9-463f-b862-8dd02ea9c453\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:00.279043 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.278985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5pk7\" (UniqueName: \"kubernetes.io/projected/d928aeaa-19b9-463f-b862-8dd02ea9c453-kube-api-access-k5pk7\") pod \"payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh\" (UID: \"d928aeaa-19b9-463f-b862-8dd02ea9c453\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:00.380033 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.380001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-plugins-config-volume\") pod \"payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt\" (UID: \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\") " pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:00.380033 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.380037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9pb2\" (UniqueName: \"kubernetes.io/projected/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-kube-api-access-f9pb2\") pod \"payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt\" (UID: \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\") " pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:00.380288 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.380067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d928aeaa-19b9-463f-b862-8dd02ea9c453-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh\" (UID: \"d928aeaa-19b9-463f-b862-8dd02ea9c453\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:00.380288 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.380100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pk7\" (UniqueName: \"kubernetes.io/projected/d928aeaa-19b9-463f-b862-8dd02ea9c453-kube-api-access-k5pk7\") pod \"payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh\" (UID: \"d928aeaa-19b9-463f-b862-8dd02ea9c453\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:00.380716 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.380690    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-plugins-config-volume\") pod \"payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt\" (UID: \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\") " pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:00.380902 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.380882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d928aeaa-19b9-463f-b862-8dd02ea9c453-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh\" (UID: \"d928aeaa-19b9-463f-b862-8dd02ea9c453\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:00.388495 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.388465    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9pb2\" (UniqueName: \"kubernetes.io/projected/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-kube-api-access-f9pb2\") pod \"payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt\" (UID: \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\") " pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:00.388976 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.388956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5pk7\" (UniqueName: \"kubernetes.io/projected/d928aeaa-19b9-463f-b862-8dd02ea9c453-kube-api-access-k5pk7\") pod \"payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh\" (UID: \"d928aeaa-19b9-463f-b862-8dd02ea9c453\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:00.515999 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.515977    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:00.526038 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.526010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:00.792857 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.792829    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"]
Sep 20 02:08:00.794315 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:08:00.794287    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd928aeaa_19b9_463f_b862_8dd02ea9c453.slice/crio-ff1959871b7b6697da450df58171d0ee9e3d0e1318fa2b8b2b77c85168c109e3 WatchSource:0}: Error finding container ff1959871b7b6697da450df58171d0ee9e3d0e1318fa2b8b2b77c85168c109e3: Status 404 returned error can't find the container with id ff1959871b7b6697da450df58171d0ee9e3d0e1318fa2b8b2b77c85168c109e3
Sep 20 02:08:00.810476 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:00.810448    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"]
Sep 20 02:08:00.813731 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:08:00.813706    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bea3ee_4b21_4ab2_900f_b08c9ce32b05.slice/crio-5d80c2ebf0dc528225db494d9d4cdeb536fc2fc3b14d85c3d2a700710a8fb969 WatchSource:0}: Error finding container 5d80c2ebf0dc528225db494d9d4cdeb536fc2fc3b14d85c3d2a700710a8fb969: Status 404 returned error can't find the container with id 5d80c2ebf0dc528225db494d9d4cdeb536fc2fc3b14d85c3d2a700710a8fb969
Sep 20 02:08:01.335956 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:01.335918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt" event={"ID":"58bea3ee-4b21-4ab2-900f-b08c9ce32b05","Type":"ContainerStarted","Data":"0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1"}
Sep 20 02:08:01.336398 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:01.335989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt" event={"ID":"58bea3ee-4b21-4ab2-900f-b08c9ce32b05","Type":"ContainerStarted","Data":"5d80c2ebf0dc528225db494d9d4cdeb536fc2fc3b14d85c3d2a700710a8fb969"}
Sep 20 02:08:01.336398 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:01.336081    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:01.337675 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:01.337651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh" event={"ID":"d928aeaa-19b9-463f-b862-8dd02ea9c453","Type":"ContainerStarted","Data":"ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05"}
Sep 20 02:08:01.337840 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:01.337688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh" event={"ID":"d928aeaa-19b9-463f-b862-8dd02ea9c453","Type":"ContainerStarted","Data":"ff1959871b7b6697da450df58171d0ee9e3d0e1318fa2b8b2b77c85168c109e3"}
Sep 20 02:08:01.337840 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:01.337706    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:01.351654 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:01.351613    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt" podStartSLOduration=1.351598821 podStartE2EDuration="1.351598821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:08:01.350142932 +0000 UTC m=+926.635154869" watchObservedRunningTime="2026-09-20 02:08:01.351598821 +0000 UTC m=+926.636610784"
Sep 20 02:08:01.368702 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:01.368660    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh" podStartSLOduration=1.368646217 podStartE2EDuration="1.368646217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:08:01.366291024 +0000 UTC m=+926.651302962" watchObservedRunningTime="2026-09-20 02:08:01.368646217 +0000 UTC m=+926.653658152"
Sep 20 02:08:12.346290 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:12.346257    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:12.346896 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:12.346481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:23.443452 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:23.443417    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"]
Sep 20 02:08:23.450373 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:23.450348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"
Sep 20 02:08:23.453030 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:23.453003    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:08:23.453156 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:23.453003    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:08:23.454170 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:23.454138    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"]
Sep 20 02:08:23.509165 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:23.509133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc4402-db43-4c96-ab70-4e0604028ac8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5\" (UID: \"81dc4402-db43-4c96-ab70-4e0604028ac8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"
Sep 20 02:08:23.610413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:23.610376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc4402-db43-4c96-ab70-4e0604028ac8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5\" (UID: \"81dc4402-db43-4c96-ab70-4e0604028ac8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"
Sep 20 02:08:23.611077 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:23.611055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc4402-db43-4c96-ab70-4e0604028ac8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5\" (UID: \"81dc4402-db43-4c96-ab70-4e0604028ac8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"
Sep 20 02:08:23.763948 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:23.763918    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"
Sep 20 02:08:24.035123 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:24.035096    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"]
Sep 20 02:08:24.036639 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:08:24.036605    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81dc4402_db43_4c96_ab70_4e0604028ac8.slice/crio-85c01fd5e71d3926aa612d4e85ce72b961ccb7b96870539d3367fc7bdcc09f34 WatchSource:0}: Error finding container 85c01fd5e71d3926aa612d4e85ce72b961ccb7b96870539d3367fc7bdcc09f34: Status 404 returned error can't find the container with id 85c01fd5e71d3926aa612d4e85ce72b961ccb7b96870539d3367fc7bdcc09f34
Sep 20 02:08:24.463869 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:24.463827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5" event={"ID":"81dc4402-db43-4c96-ab70-4e0604028ac8","Type":"ContainerStarted","Data":"b75d6fae0b668e1c3fb476cb2b5b89c126db414199c646d0c68f65e946e27b23"}
Sep 20 02:08:24.464293 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:24.463886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5" event={"ID":"81dc4402-db43-4c96-ab70-4e0604028ac8","Type":"ContainerStarted","Data":"85c01fd5e71d3926aa612d4e85ce72b961ccb7b96870539d3367fc7bdcc09f34"}
Sep 20 02:08:24.478410 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:24.478369    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5" podStartSLOduration=1.478352822 podStartE2EDuration="1.478352822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:08:24.478228181 +0000 UTC m=+949.763240117" watchObservedRunningTime="2026-09-20 02:08:24.478352822 +0000 UTC m=+949.763364758"
Sep 20 02:08:25.469804 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:25.469762    2565 generic.go:356] "Generic (PLEG): container finished" podID="81dc4402-db43-4c96-ab70-4e0604028ac8" containerID="b75d6fae0b668e1c3fb476cb2b5b89c126db414199c646d0c68f65e946e27b23" exitCode=0
Sep 20 02:08:25.470190 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:25.469845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5" event={"ID":"81dc4402-db43-4c96-ab70-4e0604028ac8","Type":"ContainerDied","Data":"b75d6fae0b668e1c3fb476cb2b5b89c126db414199c646d0c68f65e946e27b23"}
Sep 20 02:08:26.604654 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:26.604630    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"
Sep 20 02:08:26.739824 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:26.739780    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc4402-db43-4c96-ab70-4e0604028ac8-maas-api-service-ca\") pod \"81dc4402-db43-4c96-ab70-4e0604028ac8\" (UID: \"81dc4402-db43-4c96-ab70-4e0604028ac8\") "
Sep 20 02:08:26.740203 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:26.740178    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81dc4402-db43-4c96-ab70-4e0604028ac8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "81dc4402-db43-4c96-ab70-4e0604028ac8" (UID: "81dc4402-db43-4c96-ab70-4e0604028ac8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:08:26.841219 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:26.841184    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc4402-db43-4c96-ab70-4e0604028ac8-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:08:27.480964 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:27.480877    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"
Sep 20 02:08:27.480964 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:27.480918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5" event={"ID":"81dc4402-db43-4c96-ab70-4e0604028ac8","Type":"ContainerDied","Data":"85c01fd5e71d3926aa612d4e85ce72b961ccb7b96870539d3367fc7bdcc09f34"}
Sep 20 02:08:27.481148 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:27.480987    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85c01fd5e71d3926aa612d4e85ce72b961ccb7b96870539d3367fc7bdcc09f34"
Sep 20 02:08:29.156804 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.156756    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"]
Sep 20 02:08:29.157303 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.157040    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt" podUID="58bea3ee-4b21-4ab2-900f-b08c9ce32b05" containerName="payload-processing" containerID="cri-o://0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1" gracePeriod=30
Sep 20 02:08:29.167620 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.167591    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"]
Sep 20 02:08:29.168003 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.167973    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh" podUID="d928aeaa-19b9-463f-b862-8dd02ea9c453" containerName="payload-pre-processing" containerID="cri-o://ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05" gracePeriod=30
Sep 20 02:08:29.320192 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.320133    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"]
Sep 20 02:08:29.322103 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.322072    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34c720e3-6chs5"]
Sep 20 02:08:29.467650 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.467625    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:29.478394 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.478368    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:29.492966 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.492942    2565 generic.go:356] "Generic (PLEG): container finished" podID="d928aeaa-19b9-463f-b862-8dd02ea9c453" containerID="ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05" exitCode=0
Sep 20 02:08:29.493079 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.492995    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"
Sep 20 02:08:29.493079 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.493010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh" event={"ID":"d928aeaa-19b9-463f-b862-8dd02ea9c453","Type":"ContainerDied","Data":"ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05"}
Sep 20 02:08:29.493192 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.493079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh" event={"ID":"d928aeaa-19b9-463f-b862-8dd02ea9c453","Type":"ContainerDied","Data":"ff1959871b7b6697da450df58171d0ee9e3d0e1318fa2b8b2b77c85168c109e3"}
Sep 20 02:08:29.493192 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.493112    2565 scope.go:117] "RemoveContainer" containerID="ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05"
Sep 20 02:08:29.494570 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.494548    2565 generic.go:356] "Generic (PLEG): container finished" podID="58bea3ee-4b21-4ab2-900f-b08c9ce32b05" containerID="0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1" exitCode=0
Sep 20 02:08:29.494683 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.494586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt" event={"ID":"58bea3ee-4b21-4ab2-900f-b08c9ce32b05","Type":"ContainerDied","Data":"0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1"}
Sep 20 02:08:29.494683 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.494631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt" event={"ID":"58bea3ee-4b21-4ab2-900f-b08c9ce32b05","Type":"ContainerDied","Data":"5d80c2ebf0dc528225db494d9d4cdeb536fc2fc3b14d85c3d2a700710a8fb969"}
Sep 20 02:08:29.494683 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.494589    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"
Sep 20 02:08:29.504333 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.504313    2565 scope.go:117] "RemoveContainer" containerID="ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05"
Sep 20 02:08:29.504622 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:08:29.504602    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05\": container with ID starting with ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05 not found: ID does not exist" containerID="ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05"
Sep 20 02:08:29.504725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.504630    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05"} err="failed to get container status \"ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05\": rpc error: code = NotFound desc = could not find container \"ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05\": container with ID starting with ea3f461465ebe7e0d0b2bb4a33d1c35512d7a1cfb946aabf92b6fc20bf4eee05 not found: ID does not exist"
Sep 20 02:08:29.504725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.504647    2565 scope.go:117] "RemoveContainer" containerID="0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1"
Sep 20 02:08:29.513326 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.513308    2565 scope.go:117] "RemoveContainer" containerID="0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1"
Sep 20 02:08:29.513585 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:08:29.513569    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1\": container with ID starting with 0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1 not found: ID does not exist" containerID="0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1"
Sep 20 02:08:29.513649 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.513591    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1"} err="failed to get container status \"0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1\": rpc error: code = NotFound desc = could not find container \"0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1\": container with ID starting with 0e1187d3ed5bb18c3e66e808fc296e06c078e13166b02f7dcf7379fccd2445d1 not found: ID does not exist"
Sep 20 02:08:29.567368 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.567268    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9pb2\" (UniqueName: \"kubernetes.io/projected/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-kube-api-access-f9pb2\") pod \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\" (UID: \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\") "
Sep 20 02:08:29.567368 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.567336    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d928aeaa-19b9-463f-b862-8dd02ea9c453-plugins-config-volume\") pod \"d928aeaa-19b9-463f-b862-8dd02ea9c453\" (UID: \"d928aeaa-19b9-463f-b862-8dd02ea9c453\") "
Sep 20 02:08:29.567631 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.567415    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-plugins-config-volume\") pod \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\" (UID: \"58bea3ee-4b21-4ab2-900f-b08c9ce32b05\") "
Sep 20 02:08:29.567631 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.567454    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5pk7\" (UniqueName: \"kubernetes.io/projected/d928aeaa-19b9-463f-b862-8dd02ea9c453-kube-api-access-k5pk7\") pod \"d928aeaa-19b9-463f-b862-8dd02ea9c453\" (UID: \"d928aeaa-19b9-463f-b862-8dd02ea9c453\") "
Sep 20 02:08:29.568501 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.568364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58bea3ee-4b21-4ab2-900f-b08c9ce32b05" (UID: "58bea3ee-4b21-4ab2-900f-b08c9ce32b05"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:08:29.568645 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.568498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d928aeaa-19b9-463f-b862-8dd02ea9c453-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d928aeaa-19b9-463f-b862-8dd02ea9c453" (UID: "d928aeaa-19b9-463f-b862-8dd02ea9c453"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:08:29.570444 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.570414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d928aeaa-19b9-463f-b862-8dd02ea9c453-kube-api-access-k5pk7" (OuterVolumeSpecName: "kube-api-access-k5pk7") pod "d928aeaa-19b9-463f-b862-8dd02ea9c453" (UID: "d928aeaa-19b9-463f-b862-8dd02ea9c453"). InnerVolumeSpecName "kube-api-access-k5pk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:08:29.570659 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.570635    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-kube-api-access-f9pb2" (OuterVolumeSpecName: "kube-api-access-f9pb2") pod "58bea3ee-4b21-4ab2-900f-b08c9ce32b05" (UID: "58bea3ee-4b21-4ab2-900f-b08c9ce32b05"). InnerVolumeSpecName "kube-api-access-f9pb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:08:29.668260 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.668228    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9pb2\" (UniqueName: \"kubernetes.io/projected/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-kube-api-access-f9pb2\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:08:29.668260 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.668254    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d928aeaa-19b9-463f-b862-8dd02ea9c453-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:08:29.668260 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.668265    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58bea3ee-4b21-4ab2-900f-b08c9ce32b05-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:08:29.668492 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.668273    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5pk7\" (UniqueName: \"kubernetes.io/projected/d928aeaa-19b9-463f-b862-8dd02ea9c453-kube-api-access-k5pk7\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:08:29.819381 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.819349    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"]
Sep 20 02:08:29.824101 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.824077    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt"]
Sep 20 02:08:29.838150 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.838127    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"]
Sep 20 02:08:29.840245 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:29.840223    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh"]
Sep 20 02:08:31.220886 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:31.220844    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58bea3ee-4b21-4ab2-900f-b08c9ce32b05" path="/var/lib/kubelet/pods/58bea3ee-4b21-4ab2-900f-b08c9ce32b05/volumes"
Sep 20 02:08:31.221368 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:31.221349    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81dc4402-db43-4c96-ab70-4e0604028ac8" path="/var/lib/kubelet/pods/81dc4402-db43-4c96-ab70-4e0604028ac8/volumes"
Sep 20 02:08:31.221735 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:31.221715    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d928aeaa-19b9-463f-b862-8dd02ea9c453" path="/var/lib/kubelet/pods/d928aeaa-19b9-463f-b862-8dd02ea9c453/volumes"
Sep 20 02:08:35.655275 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655244    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"]
Sep 20 02:08:35.655655 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655641    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81dc4402-db43-4c96-ab70-4e0604028ac8" containerName="revoke-keys"
Sep 20 02:08:35.655707 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655656    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="81dc4402-db43-4c96-ab70-4e0604028ac8" containerName="revoke-keys"
Sep 20 02:08:35.655707 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655683    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d928aeaa-19b9-463f-b862-8dd02ea9c453" containerName="payload-pre-processing"
Sep 20 02:08:35.655707 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655689    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d928aeaa-19b9-463f-b862-8dd02ea9c453" containerName="payload-pre-processing"
Sep 20 02:08:35.655707 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655698    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58bea3ee-4b21-4ab2-900f-b08c9ce32b05" containerName="payload-processing"
Sep 20 02:08:35.655707 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655704    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="58bea3ee-4b21-4ab2-900f-b08c9ce32b05" containerName="payload-processing"
Sep 20 02:08:35.655878 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655757    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="58bea3ee-4b21-4ab2-900f-b08c9ce32b05" containerName="payload-processing"
Sep 20 02:08:35.655878 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655766    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d928aeaa-19b9-463f-b862-8dd02ea9c453" containerName="payload-pre-processing"
Sep 20 02:08:35.655878 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.655773    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="81dc4402-db43-4c96-ab70-4e0604028ac8" containerName="revoke-keys"
Sep 20 02:08:35.660150 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.660132    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:35.662576 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.662557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4c51cf40-dockercfg-2zjpw\""
Sep 20 02:08:35.662661 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.662609    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4c51cf40\""
Sep 20 02:08:35.667626 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.667604    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"]
Sep 20 02:08:35.693216 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.693187    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"]
Sep 20 02:08:35.696418 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.696403    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:35.706667 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.706645    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"]
Sep 20 02:08:35.830726 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.830690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbzsn\" (UniqueName: \"kubernetes.io/projected/04b72625-7c31-4dc6-90e1-d00e743192af-kube-api-access-fbzsn\") pod \"payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4\" (UID: \"04b72625-7c31-4dc6-90e1-d00e743192af\") " pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:35.830726 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.830731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04b72625-7c31-4dc6-90e1-d00e743192af-plugins-config-volume\") pod \"payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4\" (UID: \"04b72625-7c31-4dc6-90e1-d00e743192af\") " pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:35.830944 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.830863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjb8\" (UniqueName: \"kubernetes.io/projected/aad039a8-9a56-4a5e-919e-87ebb77d66f2-kube-api-access-xrjb8\") pod \"payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv\" (UID: \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:35.830944 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.830887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad039a8-9a56-4a5e-919e-87ebb77d66f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv\" (UID: \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:35.932190 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.932112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbzsn\" (UniqueName: \"kubernetes.io/projected/04b72625-7c31-4dc6-90e1-d00e743192af-kube-api-access-fbzsn\") pod \"payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4\" (UID: \"04b72625-7c31-4dc6-90e1-d00e743192af\") " pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:35.932190 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.932149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04b72625-7c31-4dc6-90e1-d00e743192af-plugins-config-volume\") pod \"payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4\" (UID: \"04b72625-7c31-4dc6-90e1-d00e743192af\") " pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:35.932382 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.932201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjb8\" (UniqueName: \"kubernetes.io/projected/aad039a8-9a56-4a5e-919e-87ebb77d66f2-kube-api-access-xrjb8\") pod \"payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv\" (UID: \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:35.932382 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.932220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad039a8-9a56-4a5e-919e-87ebb77d66f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv\" (UID: \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:35.932993 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.932968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad039a8-9a56-4a5e-919e-87ebb77d66f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv\" (UID: \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:35.933100 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.932993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04b72625-7c31-4dc6-90e1-d00e743192af-plugins-config-volume\") pod \"payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4\" (UID: \"04b72625-7c31-4dc6-90e1-d00e743192af\") " pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:35.940145 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.940113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjb8\" (UniqueName: \"kubernetes.io/projected/aad039a8-9a56-4a5e-919e-87ebb77d66f2-kube-api-access-xrjb8\") pod \"payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv\" (UID: \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:35.940259 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.940113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbzsn\" (UniqueName: \"kubernetes.io/projected/04b72625-7c31-4dc6-90e1-d00e743192af-kube-api-access-fbzsn\") pod \"payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4\" (UID: \"04b72625-7c31-4dc6-90e1-d00e743192af\") " pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:35.971519 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:35.971487    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:36.006694 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.006664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:36.252725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.252606    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"]
Sep 20 02:08:36.255459 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:08:36.255436    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b72625_7c31_4dc6_90e1_d00e743192af.slice/crio-d8a147f998b570b164463bd6a9703c0c695a390824c424f7dd2d9ee067028996 WatchSource:0}: Error finding container d8a147f998b570b164463bd6a9703c0c695a390824c424f7dd2d9ee067028996: Status 404 returned error can't find the container with id d8a147f998b570b164463bd6a9703c0c695a390824c424f7dd2d9ee067028996
Sep 20 02:08:36.297290 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.297263    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"]
Sep 20 02:08:36.298931 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:08:36.298906    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad039a8_9a56_4a5e_919e_87ebb77d66f2.slice/crio-c145659a4e6d44db610f64cbb70c8df05b0cc69fc2a1314cdbac8d1a6de0e0f4 WatchSource:0}: Error finding container c145659a4e6d44db610f64cbb70c8df05b0cc69fc2a1314cdbac8d1a6de0e0f4: Status 404 returned error can't find the container with id c145659a4e6d44db610f64cbb70c8df05b0cc69fc2a1314cdbac8d1a6de0e0f4
Sep 20 02:08:36.543727 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.543616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv" event={"ID":"aad039a8-9a56-4a5e-919e-87ebb77d66f2","Type":"ContainerStarted","Data":"78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07"}
Sep 20 02:08:36.543727 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.543690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv" event={"ID":"aad039a8-9a56-4a5e-919e-87ebb77d66f2","Type":"ContainerStarted","Data":"c145659a4e6d44db610f64cbb70c8df05b0cc69fc2a1314cdbac8d1a6de0e0f4"}
Sep 20 02:08:36.543727 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.543722    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:36.545297 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.545266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4" event={"ID":"04b72625-7c31-4dc6-90e1-d00e743192af","Type":"ContainerStarted","Data":"d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e"}
Sep 20 02:08:36.545437 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.545317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4" event={"ID":"04b72625-7c31-4dc6-90e1-d00e743192af","Type":"ContainerStarted","Data":"d8a147f998b570b164463bd6a9703c0c695a390824c424f7dd2d9ee067028996"}
Sep 20 02:08:36.545437 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.545361    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:36.558630 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.558581    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv" podStartSLOduration=1.558565645 podStartE2EDuration="1.558565645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:08:36.558506105 +0000 UTC m=+961.843518040" watchObservedRunningTime="2026-09-20 02:08:36.558565645 +0000 UTC m=+961.843577581"
Sep 20 02:08:36.574450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:36.574403    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4" podStartSLOduration=1.574385812 podStartE2EDuration="1.574385812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:08:36.573223151 +0000 UTC m=+961.858235086" watchObservedRunningTime="2026-09-20 02:08:36.574385812 +0000 UTC m=+961.859397749"
Sep 20 02:08:47.554380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:47.554342    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:08:47.554740 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:47.554684    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:08:55.309277 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.309237    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"]
Sep 20 02:08:55.314185 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.314163    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"
Sep 20 02:08:55.317102 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.317080    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:08:55.317247 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.317224    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:08:55.319501 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.319480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"]
Sep 20 02:08:55.410850 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.410819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50d5b96b-2887-4aa7-8931-2f6dc318e693-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp\" (UID: \"50d5b96b-2887-4aa7-8931-2f6dc318e693\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"
Sep 20 02:08:55.512145 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.512094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50d5b96b-2887-4aa7-8931-2f6dc318e693-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp\" (UID: \"50d5b96b-2887-4aa7-8931-2f6dc318e693\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"
Sep 20 02:08:55.512762 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.512735    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50d5b96b-2887-4aa7-8931-2f6dc318e693-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp\" (UID: \"50d5b96b-2887-4aa7-8931-2f6dc318e693\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"
Sep 20 02:08:55.628156 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.628072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"
Sep 20 02:08:55.898417 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:55.898387    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"]
Sep 20 02:08:55.899860 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:08:55.899835    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d5b96b_2887_4aa7_8931_2f6dc318e693.slice/crio-be9c104cc34defc1155979f7da29d5021d6d626a75f684c604352b6be47f69bc WatchSource:0}: Error finding container be9c104cc34defc1155979f7da29d5021d6d626a75f684c604352b6be47f69bc: Status 404 returned error can't find the container with id be9c104cc34defc1155979f7da29d5021d6d626a75f684c604352b6be47f69bc
Sep 20 02:08:56.649602 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:56.649562    2565 generic.go:356] "Generic (PLEG): container finished" podID="50d5b96b-2887-4aa7-8931-2f6dc318e693" containerID="89704f84a95b271ab18a55fab1409c7be861247ba6da503bf91d17d9a03c0038" exitCode=0
Sep 20 02:08:56.650024 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:56.649627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp" event={"ID":"50d5b96b-2887-4aa7-8931-2f6dc318e693","Type":"ContainerDied","Data":"89704f84a95b271ab18a55fab1409c7be861247ba6da503bf91d17d9a03c0038"}
Sep 20 02:08:56.650024 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:56.649678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp" event={"ID":"50d5b96b-2887-4aa7-8931-2f6dc318e693","Type":"ContainerStarted","Data":"be9c104cc34defc1155979f7da29d5021d6d626a75f684c604352b6be47f69bc"}
Sep 20 02:08:57.788351 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:57.788322    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"
Sep 20 02:08:57.833634 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:57.833590    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50d5b96b-2887-4aa7-8931-2f6dc318e693-maas-api-service-ca\") pod \"50d5b96b-2887-4aa7-8931-2f6dc318e693\" (UID: \"50d5b96b-2887-4aa7-8931-2f6dc318e693\") "
Sep 20 02:08:57.833935 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:57.833912    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50d5b96b-2887-4aa7-8931-2f6dc318e693-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "50d5b96b-2887-4aa7-8931-2f6dc318e693" (UID: "50d5b96b-2887-4aa7-8931-2f6dc318e693"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:08:57.834114 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:57.834092    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50d5b96b-2887-4aa7-8931-2f6dc318e693-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:08:58.663319 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:58.663287    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"
Sep 20 02:08:58.663319 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:58.663296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp" event={"ID":"50d5b96b-2887-4aa7-8931-2f6dc318e693","Type":"ContainerDied","Data":"be9c104cc34defc1155979f7da29d5021d6d626a75f684c604352b6be47f69bc"}
Sep 20 02:08:58.663529 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:08:58.663345    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be9c104cc34defc1155979f7da29d5021d6d626a75f684c604352b6be47f69bc"
Sep 20 02:09:03.489722 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.489685    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"]
Sep 20 02:09:03.490306 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.490285    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50d5b96b-2887-4aa7-8931-2f6dc318e693" containerName="revoke-keys"
Sep 20 02:09:03.490394 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.490309    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d5b96b-2887-4aa7-8931-2f6dc318e693" containerName="revoke-keys"
Sep 20 02:09:03.490448 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.490418    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="50d5b96b-2887-4aa7-8931-2f6dc318e693" containerName="revoke-keys"
Sep 20 02:09:03.493426 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.493406    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"
Sep 20 02:09:03.495713 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.495681    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:09:03.495713 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.495681    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:09:03.500471 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.500448    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"]
Sep 20 02:09:03.593705 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.593671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f133c0d6-75d8-4426-8cdf-5a364d83a15a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj\" (UID: \"f133c0d6-75d8-4426-8cdf-5a364d83a15a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"
Sep 20 02:09:03.694473 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.694442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f133c0d6-75d8-4426-8cdf-5a364d83a15a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj\" (UID: \"f133c0d6-75d8-4426-8cdf-5a364d83a15a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"
Sep 20 02:09:03.695061 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.695043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f133c0d6-75d8-4426-8cdf-5a364d83a15a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj\" (UID: \"f133c0d6-75d8-4426-8cdf-5a364d83a15a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"
Sep 20 02:09:03.804645 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:03.804567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"
Sep 20 02:09:04.073540 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:04.073473    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"]
Sep 20 02:09:04.076303 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:09:04.076276    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf133c0d6_75d8_4426_8cdf_5a364d83a15a.slice/crio-115cdc1e012af7da14642cf1a73f0a8852196fa06356af57d1338151cf3ebf58 WatchSource:0}: Error finding container 115cdc1e012af7da14642cf1a73f0a8852196fa06356af57d1338151cf3ebf58: Status 404 returned error can't find the container with id 115cdc1e012af7da14642cf1a73f0a8852196fa06356af57d1338151cf3ebf58
Sep 20 02:09:04.694300 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:04.694209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj" event={"ID":"f133c0d6-75d8-4426-8cdf-5a364d83a15a","Type":"ContainerStarted","Data":"9f2973177abd0b31f086e17cc91b77eb854d9ef056d4ba46ea21bb67e9989c55"}
Sep 20 02:09:04.694300 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:04.694263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj" event={"ID":"f133c0d6-75d8-4426-8cdf-5a364d83a15a","Type":"ContainerStarted","Data":"115cdc1e012af7da14642cf1a73f0a8852196fa06356af57d1338151cf3ebf58"}
Sep 20 02:09:04.711153 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:04.711102    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj" podStartSLOduration=1.711087606 podStartE2EDuration="1.711087606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:09:04.708614045 +0000 UTC m=+989.993625981" watchObservedRunningTime="2026-09-20 02:09:04.711087606 +0000 UTC m=+989.996099542"
Sep 20 02:09:05.700610 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:05.700576    2565 generic.go:356] "Generic (PLEG): container finished" podID="f133c0d6-75d8-4426-8cdf-5a364d83a15a" containerID="9f2973177abd0b31f086e17cc91b77eb854d9ef056d4ba46ea21bb67e9989c55" exitCode=0
Sep 20 02:09:05.701113 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:05.700660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj" event={"ID":"f133c0d6-75d8-4426-8cdf-5a364d83a15a","Type":"ContainerDied","Data":"9f2973177abd0b31f086e17cc91b77eb854d9ef056d4ba46ea21bb67e9989c55"}
Sep 20 02:09:06.296478 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:06.296446    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"]
Sep 20 02:09:06.298493 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:06.298462    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4cfa5a-dwznp"]
Sep 20 02:09:06.838848 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:06.838822    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"
Sep 20 02:09:06.925943 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:06.925910    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f133c0d6-75d8-4426-8cdf-5a364d83a15a-maas-api-service-ca\") pod \"f133c0d6-75d8-4426-8cdf-5a364d83a15a\" (UID: \"f133c0d6-75d8-4426-8cdf-5a364d83a15a\") "
Sep 20 02:09:06.926326 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:06.926302    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f133c0d6-75d8-4426-8cdf-5a364d83a15a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f133c0d6-75d8-4426-8cdf-5a364d83a15a" (UID: "f133c0d6-75d8-4426-8cdf-5a364d83a15a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:09:07.027450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:07.027418    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f133c0d6-75d8-4426-8cdf-5a364d83a15a-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:09:07.220678 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:07.220645    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50d5b96b-2887-4aa7-8931-2f6dc318e693" path="/var/lib/kubelet/pods/50d5b96b-2887-4aa7-8931-2f6dc318e693/volumes"
Sep 20 02:09:07.711185 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:07.711144    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"
Sep 20 02:09:07.711185 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:07.711164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj" event={"ID":"f133c0d6-75d8-4426-8cdf-5a364d83a15a","Type":"ContainerDied","Data":"115cdc1e012af7da14642cf1a73f0a8852196fa06356af57d1338151cf3ebf58"}
Sep 20 02:09:07.711470 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:07.711221    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="115cdc1e012af7da14642cf1a73f0a8852196fa06356af57d1338151cf3ebf58"
Sep 20 02:09:14.294450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.294418    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"]
Sep 20 02:09:14.294922 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.294633    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4" podUID="04b72625-7c31-4dc6-90e1-d00e743192af" containerName="payload-processing" containerID="cri-o://d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e" gracePeriod=30
Sep 20 02:09:14.298138 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.298111    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"]
Sep 20 02:09:14.298531 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.298494    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv" podUID="aad039a8-9a56-4a5e-919e-87ebb77d66f2" containerName="payload-pre-processing" containerID="cri-o://78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07" gracePeriod=30
Sep 20 02:09:14.461225 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.461155    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"]
Sep 20 02:09:14.463585 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.463551    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c51cf40-cbqjj"]
Sep 20 02:09:14.556950 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.556895    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:09:14.586718 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.586692    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:09:14.714955 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.714922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad039a8-9a56-4a5e-919e-87ebb77d66f2-plugins-config-volume\") pod \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\" (UID: \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\") "
Sep 20 02:09:14.715130 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.715036    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbzsn\" (UniqueName: \"kubernetes.io/projected/04b72625-7c31-4dc6-90e1-d00e743192af-kube-api-access-fbzsn\") pod \"04b72625-7c31-4dc6-90e1-d00e743192af\" (UID: \"04b72625-7c31-4dc6-90e1-d00e743192af\") "
Sep 20 02:09:14.715130 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.715083    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04b72625-7c31-4dc6-90e1-d00e743192af-plugins-config-volume\") pod \"04b72625-7c31-4dc6-90e1-d00e743192af\" (UID: \"04b72625-7c31-4dc6-90e1-d00e743192af\") "
Sep 20 02:09:14.715130 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.715116    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrjb8\" (UniqueName: \"kubernetes.io/projected/aad039a8-9a56-4a5e-919e-87ebb77d66f2-kube-api-access-xrjb8\") pod \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\" (UID: \"aad039a8-9a56-4a5e-919e-87ebb77d66f2\") "
Sep 20 02:09:14.715331 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.715306    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad039a8-9a56-4a5e-919e-87ebb77d66f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aad039a8-9a56-4a5e-919e-87ebb77d66f2" (UID: "aad039a8-9a56-4a5e-919e-87ebb77d66f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:09:14.715460 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.715427    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04b72625-7c31-4dc6-90e1-d00e743192af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "04b72625-7c31-4dc6-90e1-d00e743192af" (UID: "04b72625-7c31-4dc6-90e1-d00e743192af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:09:14.717186 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.717164    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad039a8-9a56-4a5e-919e-87ebb77d66f2-kube-api-access-xrjb8" (OuterVolumeSpecName: "kube-api-access-xrjb8") pod "aad039a8-9a56-4a5e-919e-87ebb77d66f2" (UID: "aad039a8-9a56-4a5e-919e-87ebb77d66f2"). InnerVolumeSpecName "kube-api-access-xrjb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:09:14.717270 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.717230    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b72625-7c31-4dc6-90e1-d00e743192af-kube-api-access-fbzsn" (OuterVolumeSpecName: "kube-api-access-fbzsn") pod "04b72625-7c31-4dc6-90e1-d00e743192af" (UID: "04b72625-7c31-4dc6-90e1-d00e743192af"). InnerVolumeSpecName "kube-api-access-fbzsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:09:14.761433 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.761396    2565 generic.go:356] "Generic (PLEG): container finished" podID="aad039a8-9a56-4a5e-919e-87ebb77d66f2" containerID="78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07" exitCode=0
Sep 20 02:09:14.761588 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.761462    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"
Sep 20 02:09:14.761588 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.761493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv" event={"ID":"aad039a8-9a56-4a5e-919e-87ebb77d66f2","Type":"ContainerDied","Data":"78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07"}
Sep 20 02:09:14.761588 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.761581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv" event={"ID":"aad039a8-9a56-4a5e-919e-87ebb77d66f2","Type":"ContainerDied","Data":"c145659a4e6d44db610f64cbb70c8df05b0cc69fc2a1314cdbac8d1a6de0e0f4"}
Sep 20 02:09:14.761767 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.761612    2565 scope.go:117] "RemoveContainer" containerID="78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07"
Sep 20 02:09:14.762969 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.762943    2565 generic.go:356] "Generic (PLEG): container finished" podID="04b72625-7c31-4dc6-90e1-d00e743192af" containerID="d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e" exitCode=0
Sep 20 02:09:14.763056 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.762994    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"
Sep 20 02:09:14.763056 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.763017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4" event={"ID":"04b72625-7c31-4dc6-90e1-d00e743192af","Type":"ContainerDied","Data":"d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e"}
Sep 20 02:09:14.763056 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.763052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4" event={"ID":"04b72625-7c31-4dc6-90e1-d00e743192af","Type":"ContainerDied","Data":"d8a147f998b570b164463bd6a9703c0c695a390824c424f7dd2d9ee067028996"}
Sep 20 02:09:14.771151 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.771105    2565 scope.go:117] "RemoveContainer" containerID="78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07"
Sep 20 02:09:14.771614 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:09:14.771585    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07\": container with ID starting with 78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07 not found: ID does not exist" containerID="78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07"
Sep 20 02:09:14.772023 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.771625    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07"} err="failed to get container status \"78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07\": rpc error: code = NotFound desc = could not find container \"78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07\": container with ID starting with 78e5e052f974686b14c2b0dddb6617a5140c8e913a4e0d2741c3ed7b5cb54c07 not found: ID does not exist"
Sep 20 02:09:14.772023 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.771648    2565 scope.go:117] "RemoveContainer" containerID="d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e"
Sep 20 02:09:14.794884 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.794481    2565 scope.go:117] "RemoveContainer" containerID="d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e"
Sep 20 02:09:14.795250 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:09:14.795153    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e\": container with ID starting with d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e not found: ID does not exist" containerID="d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e"
Sep 20 02:09:14.795250 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.795193    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e"} err="failed to get container status \"d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e\": rpc error: code = NotFound desc = could not find container \"d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e\": container with ID starting with d63311d902273b912261c2767216a75fe256be77d1dbf5b772d7cd6a1adea71e not found: ID does not exist"
Sep 20 02:09:14.795878 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.795854    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"]
Sep 20 02:09:14.799561 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.799540    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4"]
Sep 20 02:09:14.811997 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.811906    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"]
Sep 20 02:09:14.814189 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.814162    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv"]
Sep 20 02:09:14.816443 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.816417    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbzsn\" (UniqueName: \"kubernetes.io/projected/04b72625-7c31-4dc6-90e1-d00e743192af-kube-api-access-fbzsn\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:09:14.816443 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.816442    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04b72625-7c31-4dc6-90e1-d00e743192af-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:09:14.816590 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.816453    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrjb8\" (UniqueName: \"kubernetes.io/projected/aad039a8-9a56-4a5e-919e-87ebb77d66f2-kube-api-access-xrjb8\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:09:14.816590 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:14.816462    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad039a8-9a56-4a5e-919e-87ebb77d66f2-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:09:15.222393 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:15.222314    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04b72625-7c31-4dc6-90e1-d00e743192af" path="/var/lib/kubelet/pods/04b72625-7c31-4dc6-90e1-d00e743192af/volumes"
Sep 20 02:09:15.222665 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:15.222651    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad039a8-9a56-4a5e-919e-87ebb77d66f2" path="/var/lib/kubelet/pods/aad039a8-9a56-4a5e-919e-87ebb77d66f2/volumes"
Sep 20 02:09:15.222972 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:15.222960    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f133c0d6-75d8-4426-8cdf-5a364d83a15a" path="/var/lib/kubelet/pods/f133c0d6-75d8-4426-8cdf-5a364d83a15a/volumes"
Sep 20 02:09:22.715374 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715338    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"]
Sep 20 02:09:22.715777 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715723    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad039a8-9a56-4a5e-919e-87ebb77d66f2" containerName="payload-pre-processing"
Sep 20 02:09:22.715777 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715733    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad039a8-9a56-4a5e-919e-87ebb77d66f2" containerName="payload-pre-processing"
Sep 20 02:09:22.715777 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715743    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b72625-7c31-4dc6-90e1-d00e743192af" containerName="payload-processing"
Sep 20 02:09:22.715777 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715749    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b72625-7c31-4dc6-90e1-d00e743192af" containerName="payload-processing"
Sep 20 02:09:22.715777 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715758    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f133c0d6-75d8-4426-8cdf-5a364d83a15a" containerName="revoke-keys"
Sep 20 02:09:22.715777 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715764    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f133c0d6-75d8-4426-8cdf-5a364d83a15a" containerName="revoke-keys"
Sep 20 02:09:22.716006 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715837    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad039a8-9a56-4a5e-919e-87ebb77d66f2" containerName="payload-pre-processing"
Sep 20 02:09:22.716006 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715846    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="04b72625-7c31-4dc6-90e1-d00e743192af" containerName="payload-processing"
Sep 20 02:09:22.716006 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.715852    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f133c0d6-75d8-4426-8cdf-5a364d83a15a" containerName="revoke-keys"
Sep 20 02:09:22.720478 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.720460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:22.722588 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.722569    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-066f62f9\""
Sep 20 02:09:22.729857 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.729834    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"]
Sep 20 02:09:22.740879 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.740849    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"]
Sep 20 02:09:22.745189 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.745170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:22.747389 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.747365    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-066f62f9-dockercfg-fl2l2\""
Sep 20 02:09:22.754277 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.754255    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"]
Sep 20 02:09:22.788168 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.788142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc79z\" (UniqueName: \"kubernetes.io/projected/ca73db06-d6bd-453c-8ec7-f071de2c9392-kube-api-access-bc79z\") pod \"payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9\" (UID: \"ca73db06-d6bd-453c-8ec7-f071de2c9392\") " pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:22.788290 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.788197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdd8g\" (UniqueName: \"kubernetes.io/projected/05835df4-eaf8-4f63-a509-bac53bc64f1a-kube-api-access-xdd8g\") pod \"payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr\" (UID: \"05835df4-eaf8-4f63-a509-bac53bc64f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:22.788290 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.788244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca73db06-d6bd-453c-8ec7-f071de2c9392-plugins-config-volume\") pod \"payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9\" (UID: \"ca73db06-d6bd-453c-8ec7-f071de2c9392\") " pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:22.788365 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.788315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05835df4-eaf8-4f63-a509-bac53bc64f1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr\" (UID: \"05835df4-eaf8-4f63-a509-bac53bc64f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:22.889209 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.889172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc79z\" (UniqueName: \"kubernetes.io/projected/ca73db06-d6bd-453c-8ec7-f071de2c9392-kube-api-access-bc79z\") pod \"payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9\" (UID: \"ca73db06-d6bd-453c-8ec7-f071de2c9392\") " pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:22.889403 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.889233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdd8g\" (UniqueName: \"kubernetes.io/projected/05835df4-eaf8-4f63-a509-bac53bc64f1a-kube-api-access-xdd8g\") pod \"payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr\" (UID: \"05835df4-eaf8-4f63-a509-bac53bc64f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:22.889403 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.889254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca73db06-d6bd-453c-8ec7-f071de2c9392-plugins-config-volume\") pod \"payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9\" (UID: \"ca73db06-d6bd-453c-8ec7-f071de2c9392\") " pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:22.889403 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.889287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05835df4-eaf8-4f63-a509-bac53bc64f1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr\" (UID: \"05835df4-eaf8-4f63-a509-bac53bc64f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:22.890047 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.890020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca73db06-d6bd-453c-8ec7-f071de2c9392-plugins-config-volume\") pod \"payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9\" (UID: \"ca73db06-d6bd-453c-8ec7-f071de2c9392\") " pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:22.890047 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.890038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05835df4-eaf8-4f63-a509-bac53bc64f1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr\" (UID: \"05835df4-eaf8-4f63-a509-bac53bc64f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:22.897039 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.897014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc79z\" (UniqueName: \"kubernetes.io/projected/ca73db06-d6bd-453c-8ec7-f071de2c9392-kube-api-access-bc79z\") pod \"payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9\" (UID: \"ca73db06-d6bd-453c-8ec7-f071de2c9392\") " pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:22.897132 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:22.897021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdd8g\" (UniqueName: \"kubernetes.io/projected/05835df4-eaf8-4f63-a509-bac53bc64f1a-kube-api-access-xdd8g\") pod \"payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr\" (UID: \"05835df4-eaf8-4f63-a509-bac53bc64f1a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:23.031702 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.031673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:23.055938 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.055912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:23.304388 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.304362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"]
Sep 20 02:09:23.306869 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:09:23.306841    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05835df4_eaf8_4f63_a509_bac53bc64f1a.slice/crio-08d4a6af69f15cd1dc12c3b5c07b9b13e46bfcda45a854855e172552bfd22392 WatchSource:0}: Error finding container 08d4a6af69f15cd1dc12c3b5c07b9b13e46bfcda45a854855e172552bfd22392: Status 404 returned error can't find the container with id 08d4a6af69f15cd1dc12c3b5c07b9b13e46bfcda45a854855e172552bfd22392
Sep 20 02:09:23.335908 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.335884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"]
Sep 20 02:09:23.338247 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:09:23.338221    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca73db06_d6bd_453c_8ec7_f071de2c9392.slice/crio-6b8b4a20743649d277c84d8bfee054fdf1702ca90ff8fb5c9b9b3582cfcd7f6d WatchSource:0}: Error finding container 6b8b4a20743649d277c84d8bfee054fdf1702ca90ff8fb5c9b9b3582cfcd7f6d: Status 404 returned error can't find the container with id 6b8b4a20743649d277c84d8bfee054fdf1702ca90ff8fb5c9b9b3582cfcd7f6d
Sep 20 02:09:23.811775 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.811739    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr" event={"ID":"05835df4-eaf8-4f63-a509-bac53bc64f1a","Type":"ContainerStarted","Data":"854d922ba91d4511f3f52f4dcdeeeda0bc7249b41e08d344995f7a5dd788ac56"}
Sep 20 02:09:23.812252 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.811811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr" event={"ID":"05835df4-eaf8-4f63-a509-bac53bc64f1a","Type":"ContainerStarted","Data":"08d4a6af69f15cd1dc12c3b5c07b9b13e46bfcda45a854855e172552bfd22392"}
Sep 20 02:09:23.812252 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.811953    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:23.813408 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.813384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9" event={"ID":"ca73db06-d6bd-453c-8ec7-f071de2c9392","Type":"ContainerStarted","Data":"1049d195b9b1e68f5130c1d27c75a9e965d32e0fef0a1356398c78cda4ff938d"}
Sep 20 02:09:23.813520 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.813434    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:23.813520 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.813456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9" event={"ID":"ca73db06-d6bd-453c-8ec7-f071de2c9392","Type":"ContainerStarted","Data":"6b8b4a20743649d277c84d8bfee054fdf1702ca90ff8fb5c9b9b3582cfcd7f6d"}
Sep 20 02:09:23.828290 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.828237    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr" podStartSLOduration=1.828218245 podStartE2EDuration="1.828218245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:09:23.827204161 +0000 UTC m=+1009.112216108" watchObservedRunningTime="2026-09-20 02:09:23.828218245 +0000 UTC m=+1009.113230181"
Sep 20 02:09:23.842553 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:23.842508    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9" podStartSLOduration=1.8424932809999999 podStartE2EDuration="1.842493281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:09:23.841320806 +0000 UTC m=+1009.126332741" watchObservedRunningTime="2026-09-20 02:09:23.842493281 +0000 UTC m=+1009.127505233"
Sep 20 02:09:34.820835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:34.820800    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:09:34.821239 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:34.820881    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:09:48.877971 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:48.874917    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"]
Sep 20 02:09:48.881446 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:48.881414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"
Sep 20 02:09:48.883860 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:48.883831    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:09:48.884000 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:48.883832    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:09:48.885475 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:48.885451    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"]
Sep 20 02:09:49.049197 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:49.049144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8675bf69-f3ab-4974-8097-5d4d62625f7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-066f62f9-wxfht\" (UID: \"8675bf69-f3ab-4974-8097-5d4d62625f7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"
Sep 20 02:09:49.150778 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:49.150687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8675bf69-f3ab-4974-8097-5d4d62625f7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-066f62f9-wxfht\" (UID: \"8675bf69-f3ab-4974-8097-5d4d62625f7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"
Sep 20 02:09:49.151329 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:49.151310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8675bf69-f3ab-4974-8097-5d4d62625f7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-066f62f9-wxfht\" (UID: \"8675bf69-f3ab-4974-8097-5d4d62625f7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"
Sep 20 02:09:49.194064 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:49.194034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"
Sep 20 02:09:49.468557 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:49.467893    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"]
Sep 20 02:09:49.470894 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:09:49.470864    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8675bf69_f3ab_4974_8097_5d4d62625f7a.slice/crio-18486e3a514ef100e1b066f014c0a1c8314c3a26d7ed74dab0bf38cf249030c8 WatchSource:0}: Error finding container 18486e3a514ef100e1b066f014c0a1c8314c3a26d7ed74dab0bf38cf249030c8: Status 404 returned error can't find the container with id 18486e3a514ef100e1b066f014c0a1c8314c3a26d7ed74dab0bf38cf249030c8
Sep 20 02:09:49.952272 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:49.952235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht" event={"ID":"8675bf69-f3ab-4974-8097-5d4d62625f7a","Type":"ContainerStarted","Data":"2f608529e339012be0354a18c90b373670e218701b7948fe4b6ee6576bc18a3c"}
Sep 20 02:09:49.952680 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:49.952293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht" event={"ID":"8675bf69-f3ab-4974-8097-5d4d62625f7a","Type":"ContainerStarted","Data":"18486e3a514ef100e1b066f014c0a1c8314c3a26d7ed74dab0bf38cf249030c8"}
Sep 20 02:09:49.967424 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:49.967376    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht" podStartSLOduration=1.967360013 podStartE2EDuration="1.967360013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:09:49.966430249 +0000 UTC m=+1035.251442185" watchObservedRunningTime="2026-09-20 02:09:49.967360013 +0000 UTC m=+1035.252371948"
Sep 20 02:09:50.958882 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:50.958848    2565 generic.go:356] "Generic (PLEG): container finished" podID="8675bf69-f3ab-4974-8097-5d4d62625f7a" containerID="2f608529e339012be0354a18c90b373670e218701b7948fe4b6ee6576bc18a3c" exitCode=0
Sep 20 02:09:50.959278 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:50.958932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht" event={"ID":"8675bf69-f3ab-4974-8097-5d4d62625f7a","Type":"ContainerDied","Data":"2f608529e339012be0354a18c90b373670e218701b7948fe4b6ee6576bc18a3c"}
Sep 20 02:09:52.095395 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:52.095372    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"
Sep 20 02:09:52.281601 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:52.281559    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8675bf69-f3ab-4974-8097-5d4d62625f7a-maas-api-service-ca\") pod \"8675bf69-f3ab-4974-8097-5d4d62625f7a\" (UID: \"8675bf69-f3ab-4974-8097-5d4d62625f7a\") "
Sep 20 02:09:52.281988 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:52.281963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8675bf69-f3ab-4974-8097-5d4d62625f7a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8675bf69-f3ab-4974-8097-5d4d62625f7a" (UID: "8675bf69-f3ab-4974-8097-5d4d62625f7a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:09:52.383232 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:52.383195    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8675bf69-f3ab-4974-8097-5d4d62625f7a-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:09:52.970130 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:52.970105    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"
Sep 20 02:09:52.970332 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:52.970135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht" event={"ID":"8675bf69-f3ab-4974-8097-5d4d62625f7a","Type":"ContainerDied","Data":"18486e3a514ef100e1b066f014c0a1c8314c3a26d7ed74dab0bf38cf249030c8"}
Sep 20 02:09:52.970332 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:52.970184    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18486e3a514ef100e1b066f014c0a1c8314c3a26d7ed74dab0bf38cf249030c8"
Sep 20 02:09:55.273624 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.273589    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"]
Sep 20 02:09:55.274052 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.274037    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8675bf69-f3ab-4974-8097-5d4d62625f7a" containerName="revoke-keys"
Sep 20 02:09:55.274100 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.274053    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8675bf69-f3ab-4974-8097-5d4d62625f7a" containerName="revoke-keys"
Sep 20 02:09:55.274134 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.274122    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8675bf69-f3ab-4974-8097-5d4d62625f7a" containerName="revoke-keys"
Sep 20 02:09:55.277461 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.277445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:09:55.279543 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.279515    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-725649\""
Sep 20 02:09:55.279543 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.279516    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-725649-dockercfg-kh94q\""
Sep 20 02:09:55.286813 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.286765    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"]
Sep 20 02:09:55.298773 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.298749    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"]
Sep 20 02:09:55.302231 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.302213    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:09:55.312655 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.312633    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"]
Sep 20 02:09:55.412226 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.412191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm\" (UID: \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\") " pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:09:55.412399 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.412277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn\" (UID: \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:09:55.412463 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.412428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spmd9\" (UniqueName: \"kubernetes.io/projected/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-kube-api-access-spmd9\") pod \"payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm\" (UID: \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\") " pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:09:55.412521 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.412483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85qxj\" (UniqueName: \"kubernetes.io/projected/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-kube-api-access-85qxj\") pod \"payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn\" (UID: \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:09:55.513181 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.513138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm\" (UID: \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\") " pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:09:55.513380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.513229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn\" (UID: \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:09:55.513380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.513328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spmd9\" (UniqueName: \"kubernetes.io/projected/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-kube-api-access-spmd9\") pod \"payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm\" (UID: \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\") " pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:09:55.513380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.513373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85qxj\" (UniqueName: \"kubernetes.io/projected/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-kube-api-access-85qxj\") pod \"payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn\" (UID: \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:09:55.513893 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.513873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm\" (UID: \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\") " pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:09:55.514006 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.513986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn\" (UID: \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:09:55.521641 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.521612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85qxj\" (UniqueName: \"kubernetes.io/projected/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-kube-api-access-85qxj\") pod \"payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn\" (UID: \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:09:55.521855 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.521835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spmd9\" (UniqueName: \"kubernetes.io/projected/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-kube-api-access-spmd9\") pod \"payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm\" (UID: \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\") " pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:09:55.588819 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.588729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:09:55.613740 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.613699    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:09:55.868010 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.867917    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"]
Sep 20 02:09:55.870871 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:09:55.870835    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d09a34_7283_48b1_af7d_3f8b23cfeb3a.slice/crio-7986c6807845fa47f104519b583802c42831fb25a5a4a7f7012966a8d0a4cd91 WatchSource:0}: Error finding container 7986c6807845fa47f104519b583802c42831fb25a5a4a7f7012966a8d0a4cd91: Status 404 returned error can't find the container with id 7986c6807845fa47f104519b583802c42831fb25a5a4a7f7012966a8d0a4cd91
Sep 20 02:09:55.908374 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.908332    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"]
Sep 20 02:09:55.910177 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:09:55.910147    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c5d45d_6fa1_49f8_9c8b_09e0cd6c6978.slice/crio-eb0c89e2a2220f30d848a994f545ab59d570712341810c6ce1698fa5bc5e67f9 WatchSource:0}: Error finding container eb0c89e2a2220f30d848a994f545ab59d570712341810c6ce1698fa5bc5e67f9: Status 404 returned error can't find the container with id eb0c89e2a2220f30d848a994f545ab59d570712341810c6ce1698fa5bc5e67f9
Sep 20 02:09:55.987083 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.987032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm" event={"ID":"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a","Type":"ContainerStarted","Data":"13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b"}
Sep 20 02:09:55.987272 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.987111    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:09:55.987272 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.987137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm" event={"ID":"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a","Type":"ContainerStarted","Data":"7986c6807845fa47f104519b583802c42831fb25a5a4a7f7012966a8d0a4cd91"}
Sep 20 02:09:55.988909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.988881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn" event={"ID":"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978","Type":"ContainerStarted","Data":"4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04"}
Sep 20 02:09:55.989054 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.988931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn" event={"ID":"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978","Type":"ContainerStarted","Data":"eb0c89e2a2220f30d848a994f545ab59d570712341810c6ce1698fa5bc5e67f9"}
Sep 20 02:09:55.989054 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:55.988979    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:09:56.004655 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:56.004596    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm" podStartSLOduration=1.004574318 podStartE2EDuration="1.004574318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:09:56.00255429 +0000 UTC m=+1041.287566226" watchObservedRunningTime="2026-09-20 02:09:56.004574318 +0000 UTC m=+1041.289586255"
Sep 20 02:09:56.018273 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:09:56.018223    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn" podStartSLOduration=1.018203487 podStartE2EDuration="1.018203487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:09:56.016468061 +0000 UTC m=+1041.301480007" watchObservedRunningTime="2026-09-20 02:09:56.018203487 +0000 UTC m=+1041.303215424"
Sep 20 02:10:00.836979 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:00.836937    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"]
Sep 20 02:10:00.837450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:00.837213    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9" podUID="ca73db06-d6bd-453c-8ec7-f071de2c9392" containerName="payload-processing" containerID="cri-o://1049d195b9b1e68f5130c1d27c75a9e965d32e0fef0a1356398c78cda4ff938d" gracePeriod=30
Sep 20 02:10:00.845089 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:00.845063    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"]
Sep 20 02:10:00.845292 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:00.845269    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr" podUID="05835df4-eaf8-4f63-a509-bac53bc64f1a" containerName="payload-pre-processing" containerID="cri-o://854d922ba91d4511f3f52f4dcdeeeda0bc7249b41e08d344995f7a5dd788ac56" gracePeriod=30
Sep 20 02:10:00.993512 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:00.993473    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"]
Sep 20 02:10:00.995528 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:00.995498    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-066f62f9-wxfht"]
Sep 20 02:10:01.021326 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.021299    2565 generic.go:356] "Generic (PLEG): container finished" podID="05835df4-eaf8-4f63-a509-bac53bc64f1a" containerID="854d922ba91d4511f3f52f4dcdeeeda0bc7249b41e08d344995f7a5dd788ac56" exitCode=0
Sep 20 02:10:01.021442 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.021369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr" event={"ID":"05835df4-eaf8-4f63-a509-bac53bc64f1a","Type":"ContainerDied","Data":"854d922ba91d4511f3f52f4dcdeeeda0bc7249b41e08d344995f7a5dd788ac56"}
Sep 20 02:10:01.023202 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.023177    2565 generic.go:356] "Generic (PLEG): container finished" podID="ca73db06-d6bd-453c-8ec7-f071de2c9392" containerID="1049d195b9b1e68f5130c1d27c75a9e965d32e0fef0a1356398c78cda4ff938d" exitCode=0
Sep 20 02:10:01.023304 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.023245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9" event={"ID":"ca73db06-d6bd-453c-8ec7-f071de2c9392","Type":"ContainerDied","Data":"1049d195b9b1e68f5130c1d27c75a9e965d32e0fef0a1356398c78cda4ff938d"}
Sep 20 02:10:01.094920 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.094855    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:10:01.137025 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.136913    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:10:01.160242 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.160213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05835df4-eaf8-4f63-a509-bac53bc64f1a-plugins-config-volume\") pod \"05835df4-eaf8-4f63-a509-bac53bc64f1a\" (UID: \"05835df4-eaf8-4f63-a509-bac53bc64f1a\") "
Sep 20 02:10:01.160412 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.160393    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca73db06-d6bd-453c-8ec7-f071de2c9392-plugins-config-volume\") pod \"ca73db06-d6bd-453c-8ec7-f071de2c9392\" (UID: \"ca73db06-d6bd-453c-8ec7-f071de2c9392\") "
Sep 20 02:10:01.160467 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.160442    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdd8g\" (UniqueName: \"kubernetes.io/projected/05835df4-eaf8-4f63-a509-bac53bc64f1a-kube-api-access-xdd8g\") pod \"05835df4-eaf8-4f63-a509-bac53bc64f1a\" (UID: \"05835df4-eaf8-4f63-a509-bac53bc64f1a\") "
Sep 20 02:10:01.160561 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.160543    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc79z\" (UniqueName: \"kubernetes.io/projected/ca73db06-d6bd-453c-8ec7-f071de2c9392-kube-api-access-bc79z\") pod \"ca73db06-d6bd-453c-8ec7-f071de2c9392\" (UID: \"ca73db06-d6bd-453c-8ec7-f071de2c9392\") "
Sep 20 02:10:01.160624 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.160606    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05835df4-eaf8-4f63-a509-bac53bc64f1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05835df4-eaf8-4f63-a509-bac53bc64f1a" (UID: "05835df4-eaf8-4f63-a509-bac53bc64f1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:10:01.160866 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.160818    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca73db06-d6bd-453c-8ec7-f071de2c9392-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca73db06-d6bd-453c-8ec7-f071de2c9392" (UID: "ca73db06-d6bd-453c-8ec7-f071de2c9392"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:10:01.160970 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.160938    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca73db06-d6bd-453c-8ec7-f071de2c9392-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:10:01.160970 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.160959    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05835df4-eaf8-4f63-a509-bac53bc64f1a-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:10:01.162735 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.162703    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca73db06-d6bd-453c-8ec7-f071de2c9392-kube-api-access-bc79z" (OuterVolumeSpecName: "kube-api-access-bc79z") pod "ca73db06-d6bd-453c-8ec7-f071de2c9392" (UID: "ca73db06-d6bd-453c-8ec7-f071de2c9392"). InnerVolumeSpecName "kube-api-access-bc79z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:10:01.162968 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.162946    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05835df4-eaf8-4f63-a509-bac53bc64f1a-kube-api-access-xdd8g" (OuterVolumeSpecName: "kube-api-access-xdd8g") pod "05835df4-eaf8-4f63-a509-bac53bc64f1a" (UID: "05835df4-eaf8-4f63-a509-bac53bc64f1a"). InnerVolumeSpecName "kube-api-access-xdd8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:10:01.221439 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.221403    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8675bf69-f3ab-4974-8097-5d4d62625f7a" path="/var/lib/kubelet/pods/8675bf69-f3ab-4974-8097-5d4d62625f7a/volumes"
Sep 20 02:10:01.261858 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.261817    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdd8g\" (UniqueName: \"kubernetes.io/projected/05835df4-eaf8-4f63-a509-bac53bc64f1a-kube-api-access-xdd8g\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:10:01.261858 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:01.261858    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc79z\" (UniqueName: \"kubernetes.io/projected/ca73db06-d6bd-453c-8ec7-f071de2c9392-kube-api-access-bc79z\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:10:02.030131 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.030098    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"
Sep 20 02:10:02.030598 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.030133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr" event={"ID":"05835df4-eaf8-4f63-a509-bac53bc64f1a","Type":"ContainerDied","Data":"08d4a6af69f15cd1dc12c3b5c07b9b13e46bfcda45a854855e172552bfd22392"}
Sep 20 02:10:02.030598 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.030210    2565 scope.go:117] "RemoveContainer" containerID="854d922ba91d4511f3f52f4dcdeeeda0bc7249b41e08d344995f7a5dd788ac56"
Sep 20 02:10:02.031687 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.031665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9" event={"ID":"ca73db06-d6bd-453c-8ec7-f071de2c9392","Type":"ContainerDied","Data":"6b8b4a20743649d277c84d8bfee054fdf1702ca90ff8fb5c9b9b3582cfcd7f6d"}
Sep 20 02:10:02.031805 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.031669    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"
Sep 20 02:10:02.039470 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.039445    2565 scope.go:117] "RemoveContainer" containerID="1049d195b9b1e68f5130c1d27c75a9e965d32e0fef0a1356398c78cda4ff938d"
Sep 20 02:10:02.053386 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.053359    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"]
Sep 20 02:10:02.062824 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.062782    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr"]
Sep 20 02:10:02.073414 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.073385    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"]
Sep 20 02:10:02.075328 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:02.075304    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9"]
Sep 20 02:10:03.220765 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:03.220727    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05835df4-eaf8-4f63-a509-bac53bc64f1a" path="/var/lib/kubelet/pods/05835df4-eaf8-4f63-a509-bac53bc64f1a/volumes"
Sep 20 02:10:03.221138 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:03.221126    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca73db06-d6bd-453c-8ec7-f071de2c9392" path="/var/lib/kubelet/pods/ca73db06-d6bd-453c-8ec7-f071de2c9392/volumes"
Sep 20 02:10:06.996144 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:06.996115    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:10:06.996649 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:10:06.996191    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:11:11.758342 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.758301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"]
Sep 20 02:11:11.758941 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.758913    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca73db06-d6bd-453c-8ec7-f071de2c9392" containerName="payload-processing"
Sep 20 02:11:11.758941 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.758933    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca73db06-d6bd-453c-8ec7-f071de2c9392" containerName="payload-processing"
Sep 20 02:11:11.759079 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.758974    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05835df4-eaf8-4f63-a509-bac53bc64f1a" containerName="payload-pre-processing"
Sep 20 02:11:11.759079 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.758984    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="05835df4-eaf8-4f63-a509-bac53bc64f1a" containerName="payload-pre-processing"
Sep 20 02:11:11.759178 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.759083    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca73db06-d6bd-453c-8ec7-f071de2c9392" containerName="payload-processing"
Sep 20 02:11:11.759178 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.759104    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="05835df4-eaf8-4f63-a509-bac53bc64f1a" containerName="payload-pre-processing"
Sep 20 02:11:11.762265 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.762243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"
Sep 20 02:11:11.764468 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.764449    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:11:11.764705 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.764690    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:11:11.768664 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.768639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"]
Sep 20 02:11:11.860629 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.860598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcbfae3-1443-47cd-98dc-6f84fa66ed15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-725649-77t4c\" (UID: \"0fcbfae3-1443-47cd-98dc-6f84fa66ed15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"
Sep 20 02:11:11.961973 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.961933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcbfae3-1443-47cd-98dc-6f84fa66ed15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-725649-77t4c\" (UID: \"0fcbfae3-1443-47cd-98dc-6f84fa66ed15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"
Sep 20 02:11:11.962578 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:11.962556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcbfae3-1443-47cd-98dc-6f84fa66ed15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-725649-77t4c\" (UID: \"0fcbfae3-1443-47cd-98dc-6f84fa66ed15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"
Sep 20 02:11:12.075210 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:12.075128    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"
Sep 20 02:11:12.359553 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:12.359479    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"]
Sep 20 02:11:12.362901 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:11:12.362876    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcbfae3_1443_47cd_98dc_6f84fa66ed15.slice/crio-3c8de61d344b4d6b2e44adfc3ca217834bb95f41bc91491d9b2338051c9fbc26 WatchSource:0}: Error finding container 3c8de61d344b4d6b2e44adfc3ca217834bb95f41bc91491d9b2338051c9fbc26: Status 404 returned error can't find the container with id 3c8de61d344b4d6b2e44adfc3ca217834bb95f41bc91491d9b2338051c9fbc26
Sep 20 02:11:12.389738 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:12.389701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c" event={"ID":"0fcbfae3-1443-47cd-98dc-6f84fa66ed15","Type":"ContainerStarted","Data":"3c8de61d344b4d6b2e44adfc3ca217834bb95f41bc91491d9b2338051c9fbc26"}
Sep 20 02:11:13.396287 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:13.396204    2565 generic.go:356] "Generic (PLEG): container finished" podID="0fcbfae3-1443-47cd-98dc-6f84fa66ed15" containerID="a558a9c6c5105f2c7dd278da12a7f664b99ea85af5b1c0a96adcb1736ca051e2" exitCode=0
Sep 20 02:11:13.396647 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:13.396298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c" event={"ID":"0fcbfae3-1443-47cd-98dc-6f84fa66ed15","Type":"ContainerDied","Data":"a558a9c6c5105f2c7dd278da12a7f664b99ea85af5b1c0a96adcb1736ca051e2"}
Sep 20 02:11:14.536020 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:14.535992    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"
Sep 20 02:11:14.584300 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:14.584260    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcbfae3-1443-47cd-98dc-6f84fa66ed15-maas-api-service-ca\") pod \"0fcbfae3-1443-47cd-98dc-6f84fa66ed15\" (UID: \"0fcbfae3-1443-47cd-98dc-6f84fa66ed15\") "
Sep 20 02:11:14.584605 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:14.584576    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fcbfae3-1443-47cd-98dc-6f84fa66ed15-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0fcbfae3-1443-47cd-98dc-6f84fa66ed15" (UID: "0fcbfae3-1443-47cd-98dc-6f84fa66ed15"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:11:14.685623 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:14.685544    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcbfae3-1443-47cd-98dc-6f84fa66ed15-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:11:15.408156 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:15.408120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c" event={"ID":"0fcbfae3-1443-47cd-98dc-6f84fa66ed15","Type":"ContainerDied","Data":"3c8de61d344b4d6b2e44adfc3ca217834bb95f41bc91491d9b2338051c9fbc26"}
Sep 20 02:11:15.408324 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:15.408196    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c8de61d344b4d6b2e44adfc3ca217834bb95f41bc91491d9b2338051c9fbc26"
Sep 20 02:11:15.408324 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:15.408132    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"
Sep 20 02:11:22.337405 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.337369    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"]
Sep 20 02:11:22.337824 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.337637    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm" podUID="e0d09a34-7283-48b1-af7d-3f8b23cfeb3a" containerName="payload-processing" containerID="cri-o://13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b" gracePeriod=30
Sep 20 02:11:22.343375 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.343348    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"]
Sep 20 02:11:22.343616 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.343560    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn" podUID="83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978" containerName="payload-pre-processing" containerID="cri-o://4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04" gracePeriod=30
Sep 20 02:11:22.565068 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.565032    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"]
Sep 20 02:11:22.568414 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.568384    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-725649-77t4c"]
Sep 20 02:11:22.628769 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.628749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:11:22.631332 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.631314    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:11:22.666103 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.666066    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85qxj\" (UniqueName: \"kubernetes.io/projected/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-kube-api-access-85qxj\") pod \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\" (UID: \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\") "
Sep 20 02:11:22.666280 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.666135    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-plugins-config-volume\") pod \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\" (UID: \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\") "
Sep 20 02:11:22.666280 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.666164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-plugins-config-volume\") pod \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\" (UID: \"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978\") "
Sep 20 02:11:22.666418 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.666314    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spmd9\" (UniqueName: \"kubernetes.io/projected/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-kube-api-access-spmd9\") pod \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\" (UID: \"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a\") "
Sep 20 02:11:22.671199 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.667020    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e0d09a34-7283-48b1-af7d-3f8b23cfeb3a" (UID: "e0d09a34-7283-48b1-af7d-3f8b23cfeb3a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:11:22.673616 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.673579    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978" (UID: "83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:11:22.675157 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.674930    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:11:22.675157 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.674978    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:11:22.677894 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.676196    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-kube-api-access-spmd9" (OuterVolumeSpecName: "kube-api-access-spmd9") pod "e0d09a34-7283-48b1-af7d-3f8b23cfeb3a" (UID: "e0d09a34-7283-48b1-af7d-3f8b23cfeb3a"). InnerVolumeSpecName "kube-api-access-spmd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:11:22.677894 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.677105    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-kube-api-access-85qxj" (OuterVolumeSpecName: "kube-api-access-85qxj") pod "83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978" (UID: "83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978"). InnerVolumeSpecName "kube-api-access-85qxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:11:22.775625 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.775595    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spmd9\" (UniqueName: \"kubernetes.io/projected/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a-kube-api-access-spmd9\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:11:22.775625 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:22.775622    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85qxj\" (UniqueName: \"kubernetes.io/projected/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978-kube-api-access-85qxj\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:11:23.220508 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.220474    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fcbfae3-1443-47cd-98dc-6f84fa66ed15" path="/var/lib/kubelet/pods/0fcbfae3-1443-47cd-98dc-6f84fa66ed15/volumes"
Sep 20 02:11:23.452637 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.452599    2565 generic.go:356] "Generic (PLEG): container finished" podID="e0d09a34-7283-48b1-af7d-3f8b23cfeb3a" containerID="13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b" exitCode=0
Sep 20 02:11:23.452637 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.452640    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"
Sep 20 02:11:23.453131 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.452688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm" event={"ID":"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a","Type":"ContainerDied","Data":"13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b"}
Sep 20 02:11:23.453131 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.452743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm" event={"ID":"e0d09a34-7283-48b1-af7d-3f8b23cfeb3a","Type":"ContainerDied","Data":"7986c6807845fa47f104519b583802c42831fb25a5a4a7f7012966a8d0a4cd91"}
Sep 20 02:11:23.453131 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.452771    2565 scope.go:117] "RemoveContainer" containerID="13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b"
Sep 20 02:11:23.454184 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.454162    2565 generic.go:356] "Generic (PLEG): container finished" podID="83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978" containerID="4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04" exitCode=0
Sep 20 02:11:23.454253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.454199    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"
Sep 20 02:11:23.454253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.454217    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn" event={"ID":"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978","Type":"ContainerDied","Data":"4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04"}
Sep 20 02:11:23.454378 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.454253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn" event={"ID":"83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978","Type":"ContainerDied","Data":"eb0c89e2a2220f30d848a994f545ab59d570712341810c6ce1698fa5bc5e67f9"}
Sep 20 02:11:23.461656 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.461640    2565 scope.go:117] "RemoveContainer" containerID="13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b"
Sep 20 02:11:23.461937 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:11:23.461917    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b\": container with ID starting with 13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b not found: ID does not exist" containerID="13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b"
Sep 20 02:11:23.462037 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.461955    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b"} err="failed to get container status \"13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b\": rpc error: code = NotFound desc = could not find container \"13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b\": container with ID starting with 13034175b7240c5365d078f80ebd6bb4ffb20087a4aa3e90baea4bb7e002025b not found: ID does not exist"
Sep 20 02:11:23.462037 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.461978    2565 scope.go:117] "RemoveContainer" containerID="4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04"
Sep 20 02:11:23.469454 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.469434    2565 scope.go:117] "RemoveContainer" containerID="4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04"
Sep 20 02:11:23.469699 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:11:23.469681    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04\": container with ID starting with 4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04 not found: ID does not exist" containerID="4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04"
Sep 20 02:11:23.469750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.469705    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04"} err="failed to get container status \"4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04\": rpc error: code = NotFound desc = could not find container \"4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04\": container with ID starting with 4fbc4df7f50185b509ea41ce7fed766d163645cdbef5880885214d69d8e37d04 not found: ID does not exist"
Sep 20 02:11:23.474508 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.474456    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"]
Sep 20 02:11:23.483417 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.483389    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm"]
Sep 20 02:11:23.494155 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.494130    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"]
Sep 20 02:11:23.500771 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:23.500750    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn"]
Sep 20 02:11:25.220989 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:25.220957    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978" path="/var/lib/kubelet/pods/83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978/volumes"
Sep 20 02:11:25.221353 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:25.221313    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d09a34-7283-48b1-af7d-3f8b23cfeb3a" path="/var/lib/kubelet/pods/e0d09a34-7283-48b1-af7d-3f8b23cfeb3a/volumes"
Sep 20 02:11:48.304689 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.304654    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"]
Sep 20 02:11:48.305303 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.305284    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978" containerName="payload-pre-processing"
Sep 20 02:11:48.305348 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.305307    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978" containerName="payload-pre-processing"
Sep 20 02:11:48.305348 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.305322    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fcbfae3-1443-47cd-98dc-6f84fa66ed15" containerName="revoke-keys"
Sep 20 02:11:48.305348 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.305331    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fcbfae3-1443-47cd-98dc-6f84fa66ed15" containerName="revoke-keys"
Sep 20 02:11:48.305444 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.305347    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d09a34-7283-48b1-af7d-3f8b23cfeb3a" containerName="payload-processing"
Sep 20 02:11:48.305444 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.305356    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d09a34-7283-48b1-af7d-3f8b23cfeb3a" containerName="payload-processing"
Sep 20 02:11:48.305509 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.305471    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="83c5d45d-6fa1-49f8-9c8b-09e0cd6c6978" containerName="payload-pre-processing"
Sep 20 02:11:48.305509 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.305482    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d09a34-7283-48b1-af7d-3f8b23cfeb3a" containerName="payload-processing"
Sep 20 02:11:48.305509 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.305494    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fcbfae3-1443-47cd-98dc-6f84fa66ed15" containerName="revoke-keys"
Sep 20 02:11:48.310216 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.310199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:11:48.312533 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.312513    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-06367b84\""
Sep 20 02:11:48.312533 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.312527    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-06367b84-dockercfg-4qsvq\""
Sep 20 02:11:48.317688 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.317666    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"]
Sep 20 02:11:48.328474 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.328447    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"]
Sep 20 02:11:48.328576 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.328539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2050d2ab-e2dc-40e7-897f-8cac226a5012-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv\" (UID: \"2050d2ab-e2dc-40e7-897f-8cac226a5012\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:11:48.328636 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.328583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz78c\" (UniqueName: \"kubernetes.io/projected/2050d2ab-e2dc-40e7-897f-8cac226a5012-kube-api-access-vz78c\") pod \"payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv\" (UID: \"2050d2ab-e2dc-40e7-897f-8cac226a5012\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:11:48.332781 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.332761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:11:48.351362 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.342484    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"]
Sep 20 02:11:48.430207 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.430165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f22732c7-4ba4-4b12-a446-1adde377a51e-plugins-config-volume\") pod \"payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh\" (UID: \"f22732c7-4ba4-4b12-a446-1adde377a51e\") " pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:11:48.430469 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.430443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2050d2ab-e2dc-40e7-897f-8cac226a5012-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv\" (UID: \"2050d2ab-e2dc-40e7-897f-8cac226a5012\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:11:48.430646 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.430630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz78c\" (UniqueName: \"kubernetes.io/projected/2050d2ab-e2dc-40e7-897f-8cac226a5012-kube-api-access-vz78c\") pod \"payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv\" (UID: \"2050d2ab-e2dc-40e7-897f-8cac226a5012\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:11:48.430828 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.430808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7kcc\" (UniqueName: \"kubernetes.io/projected/f22732c7-4ba4-4b12-a446-1adde377a51e-kube-api-access-x7kcc\") pod \"payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh\" (UID: \"f22732c7-4ba4-4b12-a446-1adde377a51e\") " pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:11:48.431538 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.431507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2050d2ab-e2dc-40e7-897f-8cac226a5012-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv\" (UID: \"2050d2ab-e2dc-40e7-897f-8cac226a5012\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:11:48.440482 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.440450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz78c\" (UniqueName: \"kubernetes.io/projected/2050d2ab-e2dc-40e7-897f-8cac226a5012-kube-api-access-vz78c\") pod \"payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv\" (UID: \"2050d2ab-e2dc-40e7-897f-8cac226a5012\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:11:48.531625 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.531587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f22732c7-4ba4-4b12-a446-1adde377a51e-plugins-config-volume\") pod \"payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh\" (UID: \"f22732c7-4ba4-4b12-a446-1adde377a51e\") " pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:11:48.531844 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.531698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7kcc\" (UniqueName: \"kubernetes.io/projected/f22732c7-4ba4-4b12-a446-1adde377a51e-kube-api-access-x7kcc\") pod \"payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh\" (UID: \"f22732c7-4ba4-4b12-a446-1adde377a51e\") " pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:11:48.532305 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.532283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f22732c7-4ba4-4b12-a446-1adde377a51e-plugins-config-volume\") pod \"payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh\" (UID: \"f22732c7-4ba4-4b12-a446-1adde377a51e\") " pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:11:48.539741 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.539722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7kcc\" (UniqueName: \"kubernetes.io/projected/f22732c7-4ba4-4b12-a446-1adde377a51e-kube-api-access-x7kcc\") pod \"payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh\" (UID: \"f22732c7-4ba4-4b12-a446-1adde377a51e\") " pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:11:48.622302 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.622224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:11:48.644529 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.644501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:11:48.898956 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.898884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"]
Sep 20 02:11:48.902002 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:11:48.901979    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2050d2ab_e2dc_40e7_897f_8cac226a5012.slice/crio-508881c489be864f1b54db375d1513eb5b0611603eb8e40968772a21b14683fa WatchSource:0}: Error finding container 508881c489be864f1b54db375d1513eb5b0611603eb8e40968772a21b14683fa: Status 404 returned error can't find the container with id 508881c489be864f1b54db375d1513eb5b0611603eb8e40968772a21b14683fa
Sep 20 02:11:48.927742 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:48.927707    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"]
Sep 20 02:11:48.936937 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:11:48.936909    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22732c7_4ba4_4b12_a446_1adde377a51e.slice/crio-136c0fa43be76f2526847d3a1971ff8d5120a6e8add2519e736e9f2e11713d61 WatchSource:0}: Error finding container 136c0fa43be76f2526847d3a1971ff8d5120a6e8add2519e736e9f2e11713d61: Status 404 returned error can't find the container with id 136c0fa43be76f2526847d3a1971ff8d5120a6e8add2519e736e9f2e11713d61
Sep 20 02:11:49.596054 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:49.596013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh" event={"ID":"f22732c7-4ba4-4b12-a446-1adde377a51e","Type":"ContainerStarted","Data":"707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697"}
Sep 20 02:11:49.596539 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:49.596080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh" event={"ID":"f22732c7-4ba4-4b12-a446-1adde377a51e","Type":"ContainerStarted","Data":"136c0fa43be76f2526847d3a1971ff8d5120a6e8add2519e736e9f2e11713d61"}
Sep 20 02:11:49.596539 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:49.596142    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:11:49.597809 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:49.597773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv" event={"ID":"2050d2ab-e2dc-40e7-897f-8cac226a5012","Type":"ContainerStarted","Data":"b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2"}
Sep 20 02:11:49.597913 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:49.597827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv" event={"ID":"2050d2ab-e2dc-40e7-897f-8cac226a5012","Type":"ContainerStarted","Data":"508881c489be864f1b54db375d1513eb5b0611603eb8e40968772a21b14683fa"}
Sep 20 02:11:49.597913 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:49.597861    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:11:49.612662 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:49.612623    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh" podStartSLOduration=1.612609145 podStartE2EDuration="1.612609145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:11:49.610404635 +0000 UTC m=+1154.895416571" watchObservedRunningTime="2026-09-20 02:11:49.612609145 +0000 UTC m=+1154.897621132"
Sep 20 02:11:49.625855 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:11:49.625820    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv" podStartSLOduration=1.625808481 podStartE2EDuration="1.625808481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:11:49.624483779 +0000 UTC m=+1154.909495725" watchObservedRunningTime="2026-09-20 02:11:49.625808481 +0000 UTC m=+1154.910820408"
Sep 20 02:12:00.605752 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:00.605673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:12:00.606134 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:00.605849    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:12:21.508322 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:21.508275    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"]
Sep 20 02:12:21.511936 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:21.511915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"
Sep 20 02:12:21.514128 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:21.514107    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:12:21.514208 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:21.514107    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:12:21.518581 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:21.518538    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"]
Sep 20 02:12:21.562279 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:21.562250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-06367b84-nbcqh\" (UID: \"bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"
Sep 20 02:12:21.663283 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:21.663237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-06367b84-nbcqh\" (UID: \"bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"
Sep 20 02:12:21.663898 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:21.663878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-06367b84-nbcqh\" (UID: \"bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"
Sep 20 02:12:21.824276 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:21.824179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"
Sep 20 02:12:22.093171 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:22.093143    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"]
Sep 20 02:12:22.095346 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:12:22.095318    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd49c6ee_54b5_4c37_9ed7_ed1d7de754f8.slice/crio-ebc8cf08c7094038a980ecac3421d8c1951f4186acfca465f05b1417a333059f WatchSource:0}: Error finding container ebc8cf08c7094038a980ecac3421d8c1951f4186acfca465f05b1417a333059f: Status 404 returned error can't find the container with id ebc8cf08c7094038a980ecac3421d8c1951f4186acfca465f05b1417a333059f
Sep 20 02:12:22.769937 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:22.769894    2565 generic.go:356] "Generic (PLEG): container finished" podID="bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8" containerID="920896042d37ca3011aba011115bbd7cf03e16616c267727fdec4101fab3469f" exitCode=0
Sep 20 02:12:22.770313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:22.769986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh" event={"ID":"bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8","Type":"ContainerDied","Data":"920896042d37ca3011aba011115bbd7cf03e16616c267727fdec4101fab3469f"}
Sep 20 02:12:22.770313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:22.770070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh" event={"ID":"bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8","Type":"ContainerStarted","Data":"ebc8cf08c7094038a980ecac3421d8c1951f4186acfca465f05b1417a333059f"}
Sep 20 02:12:23.915395 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:23.915371    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"
Sep 20 02:12:23.985848 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:23.985814    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8-maas-api-service-ca\") pod \"bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8\" (UID: \"bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8\") "
Sep 20 02:12:23.986160 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:23.986140    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8" (UID: "bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:12:24.087381 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:24.087295    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:12:24.781763 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:24.781729    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"
Sep 20 02:12:24.781957 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:24.781735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh" event={"ID":"bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8","Type":"ContainerDied","Data":"ebc8cf08c7094038a980ecac3421d8c1951f4186acfca465f05b1417a333059f"}
Sep 20 02:12:24.781957 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:24.781850    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebc8cf08c7094038a980ecac3421d8c1951f4186acfca465f05b1417a333059f"
Sep 20 02:12:32.245885 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.245851    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"]
Sep 20 02:12:32.246358 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.246076    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh" podUID="f22732c7-4ba4-4b12-a446-1adde377a51e" containerName="payload-processing" containerID="cri-o://707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697" gracePeriod=30
Sep 20 02:12:32.250424 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.250396    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"]
Sep 20 02:12:32.250870 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.250820    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv" podUID="2050d2ab-e2dc-40e7-897f-8cac226a5012" containerName="payload-pre-processing" containerID="cri-o://b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2" gracePeriod=30
Sep 20 02:12:32.397897 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.397838    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"]
Sep 20 02:12:32.400133 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.400102    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06367b84-nbcqh"]
Sep 20 02:12:32.529538 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.529513    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:12:32.547138 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.547110    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:12:32.576838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.566261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f22732c7-4ba4-4b12-a446-1adde377a51e-plugins-config-volume\") pod \"f22732c7-4ba4-4b12-a446-1adde377a51e\" (UID: \"f22732c7-4ba4-4b12-a446-1adde377a51e\") "
Sep 20 02:12:32.576838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.566425    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7kcc\" (UniqueName: \"kubernetes.io/projected/f22732c7-4ba4-4b12-a446-1adde377a51e-kube-api-access-x7kcc\") pod \"f22732c7-4ba4-4b12-a446-1adde377a51e\" (UID: \"f22732c7-4ba4-4b12-a446-1adde377a51e\") "
Sep 20 02:12:32.576838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.567384    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f22732c7-4ba4-4b12-a446-1adde377a51e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f22732c7-4ba4-4b12-a446-1adde377a51e" (UID: "f22732c7-4ba4-4b12-a446-1adde377a51e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:12:32.580813 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.578968    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f22732c7-4ba4-4b12-a446-1adde377a51e-kube-api-access-x7kcc" (OuterVolumeSpecName: "kube-api-access-x7kcc") pod "f22732c7-4ba4-4b12-a446-1adde377a51e" (UID: "f22732c7-4ba4-4b12-a446-1adde377a51e"). InnerVolumeSpecName "kube-api-access-x7kcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:12:32.667767 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.667732    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2050d2ab-e2dc-40e7-897f-8cac226a5012-plugins-config-volume\") pod \"2050d2ab-e2dc-40e7-897f-8cac226a5012\" (UID: \"2050d2ab-e2dc-40e7-897f-8cac226a5012\") "
Sep 20 02:12:32.667955 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.667846    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz78c\" (UniqueName: \"kubernetes.io/projected/2050d2ab-e2dc-40e7-897f-8cac226a5012-kube-api-access-vz78c\") pod \"2050d2ab-e2dc-40e7-897f-8cac226a5012\" (UID: \"2050d2ab-e2dc-40e7-897f-8cac226a5012\") "
Sep 20 02:12:32.668064 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.668051    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7kcc\" (UniqueName: \"kubernetes.io/projected/f22732c7-4ba4-4b12-a446-1adde377a51e-kube-api-access-x7kcc\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:12:32.668104 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.668066    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f22732c7-4ba4-4b12-a446-1adde377a51e-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:12:32.668139 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.668093    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2050d2ab-e2dc-40e7-897f-8cac226a5012-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2050d2ab-e2dc-40e7-897f-8cac226a5012" (UID: "2050d2ab-e2dc-40e7-897f-8cac226a5012"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:12:32.669797 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.669769    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2050d2ab-e2dc-40e7-897f-8cac226a5012-kube-api-access-vz78c" (OuterVolumeSpecName: "kube-api-access-vz78c") pod "2050d2ab-e2dc-40e7-897f-8cac226a5012" (UID: "2050d2ab-e2dc-40e7-897f-8cac226a5012"). InnerVolumeSpecName "kube-api-access-vz78c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:12:32.768979 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.768900    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2050d2ab-e2dc-40e7-897f-8cac226a5012-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:12:32.768979 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.768927    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz78c\" (UniqueName: \"kubernetes.io/projected/2050d2ab-e2dc-40e7-897f-8cac226a5012-kube-api-access-vz78c\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:12:32.825876 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.825842    2565 generic.go:356] "Generic (PLEG): container finished" podID="f22732c7-4ba4-4b12-a446-1adde377a51e" containerID="707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697" exitCode=0
Sep 20 02:12:32.826092 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.825888    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"
Sep 20 02:12:32.826092 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.825933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh" event={"ID":"f22732c7-4ba4-4b12-a446-1adde377a51e","Type":"ContainerDied","Data":"707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697"}
Sep 20 02:12:32.826092 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.825996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh" event={"ID":"f22732c7-4ba4-4b12-a446-1adde377a51e","Type":"ContainerDied","Data":"136c0fa43be76f2526847d3a1971ff8d5120a6e8add2519e736e9f2e11713d61"}
Sep 20 02:12:32.826092 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.826025    2565 scope.go:117] "RemoveContainer" containerID="707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697"
Sep 20 02:12:32.827406 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.827387    2565 generic.go:356] "Generic (PLEG): container finished" podID="2050d2ab-e2dc-40e7-897f-8cac226a5012" containerID="b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2" exitCode=0
Sep 20 02:12:32.827492 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.827424    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"
Sep 20 02:12:32.827492 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.827422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv" event={"ID":"2050d2ab-e2dc-40e7-897f-8cac226a5012","Type":"ContainerDied","Data":"b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2"}
Sep 20 02:12:32.827492 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.827474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv" event={"ID":"2050d2ab-e2dc-40e7-897f-8cac226a5012","Type":"ContainerDied","Data":"508881c489be864f1b54db375d1513eb5b0611603eb8e40968772a21b14683fa"}
Sep 20 02:12:32.838047 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.838005    2565 scope.go:117] "RemoveContainer" containerID="707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697"
Sep 20 02:12:32.838375 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:12:32.838348    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697\": container with ID starting with 707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697 not found: ID does not exist" containerID="707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697"
Sep 20 02:12:32.838435 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.838385    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697"} err="failed to get container status \"707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697\": rpc error: code = NotFound desc = could not find container \"707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697\": container with ID starting with 707e07a58f361069a15536e8a9fde0da375f278a6fe55c19892dd014c16e3697 not found: ID does not exist"
Sep 20 02:12:32.838435 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.838407    2565 scope.go:117] "RemoveContainer" containerID="b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2"
Sep 20 02:12:32.847576 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.847556    2565 scope.go:117] "RemoveContainer" containerID="b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2"
Sep 20 02:12:32.847913 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:12:32.847892    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2\": container with ID starting with b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2 not found: ID does not exist" containerID="b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2"
Sep 20 02:12:32.847961 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.847923    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2"} err="failed to get container status \"b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2\": rpc error: code = NotFound desc = could not find container \"b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2\": container with ID starting with b7823538e074d8520689475e032a2dd3cc54f9456329483c758e602b63bb59e2 not found: ID does not exist"
Sep 20 02:12:32.857293 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.857256    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"]
Sep 20 02:12:32.861110 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.861090    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh"]
Sep 20 02:12:32.871261 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.871234    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"]
Sep 20 02:12:32.874544 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:32.874519    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv"]
Sep 20 02:12:33.220994 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:33.220918    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2050d2ab-e2dc-40e7-897f-8cac226a5012" path="/var/lib/kubelet/pods/2050d2ab-e2dc-40e7-897f-8cac226a5012/volumes"
Sep 20 02:12:33.221246 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:33.221233    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8" path="/var/lib/kubelet/pods/bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8/volumes"
Sep 20 02:12:33.221546 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:33.221534    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f22732c7-4ba4-4b12-a446-1adde377a51e" path="/var/lib/kubelet/pods/f22732c7-4ba4-4b12-a446-1adde377a51e/volumes"
Sep 20 02:12:58.734053 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734017    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"]
Sep 20 02:12:58.734657 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734607    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f22732c7-4ba4-4b12-a446-1adde377a51e" containerName="payload-processing"
Sep 20 02:12:58.734657 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734628    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f22732c7-4ba4-4b12-a446-1adde377a51e" containerName="payload-processing"
Sep 20 02:12:58.734657 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734645    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8" containerName="revoke-keys"
Sep 20 02:12:58.734657 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734654    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8" containerName="revoke-keys"
Sep 20 02:12:58.734910 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734674    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2050d2ab-e2dc-40e7-897f-8cac226a5012" containerName="payload-pre-processing"
Sep 20 02:12:58.734910 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734683    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2050d2ab-e2dc-40e7-897f-8cac226a5012" containerName="payload-pre-processing"
Sep 20 02:12:58.734910 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734770    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f22732c7-4ba4-4b12-a446-1adde377a51e" containerName="payload-processing"
Sep 20 02:12:58.734910 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734780    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd49c6ee-54b5-4c37-9ed7-ed1d7de754f8" containerName="revoke-keys"
Sep 20 02:12:58.734910 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.734809    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2050d2ab-e2dc-40e7-897f-8cac226a5012" containerName="payload-pre-processing"
Sep 20 02:12:58.739188 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.739169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:12:58.741599 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.741577    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-4559b3\""
Sep 20 02:12:58.741704 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.741685    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-4559b3-dockercfg-lfk7k\""
Sep 20 02:12:58.747974 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.747951    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"]
Sep 20 02:12:58.764939 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.764912    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"]
Sep 20 02:12:58.768314 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.768295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:12:58.779087 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.779063    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"]
Sep 20 02:12:58.833183 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.833121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de333512-1a47-4be0-b6f5-ffecf891231c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr\" (UID: \"de333512-1a47-4be0-b6f5-ffecf891231c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:12:58.840983 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.833420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9778\" (UniqueName: \"kubernetes.io/projected/de333512-1a47-4be0-b6f5-ffecf891231c-kube-api-access-n9778\") pod \"payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr\" (UID: \"de333512-1a47-4be0-b6f5-ffecf891231c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:12:58.840983 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.839484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlkcf\" (UniqueName: \"kubernetes.io/projected/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-kube-api-access-dlkcf\") pod \"payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f\" (UID: \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:12:58.840983 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.839542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f\" (UID: \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:12:58.940082 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.940044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de333512-1a47-4be0-b6f5-ffecf891231c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr\" (UID: \"de333512-1a47-4be0-b6f5-ffecf891231c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:12:58.940082 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.940093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9778\" (UniqueName: \"kubernetes.io/projected/de333512-1a47-4be0-b6f5-ffecf891231c-kube-api-access-n9778\") pod \"payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr\" (UID: \"de333512-1a47-4be0-b6f5-ffecf891231c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:12:58.940361 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.940151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlkcf\" (UniqueName: \"kubernetes.io/projected/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-kube-api-access-dlkcf\") pod \"payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f\" (UID: \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:12:58.940361 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.940175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f\" (UID: \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:12:58.940909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.940879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de333512-1a47-4be0-b6f5-ffecf891231c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr\" (UID: \"de333512-1a47-4be0-b6f5-ffecf891231c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:12:58.940909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.940897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f\" (UID: \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:12:58.948303 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.948282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlkcf\" (UniqueName: \"kubernetes.io/projected/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-kube-api-access-dlkcf\") pod \"payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f\" (UID: \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:12:58.948395 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:58.948332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9778\" (UniqueName: \"kubernetes.io/projected/de333512-1a47-4be0-b6f5-ffecf891231c-kube-api-access-n9778\") pod \"payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr\" (UID: \"de333512-1a47-4be0-b6f5-ffecf891231c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:12:59.051139 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.051105    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:12:59.079937 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.079911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:12:59.329955 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.329930    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"]
Sep 20 02:12:59.332195 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:12:59.332168    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde333512_1a47_4be0_b6f5_ffecf891231c.slice/crio-87dbe5a5a2cdc22998931edda09ba747cde89d18089a2cbdcbfb5e030e20a59a WatchSource:0}: Error finding container 87dbe5a5a2cdc22998931edda09ba747cde89d18089a2cbdcbfb5e030e20a59a: Status 404 returned error can't find the container with id 87dbe5a5a2cdc22998931edda09ba747cde89d18089a2cbdcbfb5e030e20a59a
Sep 20 02:12:59.363996 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.363973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"]
Sep 20 02:12:59.366209 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:12:59.366186    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7d6ddc_7bcc_4df2_84e5_c7b780cb8cc8.slice/crio-0086149f4700c7fe6ced73ce6ee8bc86a8530d7ca0fe495ddc86d0d25cf0b973 WatchSource:0}: Error finding container 0086149f4700c7fe6ced73ce6ee8bc86a8530d7ca0fe495ddc86d0d25cf0b973: Status 404 returned error can't find the container with id 0086149f4700c7fe6ced73ce6ee8bc86a8530d7ca0fe495ddc86d0d25cf0b973
Sep 20 02:12:59.980895 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.980853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f" event={"ID":"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8","Type":"ContainerStarted","Data":"e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de"}
Sep 20 02:12:59.981359 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.980920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f" event={"ID":"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8","Type":"ContainerStarted","Data":"0086149f4700c7fe6ced73ce6ee8bc86a8530d7ca0fe495ddc86d0d25cf0b973"}
Sep 20 02:12:59.981359 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.981048    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:12:59.982628 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.982604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr" event={"ID":"de333512-1a47-4be0-b6f5-ffecf891231c","Type":"ContainerStarted","Data":"57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d"}
Sep 20 02:12:59.982750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.982646    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr" event={"ID":"de333512-1a47-4be0-b6f5-ffecf891231c","Type":"ContainerStarted","Data":"87dbe5a5a2cdc22998931edda09ba747cde89d18089a2cbdcbfb5e030e20a59a"}
Sep 20 02:12:59.982750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:12:59.982727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:13:00.012750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:00.012694    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f" podStartSLOduration=2.012678059 podStartE2EDuration="2.012678059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:13:00.01201842 +0000 UTC m=+1225.297030356" watchObservedRunningTime="2026-09-20 02:13:00.012678059 +0000 UTC m=+1225.297689995"
Sep 20 02:13:00.031676 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:00.031628    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr" podStartSLOduration=2.031611224 podStartE2EDuration="2.031611224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:13:00.029310389 +0000 UTC m=+1225.314322347" watchObservedRunningTime="2026-09-20 02:13:00.031611224 +0000 UTC m=+1225.316623160"
Sep 20 02:13:06.823884 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:06.823846    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"]
Sep 20 02:13:06.827438 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:06.827420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"
Sep 20 02:13:06.829739 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:06.829717    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:13:06.829872 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:06.829833    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:13:06.834514 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:06.834488    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"]
Sep 20 02:13:06.919441 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:06.919400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m\" (UID: \"77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"
Sep 20 02:13:07.020164 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:07.020128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m\" (UID: \"77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"
Sep 20 02:13:07.020725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:07.020705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m\" (UID: \"77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"
Sep 20 02:13:07.140152 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:07.140072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"
Sep 20 02:13:07.409185 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:07.409127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"]
Sep 20 02:13:07.411569 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:13:07.411539    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c80f2c_ea56_4af5_ba1c_bfbbc9b5934f.slice/crio-62297eacdc8f4ab3153100c92f4403637c4ebb517a15a5cf4c86a0e89934b7d9 WatchSource:0}: Error finding container 62297eacdc8f4ab3153100c92f4403637c4ebb517a15a5cf4c86a0e89934b7d9: Status 404 returned error can't find the container with id 62297eacdc8f4ab3153100c92f4403637c4ebb517a15a5cf4c86a0e89934b7d9
Sep 20 02:13:08.032077 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:08.032042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m" event={"ID":"77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f","Type":"ContainerStarted","Data":"58b50afce35467cfb6c23df2e396f28c9dbe8ec6a40db574c04a7eced18e2dd6"}
Sep 20 02:13:08.032461 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:08.032098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m" event={"ID":"77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f","Type":"ContainerStarted","Data":"62297eacdc8f4ab3153100c92f4403637c4ebb517a15a5cf4c86a0e89934b7d9"}
Sep 20 02:13:08.047734 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:08.047690    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m" podStartSLOduration=2.047673896 podStartE2EDuration="2.047673896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:13:08.045654313 +0000 UTC m=+1233.330666250" watchObservedRunningTime="2026-09-20 02:13:08.047673896 +0000 UTC m=+1233.332685831"
Sep 20 02:13:09.044762 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:09.044731    2565 generic.go:356] "Generic (PLEG): container finished" podID="77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f" containerID="58b50afce35467cfb6c23df2e396f28c9dbe8ec6a40db574c04a7eced18e2dd6" exitCode=0
Sep 20 02:13:09.045154 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:09.044816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m" event={"ID":"77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f","Type":"ContainerDied","Data":"58b50afce35467cfb6c23df2e396f28c9dbe8ec6a40db574c04a7eced18e2dd6"}
Sep 20 02:13:10.188533 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:10.188506    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"
Sep 20 02:13:10.254086 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:10.254053    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f-maas-api-service-ca\") pod \"77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f\" (UID: \"77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f\") "
Sep 20 02:13:10.254437 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:10.254410    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f" (UID: "77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:13:10.355359 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:10.355268    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:13:10.994349 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:10.994316    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:13:10.994638 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:10.994616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:13:11.057247 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:11.057218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"
Sep 20 02:13:11.057410 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:11.057212    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m" event={"ID":"77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f","Type":"ContainerDied","Data":"62297eacdc8f4ab3153100c92f4403637c4ebb517a15a5cf4c86a0e89934b7d9"}
Sep 20 02:13:11.057410 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:11.057340    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62297eacdc8f4ab3153100c92f4403637c4ebb517a15a5cf4c86a0e89934b7d9"
Sep 20 02:13:15.258299 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.258257    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"]
Sep 20 02:13:15.258725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.258711    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f" containerName="revoke-keys"
Sep 20 02:13:15.258770 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.258727    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f" containerName="revoke-keys"
Sep 20 02:13:15.258829 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.258824    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f" containerName="revoke-keys"
Sep 20 02:13:15.261674 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.261655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.263778 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.263755    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-90811b-openshift-default-dockercfg-ccxft\""
Sep 20 02:13:15.273645 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.273624    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"]
Sep 20 02:13:15.406627 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.406595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-socket\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.406627 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.406638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-data\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.406901 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.406664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-envoy\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.406901 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.406782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ccv8\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-kube-api-access-2ccv8\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.406901 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.406832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-token\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.406901 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.406879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istiod-ca-cert\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.407049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.406947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-credential-socket\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.407049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.406964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-podinfo\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.407049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.406989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-certs\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508096 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-credential-socket\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508096 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-podinfo\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508391 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-certs\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508391 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-socket\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508391 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-data\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508391 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-envoy\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508391 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ccv8\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-kube-api-access-2ccv8\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508391 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-token\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508700 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istiod-ca-cert\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508700 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-credential-socket\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508700 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-certs\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508905 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-data\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.508905 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.508759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-socket\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.509160 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.509135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istiod-ca-cert\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.510487 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.510465    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-envoy\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.510613 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.510597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-podinfo\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.517128 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.517098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-token\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.517459 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.517439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ccv8\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-kube-api-access-2ccv8\") pod \"e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") " pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.572933 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.572898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:15.848130 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.848106    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"]
Sep 20 02:13:15.849969 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:13:15.849937    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3899c7f4_a20d_46a7_9e41_63bde7ba26f7.slice/crio-11a97a02b38d70278fd483e550893d53ca29797f3c6a78722caef23cd21df68a WatchSource:0}: Error finding container 11a97a02b38d70278fd483e550893d53ca29797f3c6a78722caef23cd21df68a: Status 404 returned error can't find the container with id 11a97a02b38d70278fd483e550893d53ca29797f3c6a78722caef23cd21df68a
Sep 20 02:13:15.852368 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.852336    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:13:15.852439 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.852411    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:13:15.852478 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:15.852438    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:13:16.087252 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:16.087211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" event={"ID":"3899c7f4-a20d-46a7-9e41-63bde7ba26f7","Type":"ContainerStarted","Data":"3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272"}
Sep 20 02:13:16.087846 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:16.087266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" event={"ID":"3899c7f4-a20d-46a7-9e41-63bde7ba26f7","Type":"ContainerStarted","Data":"11a97a02b38d70278fd483e550893d53ca29797f3c6a78722caef23cd21df68a"}
Sep 20 02:13:16.107782 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:16.107672    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" podStartSLOduration=1.107657698 podStartE2EDuration="1.107657698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:13:16.105257689 +0000 UTC m=+1241.390269624" watchObservedRunningTime="2026-09-20 02:13:16.107657698 +0000 UTC m=+1241.392669633"
Sep 20 02:13:16.573830 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:16.573773    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:16.579298 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:16.579274    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:17.093491 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:17.093461    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:17.094278 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:17.094256    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:21.746836 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:21.746783    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"]
Sep 20 02:13:21.747813 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:21.747061    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz" podUID="0b2ceeed-7d83-401e-bd47-961f11d30853" containerName="payload-processing" containerID="cri-o://631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec" gracePeriod=30
Sep 20 02:13:21.753713 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:21.753160    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"]
Sep 20 02:13:21.753713 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:21.753478    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2" podUID="251d0dc7-5e09-4e11-aa75-d42586faf07a" containerName="payload-pre-processing" containerID="cri-o://015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7" gracePeriod=30
Sep 20 02:13:22.006593 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.006172    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"]
Sep 20 02:13:22.015154 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.015117    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04a2fd-zhs2m"]
Sep 20 02:13:22.041818 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.041779    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:13:22.071960 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.071934    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:13:22.125153 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.125119    2565 generic.go:356] "Generic (PLEG): container finished" podID="0b2ceeed-7d83-401e-bd47-961f11d30853" containerID="631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec" exitCode=0
Sep 20 02:13:22.125313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.125160    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"
Sep 20 02:13:22.125313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.125209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz" event={"ID":"0b2ceeed-7d83-401e-bd47-961f11d30853","Type":"ContainerDied","Data":"631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec"}
Sep 20 02:13:22.125313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.125265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz" event={"ID":"0b2ceeed-7d83-401e-bd47-961f11d30853","Type":"ContainerDied","Data":"51116d0d44841426449f2bfd0f2c8db7b201066dd5cbfe91de08cb1c8a4c29b9"}
Sep 20 02:13:22.125938 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.125294    2565 scope.go:117] "RemoveContainer" containerID="631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec"
Sep 20 02:13:22.126671 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.126650    2565 generic.go:356] "Generic (PLEG): container finished" podID="251d0dc7-5e09-4e11-aa75-d42586faf07a" containerID="015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7" exitCode=0
Sep 20 02:13:22.126775 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.126693    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"
Sep 20 02:13:22.126775 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.126715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2" event={"ID":"251d0dc7-5e09-4e11-aa75-d42586faf07a","Type":"ContainerDied","Data":"015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7"}
Sep 20 02:13:22.126775 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.126753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2" event={"ID":"251d0dc7-5e09-4e11-aa75-d42586faf07a","Type":"ContainerDied","Data":"d172e0f6e6b4a3de38de007ba1fd945c9de9a09063f3cd287a99361b46e27124"}
Sep 20 02:13:22.135450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.135424    2565 scope.go:117] "RemoveContainer" containerID="631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec"
Sep 20 02:13:22.136151 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:13:22.136030    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec\": container with ID starting with 631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec not found: ID does not exist" containerID="631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec"
Sep 20 02:13:22.136151 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.136062    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec"} err="failed to get container status \"631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec\": rpc error: code = NotFound desc = could not find container \"631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec\": container with ID starting with 631921dcdc571a280a7845665fa7698318fa09598d9b01c176dee2d7baeaecec not found: ID does not exist"
Sep 20 02:13:22.136151 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.136083    2565 scope.go:117] "RemoveContainer" containerID="015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7"
Sep 20 02:13:22.144737 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.144718    2565 scope.go:117] "RemoveContainer" containerID="015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7"
Sep 20 02:13:22.145000 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:13:22.144982    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7\": container with ID starting with 015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7 not found: ID does not exist" containerID="015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7"
Sep 20 02:13:22.145070 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.145008    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7"} err="failed to get container status \"015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7\": rpc error: code = NotFound desc = could not find container \"015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7\": container with ID starting with 015c6ed51b6f218a1db579dd8beff5f637192b5bc8db6ce500e264581389e0f7 not found: ID does not exist"
Sep 20 02:13:22.177364 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.177338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b2ceeed-7d83-401e-bd47-961f11d30853-plugins-config-volume\") pod \"0b2ceeed-7d83-401e-bd47-961f11d30853\" (UID: \"0b2ceeed-7d83-401e-bd47-961f11d30853\") "
Sep 20 02:13:22.177476 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.177402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqdxg\" (UniqueName: \"kubernetes.io/projected/251d0dc7-5e09-4e11-aa75-d42586faf07a-kube-api-access-gqdxg\") pod \"251d0dc7-5e09-4e11-aa75-d42586faf07a\" (UID: \"251d0dc7-5e09-4e11-aa75-d42586faf07a\") "
Sep 20 02:13:22.177545 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.177489    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251d0dc7-5e09-4e11-aa75-d42586faf07a-plugins-config-volume\") pod \"251d0dc7-5e09-4e11-aa75-d42586faf07a\" (UID: \"251d0dc7-5e09-4e11-aa75-d42586faf07a\") "
Sep 20 02:13:22.177545 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.177541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zv94\" (UniqueName: \"kubernetes.io/projected/0b2ceeed-7d83-401e-bd47-961f11d30853-kube-api-access-9zv94\") pod \"0b2ceeed-7d83-401e-bd47-961f11d30853\" (UID: \"0b2ceeed-7d83-401e-bd47-961f11d30853\") "
Sep 20 02:13:22.177772 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.177736    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b2ceeed-7d83-401e-bd47-961f11d30853-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b2ceeed-7d83-401e-bd47-961f11d30853" (UID: "0b2ceeed-7d83-401e-bd47-961f11d30853"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:13:22.177893 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.177805    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/251d0dc7-5e09-4e11-aa75-d42586faf07a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "251d0dc7-5e09-4e11-aa75-d42586faf07a" (UID: "251d0dc7-5e09-4e11-aa75-d42586faf07a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:13:22.179477 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.179442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/251d0dc7-5e09-4e11-aa75-d42586faf07a-kube-api-access-gqdxg" (OuterVolumeSpecName: "kube-api-access-gqdxg") pod "251d0dc7-5e09-4e11-aa75-d42586faf07a" (UID: "251d0dc7-5e09-4e11-aa75-d42586faf07a"). InnerVolumeSpecName "kube-api-access-gqdxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:13:22.179572 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.179532    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2ceeed-7d83-401e-bd47-961f11d30853-kube-api-access-9zv94" (OuterVolumeSpecName: "kube-api-access-9zv94") pod "0b2ceeed-7d83-401e-bd47-961f11d30853" (UID: "0b2ceeed-7d83-401e-bd47-961f11d30853"). InnerVolumeSpecName "kube-api-access-9zv94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:13:22.279127 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.279035    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zv94\" (UniqueName: \"kubernetes.io/projected/0b2ceeed-7d83-401e-bd47-961f11d30853-kube-api-access-9zv94\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:13:22.279127 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.279065    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b2ceeed-7d83-401e-bd47-961f11d30853-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:13:22.279127 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.279074    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqdxg\" (UniqueName: \"kubernetes.io/projected/251d0dc7-5e09-4e11-aa75-d42586faf07a-kube-api-access-gqdxg\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:13:22.279127 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.279087    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251d0dc7-5e09-4e11-aa75-d42586faf07a-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:13:22.449441 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.449413    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"]
Sep 20 02:13:22.456407 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.456373    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2"]
Sep 20 02:13:22.465773 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.465738    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"]
Sep 20 02:13:22.471236 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.471214    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz"]
Sep 20 02:13:22.834622 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.834587    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"]
Sep 20 02:13:22.835033 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.835019    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2ceeed-7d83-401e-bd47-961f11d30853" containerName="payload-processing"
Sep 20 02:13:22.835087 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.835035    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2ceeed-7d83-401e-bd47-961f11d30853" containerName="payload-processing"
Sep 20 02:13:22.835087 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.835050    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="251d0dc7-5e09-4e11-aa75-d42586faf07a" containerName="payload-pre-processing"
Sep 20 02:13:22.835087 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.835055    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="251d0dc7-5e09-4e11-aa75-d42586faf07a" containerName="payload-pre-processing"
Sep 20 02:13:22.835182 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.835121    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2ceeed-7d83-401e-bd47-961f11d30853" containerName="payload-processing"
Sep 20 02:13:22.835182 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.835130    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="251d0dc7-5e09-4e11-aa75-d42586faf07a" containerName="payload-pre-processing"
Sep 20 02:13:22.839535 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.839519    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:22.842032 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.842005    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-90811b\""
Sep 20 02:13:22.850011 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.849988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"]
Sep 20 02:13:22.883098 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.883069    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"]
Sep 20 02:13:22.886516 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.886501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:22.892494 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.892469    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-90811b-dockercfg-2tqjt\""
Sep 20 02:13:22.899549 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.899522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"]
Sep 20 02:13:22.984730 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.984476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwdqd\" (UniqueName: \"kubernetes.io/projected/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-kube-api-access-xwdqd\") pod \"payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2\" (UID: \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:22.984730 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.984603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6sgc\" (UniqueName: \"kubernetes.io/projected/2aed0c73-536a-469d-9710-e6e2fc9df99f-kube-api-access-j6sgc\") pod \"payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr\" (UID: \"2aed0c73-536a-469d-9710-e6e2fc9df99f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:22.984730 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.984679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2\" (UID: \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:22.984730 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:22.984732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2aed0c73-536a-469d-9710-e6e2fc9df99f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr\" (UID: \"2aed0c73-536a-469d-9710-e6e2fc9df99f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:23.085835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.085724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6sgc\" (UniqueName: \"kubernetes.io/projected/2aed0c73-536a-469d-9710-e6e2fc9df99f-kube-api-access-j6sgc\") pod \"payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr\" (UID: \"2aed0c73-536a-469d-9710-e6e2fc9df99f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:23.085835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.085775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2\" (UID: \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:23.085835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.085831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2aed0c73-536a-469d-9710-e6e2fc9df99f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr\" (UID: \"2aed0c73-536a-469d-9710-e6e2fc9df99f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:23.086082 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.085919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwdqd\" (UniqueName: \"kubernetes.io/projected/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-kube-api-access-xwdqd\") pod \"payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2\" (UID: \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:23.086595 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.086576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2aed0c73-536a-469d-9710-e6e2fc9df99f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr\" (UID: \"2aed0c73-536a-469d-9710-e6e2fc9df99f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:23.086635 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.086586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2\" (UID: \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:23.093690 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.093664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwdqd\" (UniqueName: \"kubernetes.io/projected/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-kube-api-access-xwdqd\") pod \"payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2\" (UID: \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:23.094181 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.094164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6sgc\" (UniqueName: \"kubernetes.io/projected/2aed0c73-536a-469d-9710-e6e2fc9df99f-kube-api-access-j6sgc\") pod \"payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr\" (UID: \"2aed0c73-536a-469d-9710-e6e2fc9df99f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:23.149950 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.149920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:23.196322 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.196187    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:23.221974 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.221940    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b2ceeed-7d83-401e-bd47-961f11d30853" path="/var/lib/kubelet/pods/0b2ceeed-7d83-401e-bd47-961f11d30853/volumes"
Sep 20 02:13:23.222518 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.222491    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="251d0dc7-5e09-4e11-aa75-d42586faf07a" path="/var/lib/kubelet/pods/251d0dc7-5e09-4e11-aa75-d42586faf07a/volumes"
Sep 20 02:13:23.226189 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.222970    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f" path="/var/lib/kubelet/pods/77c80f2c-ea56-4af5-ba1c-bfbbc9b5934f/volumes"
Sep 20 02:13:23.422244 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.422216    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"]
Sep 20 02:13:23.424098 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:13:23.424070    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7839bfbd_953d_4eeb_9e11_d5ffa0641d7b.slice/crio-2f8961b5481f9b0e641577766d70e1b3aead5e82c6ed611a44339a596f06f6a9 WatchSource:0}: Error finding container 2f8961b5481f9b0e641577766d70e1b3aead5e82c6ed611a44339a596f06f6a9: Status 404 returned error can't find the container with id 2f8961b5481f9b0e641577766d70e1b3aead5e82c6ed611a44339a596f06f6a9
Sep 20 02:13:23.491009 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:23.490988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"]
Sep 20 02:13:23.493035 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:13:23.493011    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aed0c73_536a_469d_9710_e6e2fc9df99f.slice/crio-6eccd228dcea7d53fd14bd716c2fbc3055c5851ca0ec4d2876276abdd24319f9 WatchSource:0}: Error finding container 6eccd228dcea7d53fd14bd716c2fbc3055c5851ca0ec4d2876276abdd24319f9: Status 404 returned error can't find the container with id 6eccd228dcea7d53fd14bd716c2fbc3055c5851ca0ec4d2876276abdd24319f9
Sep 20 02:13:24.142588 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:24.142549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2" event={"ID":"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b","Type":"ContainerStarted","Data":"ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b"}
Sep 20 02:13:24.143054 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:24.142611    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:24.143054 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:24.142638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2" event={"ID":"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b","Type":"ContainerStarted","Data":"2f8961b5481f9b0e641577766d70e1b3aead5e82c6ed611a44339a596f06f6a9"}
Sep 20 02:13:24.144182 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:24.144156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr" event={"ID":"2aed0c73-536a-469d-9710-e6e2fc9df99f","Type":"ContainerStarted","Data":"8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0"}
Sep 20 02:13:24.144312 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:24.144200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr" event={"ID":"2aed0c73-536a-469d-9710-e6e2fc9df99f","Type":"ContainerStarted","Data":"6eccd228dcea7d53fd14bd716c2fbc3055c5851ca0ec4d2876276abdd24319f9"}
Sep 20 02:13:24.144312 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:24.144228    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:24.159625 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:24.159582    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2" podStartSLOduration=2.159566961 podStartE2EDuration="2.159566961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:13:24.15844187 +0000 UTC m=+1249.443453806" watchObservedRunningTime="2026-09-20 02:13:24.159566961 +0000 UTC m=+1249.444578903"
Sep 20 02:13:24.174728 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:24.174674    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr" podStartSLOduration=2.17465833 podStartE2EDuration="2.17465833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:13:24.173471583 +0000 UTC m=+1249.458483519" watchObservedRunningTime="2026-09-20 02:13:24.17465833 +0000 UTC m=+1249.459670265"
Sep 20 02:13:28.659362 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:28.659269    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"]
Sep 20 02:13:28.663217 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:28.663194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"
Sep 20 02:13:28.665563 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:28.665545    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:13:28.665652 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:28.665563    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:13:28.669314 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:28.669293    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"]
Sep 20 02:13:28.844836 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:28.844774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77940428-dc04-47b7-81bd-d7084a846932-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-703998-lp4n9\" (UID: \"77940428-dc04-47b7-81bd-d7084a846932\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"
Sep 20 02:13:28.945623 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:28.945542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77940428-dc04-47b7-81bd-d7084a846932-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-703998-lp4n9\" (UID: \"77940428-dc04-47b7-81bd-d7084a846932\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"
Sep 20 02:13:28.946217 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:28.946198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77940428-dc04-47b7-81bd-d7084a846932-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-703998-lp4n9\" (UID: \"77940428-dc04-47b7-81bd-d7084a846932\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"
Sep 20 02:13:28.976497 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:28.976467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"
Sep 20 02:13:29.257025 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:29.256997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"]
Sep 20 02:13:29.258990 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:13:29.258965    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77940428_dc04_47b7_81bd_d7084a846932.slice/crio-20f3fb7f6dfbe8499ecc3ee8e6885335c3d535721f6f6603f74bc196367b188d WatchSource:0}: Error finding container 20f3fb7f6dfbe8499ecc3ee8e6885335c3d535721f6f6603f74bc196367b188d: Status 404 returned error can't find the container with id 20f3fb7f6dfbe8499ecc3ee8e6885335c3d535721f6f6603f74bc196367b188d
Sep 20 02:13:30.183855 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:30.183752    2565 generic.go:356] "Generic (PLEG): container finished" podID="77940428-dc04-47b7-81bd-d7084a846932" containerID="15902c48fa6688aead558436ca3c6b2d03d3065339b0e71cad81c42cc9e10673" exitCode=0
Sep 20 02:13:30.184238 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:30.183843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9" event={"ID":"77940428-dc04-47b7-81bd-d7084a846932","Type":"ContainerDied","Data":"15902c48fa6688aead558436ca3c6b2d03d3065339b0e71cad81c42cc9e10673"}
Sep 20 02:13:30.184238 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:30.183897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9" event={"ID":"77940428-dc04-47b7-81bd-d7084a846932","Type":"ContainerStarted","Data":"20f3fb7f6dfbe8499ecc3ee8e6885335c3d535721f6f6603f74bc196367b188d"}
Sep 20 02:13:31.377651 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:31.377624    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"
Sep 20 02:13:31.477759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:31.477673    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77940428-dc04-47b7-81bd-d7084a846932-maas-api-service-ca\") pod \"77940428-dc04-47b7-81bd-d7084a846932\" (UID: \"77940428-dc04-47b7-81bd-d7084a846932\") "
Sep 20 02:13:31.478050 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:31.478027    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77940428-dc04-47b7-81bd-d7084a846932-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77940428-dc04-47b7-81bd-d7084a846932" (UID: "77940428-dc04-47b7-81bd-d7084a846932"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:13:31.578881 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:31.578839    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77940428-dc04-47b7-81bd-d7084a846932-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:13:32.199635 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:32.199592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9" event={"ID":"77940428-dc04-47b7-81bd-d7084a846932","Type":"ContainerDied","Data":"20f3fb7f6dfbe8499ecc3ee8e6885335c3d535721f6f6603f74bc196367b188d"}
Sep 20 02:13:32.199863 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:32.199664    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20f3fb7f6dfbe8499ecc3ee8e6885335c3d535721f6f6603f74bc196367b188d"
Sep 20 02:13:32.199863 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:32.199738    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"
Sep 20 02:13:35.157881 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:35.156945    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:13:35.159528 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:35.158905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:13:39.435671 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.435636    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"]
Sep 20 02:13:39.436146 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.435904    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk" podUID="5677da80-2d94-4d80-b043-cbda9386a640" containerName="payload-pre-processing" containerID="cri-o://057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce" gracePeriod=30
Sep 20 02:13:39.594496 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.594455    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"]
Sep 20 02:13:39.596411 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.596378    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-703998-lp4n9"]
Sep 20 02:13:39.726353 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.726329    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:13:39.758517 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.758485    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5677da80-2d94-4d80-b043-cbda9386a640-plugins-config-volume\") pod \"5677da80-2d94-4d80-b043-cbda9386a640\" (UID: \"5677da80-2d94-4d80-b043-cbda9386a640\") "
Sep 20 02:13:39.758706 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.758542    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b6gm\" (UniqueName: \"kubernetes.io/projected/5677da80-2d94-4d80-b043-cbda9386a640-kube-api-access-4b6gm\") pod \"5677da80-2d94-4d80-b043-cbda9386a640\" (UID: \"5677da80-2d94-4d80-b043-cbda9386a640\") "
Sep 20 02:13:39.758937 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.758906    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5677da80-2d94-4d80-b043-cbda9386a640-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5677da80-2d94-4d80-b043-cbda9386a640" (UID: "5677da80-2d94-4d80-b043-cbda9386a640"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:13:39.760619 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.760590    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5677da80-2d94-4d80-b043-cbda9386a640-kube-api-access-4b6gm" (OuterVolumeSpecName: "kube-api-access-4b6gm") pod "5677da80-2d94-4d80-b043-cbda9386a640" (UID: "5677da80-2d94-4d80-b043-cbda9386a640"). InnerVolumeSpecName "kube-api-access-4b6gm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:13:39.860071 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.860039    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b6gm\" (UniqueName: \"kubernetes.io/projected/5677da80-2d94-4d80-b043-cbda9386a640-kube-api-access-4b6gm\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:13:39.860071 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:39.860066    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5677da80-2d94-4d80-b043-cbda9386a640-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:13:40.247117 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.247082    2565 generic.go:356] "Generic (PLEG): container finished" podID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerID="3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272" exitCode=0
Sep 20 02:13:40.247316 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.247153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" event={"ID":"3899c7f4-a20d-46a7-9e41-63bde7ba26f7","Type":"ContainerDied","Data":"3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272"}
Sep 20 02:13:40.247637 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.247619    2565 scope.go:117] "RemoveContainer" containerID="3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272"
Sep 20 02:13:40.248479 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.248458    2565 generic.go:356] "Generic (PLEG): container finished" podID="5677da80-2d94-4d80-b043-cbda9386a640" containerID="057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce" exitCode=0
Sep 20 02:13:40.248590 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.248521    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"
Sep 20 02:13:40.248642 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.248595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk" event={"ID":"5677da80-2d94-4d80-b043-cbda9386a640","Type":"ContainerDied","Data":"057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce"}
Sep 20 02:13:40.248680 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.248643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk" event={"ID":"5677da80-2d94-4d80-b043-cbda9386a640","Type":"ContainerDied","Data":"181eebe1d186815ade30c91a16339eb43eb29b64377dc7a8cfb572ed6a74fbcf"}
Sep 20 02:13:40.248680 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.248669    2565 scope.go:117] "RemoveContainer" containerID="057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce"
Sep 20 02:13:40.248779 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.248751    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:13:40.248870 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.248851    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:13:40.248920 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.248903    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 20 02:13:40.260364 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.259011    2565 scope.go:117] "RemoveContainer" containerID="057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce"
Sep 20 02:13:40.260432 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:13:40.260372    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce\": container with ID starting with 057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce not found: ID does not exist" containerID="057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce"
Sep 20 02:13:40.260432 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.260407    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce"} err="failed to get container status \"057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce\": rpc error: code = NotFound desc = could not find container \"057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce\": container with ID starting with 057c17f1403f9269f23dcdfcdc97279976c4cac40f90d82b4fa3bd59fa344dce not found: ID does not exist"
Sep 20 02:13:40.284137 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.283757    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"]
Sep 20 02:13:40.287347 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:40.287313    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk"]
Sep 20 02:13:41.220776 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:41.220745    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5677da80-2d94-4d80-b043-cbda9386a640" path="/var/lib/kubelet/pods/5677da80-2d94-4d80-b043-cbda9386a640/volumes"
Sep 20 02:13:41.221169 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:41.221114    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77940428-dc04-47b7-81bd-d7084a846932" path="/var/lib/kubelet/pods/77940428-dc04-47b7-81bd-d7084a846932/volumes"
Sep 20 02:13:41.263909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:41.263869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" event={"ID":"3899c7f4-a20d-46a7-9e41-63bde7ba26f7","Type":"ContainerStarted","Data":"0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a"}
Sep 20 02:13:41.573616 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:41.573568    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:41.573864 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:41.573839    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 20 02:13:41.573963 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:41.573893    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 20 02:13:42.573333 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:42.573292    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 20 02:13:42.573719 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:42.573348    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 20 02:13:43.573310 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:43.573268    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 20 02:13:43.573489 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:43.573325    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 20 02:13:44.573513 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:44.573481    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 20 02:13:44.573912 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:44.573535    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 20 02:13:45.573889 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:45.573784    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 20 02:13:45.573889 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:45.573870    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 20 02:13:46.577629 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:46.577596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:46.578127 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:46.578022    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:46.578600 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:46.578582    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:13:52.187892 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.187857    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"]
Sep 20 02:13:52.188342 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.188306    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77940428-dc04-47b7-81bd-d7084a846932" containerName="revoke-keys"
Sep 20 02:13:52.188342 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.188323    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77940428-dc04-47b7-81bd-d7084a846932" containerName="revoke-keys"
Sep 20 02:13:52.188342 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.188334    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5677da80-2d94-4d80-b043-cbda9386a640" containerName="payload-pre-processing"
Sep 20 02:13:52.188342 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.188340    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5677da80-2d94-4d80-b043-cbda9386a640" containerName="payload-pre-processing"
Sep 20 02:13:52.188480 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.188408    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="77940428-dc04-47b7-81bd-d7084a846932" containerName="revoke-keys"
Sep 20 02:13:52.188480 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.188416    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5677da80-2d94-4d80-b043-cbda9386a640" containerName="payload-pre-processing"
Sep 20 02:13:52.192884 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.192867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:13:52.195202 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.195176    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f5813346-dockercfg-wkgzb\""
Sep 20 02:13:52.195369 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.195347    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f5813346\""
Sep 20 02:13:52.203036 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.203007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"]
Sep 20 02:13:52.291224 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.289290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40f91726-b0ca-4776-a4b9-73dcf2398d61-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv\" (UID: \"40f91726-b0ca-4776-a4b9-73dcf2398d61\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:13:52.291224 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.289364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n88s\" (UniqueName: \"kubernetes.io/projected/40f91726-b0ca-4776-a4b9-73dcf2398d61-kube-api-access-2n88s\") pod \"payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv\" (UID: \"40f91726-b0ca-4776-a4b9-73dcf2398d61\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:13:52.390052 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.390006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40f91726-b0ca-4776-a4b9-73dcf2398d61-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv\" (UID: \"40f91726-b0ca-4776-a4b9-73dcf2398d61\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:13:52.390259 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.390066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n88s\" (UniqueName: \"kubernetes.io/projected/40f91726-b0ca-4776-a4b9-73dcf2398d61-kube-api-access-2n88s\") pod \"payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv\" (UID: \"40f91726-b0ca-4776-a4b9-73dcf2398d61\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:13:52.390693 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.390667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40f91726-b0ca-4776-a4b9-73dcf2398d61-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv\" (UID: \"40f91726-b0ca-4776-a4b9-73dcf2398d61\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:13:52.397873 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.397845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n88s\" (UniqueName: \"kubernetes.io/projected/40f91726-b0ca-4776-a4b9-73dcf2398d61-kube-api-access-2n88s\") pod \"payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv\" (UID: \"40f91726-b0ca-4776-a4b9-73dcf2398d61\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:13:52.505354 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.505325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:13:52.775765 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:52.775682    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"]
Sep 20 02:13:52.779886 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:13:52.779853    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f91726_b0ca_4776_a4b9_73dcf2398d61.slice/crio-5e9d135750d294de0fddccd68b3cd511d726252b5a69b4e358f3333ec988d8ac WatchSource:0}: Error finding container 5e9d135750d294de0fddccd68b3cd511d726252b5a69b4e358f3333ec988d8ac: Status 404 returned error can't find the container with id 5e9d135750d294de0fddccd68b3cd511d726252b5a69b4e358f3333ec988d8ac
Sep 20 02:13:53.341179 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:53.341140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv" event={"ID":"40f91726-b0ca-4776-a4b9-73dcf2398d61","Type":"ContainerStarted","Data":"dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef"}
Sep 20 02:13:53.341646 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:53.341190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv" event={"ID":"40f91726-b0ca-4776-a4b9-73dcf2398d61","Type":"ContainerStarted","Data":"5e9d135750d294de0fddccd68b3cd511d726252b5a69b4e358f3333ec988d8ac"}
Sep 20 02:13:53.341646 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:53.341238    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:13:53.357939 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:13:53.357884    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv" podStartSLOduration=1.357868678 podStartE2EDuration="1.357868678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:13:53.355813275 +0000 UTC m=+1278.640825213" watchObservedRunningTime="2026-09-20 02:13:53.357868678 +0000 UTC m=+1278.642880613"
Sep 20 02:14:04.349489 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:04.349451    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:14:31.323486 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.323455    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"]
Sep 20 02:14:31.327257 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.327234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:14:31.329512 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.329493    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-ed9f38\""
Sep 20 02:14:31.329604 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.329495    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-ed9f38-dockercfg-wkbhs\""
Sep 20 02:14:31.338388 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.338369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"]
Sep 20 02:14:31.353338 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.353316    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"]
Sep 20 02:14:31.357804 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.357767    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:31.366509 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.366489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"]
Sep 20 02:14:31.488284 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.488246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbmz9\" (UniqueName: \"kubernetes.io/projected/faf10c9d-c086-4844-b2c9-fad25e670a34-kube-api-access-gbmz9\") pod \"payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s\" (UID: \"faf10c9d-c086-4844-b2c9-fad25e670a34\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:14:31.488450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.488302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faf10c9d-c086-4844-b2c9-fad25e670a34-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s\" (UID: \"faf10c9d-c086-4844-b2c9-fad25e670a34\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:14:31.488450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.488330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pnz9\" (UniqueName: \"kubernetes.io/projected/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-kube-api-access-7pnz9\") pod \"payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv\" (UID: \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:31.488450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.488378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv\" (UID: \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:31.589750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.589666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbmz9\" (UniqueName: \"kubernetes.io/projected/faf10c9d-c086-4844-b2c9-fad25e670a34-kube-api-access-gbmz9\") pod \"payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s\" (UID: \"faf10c9d-c086-4844-b2c9-fad25e670a34\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:14:31.589750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.589712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faf10c9d-c086-4844-b2c9-fad25e670a34-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s\" (UID: \"faf10c9d-c086-4844-b2c9-fad25e670a34\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:14:31.589750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.589733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pnz9\" (UniqueName: \"kubernetes.io/projected/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-kube-api-access-7pnz9\") pod \"payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv\" (UID: \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:31.590053 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.589826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv\" (UID: \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:31.590475 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.590450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faf10c9d-c086-4844-b2c9-fad25e670a34-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s\" (UID: \"faf10c9d-c086-4844-b2c9-fad25e670a34\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:14:31.590605 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.590585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv\" (UID: \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:31.597452 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.597423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pnz9\" (UniqueName: \"kubernetes.io/projected/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-kube-api-access-7pnz9\") pod \"payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv\" (UID: \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:31.597661 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.597624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbmz9\" (UniqueName: \"kubernetes.io/projected/faf10c9d-c086-4844-b2c9-fad25e670a34-kube-api-access-gbmz9\") pod \"payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s\" (UID: \"faf10c9d-c086-4844-b2c9-fad25e670a34\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:14:31.637471 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.637437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:14:31.669254 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.669213    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:31.909608 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.909579    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"]
Sep 20 02:14:31.910750 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:14:31.910729    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf10c9d_c086_4844_b2c9_fad25e670a34.slice/crio-0d57cf7fa797add98dc83423c9ed0c099b3b4ef5614c943731aeaf3ef76a73db WatchSource:0}: Error finding container 0d57cf7fa797add98dc83423c9ed0c099b3b4ef5614c943731aeaf3ef76a73db: Status 404 returned error can't find the container with id 0d57cf7fa797add98dc83423c9ed0c099b3b4ef5614c943731aeaf3ef76a73db
Sep 20 02:14:31.957348 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:31.957320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"]
Sep 20 02:14:31.958273 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:14:31.958248    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfdc8c9_cf54_4d17_ab80_56243aa91dce.slice/crio-5e66fc15e69e50a5c59ff29f66c75a43b04f551fc73c4ea29d28ebea3d00d1a0 WatchSource:0}: Error finding container 5e66fc15e69e50a5c59ff29f66c75a43b04f551fc73c4ea29d28ebea3d00d1a0: Status 404 returned error can't find the container with id 5e66fc15e69e50a5c59ff29f66c75a43b04f551fc73c4ea29d28ebea3d00d1a0
Sep 20 02:14:32.569667 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:32.569622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv" event={"ID":"7dfdc8c9-cf54-4d17-ab80-56243aa91dce","Type":"ContainerStarted","Data":"a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3"}
Sep 20 02:14:32.570153 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:32.569686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv" event={"ID":"7dfdc8c9-cf54-4d17-ab80-56243aa91dce","Type":"ContainerStarted","Data":"5e66fc15e69e50a5c59ff29f66c75a43b04f551fc73c4ea29d28ebea3d00d1a0"}
Sep 20 02:14:32.570153 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:32.569713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:32.571326 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:32.571300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s" event={"ID":"faf10c9d-c086-4844-b2c9-fad25e670a34","Type":"ContainerStarted","Data":"dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a"}
Sep 20 02:14:32.571459 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:32.571348    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s" event={"ID":"faf10c9d-c086-4844-b2c9-fad25e670a34","Type":"ContainerStarted","Data":"0d57cf7fa797add98dc83423c9ed0c099b3b4ef5614c943731aeaf3ef76a73db"}
Sep 20 02:14:32.571459 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:32.571385    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:14:32.589412 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:32.589354    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv" podStartSLOduration=1.589335822 podStartE2EDuration="1.589335822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:14:32.586078836 +0000 UTC m=+1317.871090769" watchObservedRunningTime="2026-09-20 02:14:32.589335822 +0000 UTC m=+1317.874347758"
Sep 20 02:14:32.606542 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:32.606486    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s" podStartSLOduration=1.606467559 podStartE2EDuration="1.606467559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:14:32.603767194 +0000 UTC m=+1317.888779132" watchObservedRunningTime="2026-09-20 02:14:32.606467559 +0000 UTC m=+1317.891479496"
Sep 20 02:14:35.315725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:35.315693    2565 scope.go:117] "RemoveContainer" containerID="b75d6fae0b668e1c3fb476cb2b5b89c126db414199c646d0c68f65e946e27b23"
Sep 20 02:14:35.323957 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:35.323927    2565 scope.go:117] "RemoveContainer" containerID="eab30143df6449ca5a26fa16bf8066871abb15993bba0fc8343f7f0279ebafb1"
Sep 20 02:14:43.580467 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:43.580414    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:14:43.580961 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:14:43.580541    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:15:00.131188 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.131104    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc"]
Sep 20 02:15:00.136628 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.136605    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4"]
Sep 20 02:15:00.136757 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.136720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc"
Sep 20 02:15:00.139487 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.139467    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:15:00.140547 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.140530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4"
Sep 20 02:15:00.141592 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.141575    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg"]
Sep 20 02:15:00.145408 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.145359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg"
Sep 20 02:15:00.146018 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.145989    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc"]
Sep 20 02:15:00.151852 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.151833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc"
Sep 20 02:15:00.152340 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.152321    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4"]
Sep 20 02:15:00.155507 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.154766    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg"]
Sep 20 02:15:00.162299 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.162093    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct"]
Sep 20 02:15:00.165987 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.165964    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4"
Sep 20 02:15:00.166629 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.166607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct"
Sep 20 02:15:00.177265 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.175398    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct"]
Sep 20 02:15:00.209627 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.209599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg"
Sep 20 02:15:00.217193 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.217167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct"
Sep 20 02:15:00.444846 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.444816    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc"]
Sep 20 02:15:00.446302 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:15:00.446274    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e940ec_f8da_4d6d_9c83_4720a41c4c09.slice/crio-a1a61d90f10be9ac38cea3f096aea882998ba66711bcd5992b802338358ec206 WatchSource:0}: Error finding container a1a61d90f10be9ac38cea3f096aea882998ba66711bcd5992b802338358ec206: Status 404 returned error can't find the container with id a1a61d90f10be9ac38cea3f096aea882998ba66711bcd5992b802338358ec206
Sep 20 02:15:00.458447 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.458424    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4"]
Sep 20 02:15:00.460366 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:15:00.460345    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9499b9ab_466f_4571_8637_888129394690.slice/crio-0868a9066dcc030c6c7f3be9b81a96f7b67aa863eba53205d9791eb9fb5b5eab WatchSource:0}: Error finding container 0868a9066dcc030c6c7f3be9b81a96f7b67aa863eba53205d9791eb9fb5b5eab: Status 404 returned error can't find the container with id 0868a9066dcc030c6c7f3be9b81a96f7b67aa863eba53205d9791eb9fb5b5eab
Sep 20 02:15:00.506339 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.506314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg"]
Sep 20 02:15:00.507259 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:15:00.507237    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4582da82_d733_485d_81c2_9ebd15f4857c.slice/crio-9437ac060a206f75a96792b6b7c9b85ebc84c26866dac009ab1ccf5eb7181fc6 WatchSource:0}: Error finding container 9437ac060a206f75a96792b6b7c9b85ebc84c26866dac009ab1ccf5eb7181fc6: Status 404 returned error can't find the container with id 9437ac060a206f75a96792b6b7c9b85ebc84c26866dac009ab1ccf5eb7181fc6
Sep 20 02:15:00.531163 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.531137    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct"]
Sep 20 02:15:00.534878 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:15:00.534853    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c98f1b_d773_4821_a530_273a730b5e71.slice/crio-4bd4aa995193ffba6bda939a7dd1b8818c8292c5fb8b63ca9a4233ae4f381b72 WatchSource:0}: Error finding container 4bd4aa995193ffba6bda939a7dd1b8818c8292c5fb8b63ca9a4233ae4f381b72: Status 404 returned error can't find the container with id 4bd4aa995193ffba6bda939a7dd1b8818c8292c5fb8b63ca9a4233ae4f381b72
Sep 20 02:15:00.725054 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.724958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4" event={"ID":"9499b9ab-466f-4571-8637-888129394690","Type":"ContainerStarted","Data":"0868a9066dcc030c6c7f3be9b81a96f7b67aa863eba53205d9791eb9fb5b5eab"}
Sep 20 02:15:00.726268 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.726238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg" event={"ID":"4582da82-d733-485d-81c2-9ebd15f4857c","Type":"ContainerStarted","Data":"9437ac060a206f75a96792b6b7c9b85ebc84c26866dac009ab1ccf5eb7181fc6"}
Sep 20 02:15:00.727518 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.727488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct" event={"ID":"44c98f1b-d773-4821-a530-273a730b5e71","Type":"ContainerStarted","Data":"4bd4aa995193ffba6bda939a7dd1b8818c8292c5fb8b63ca9a4233ae4f381b72"}
Sep 20 02:15:00.728652 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:00.728631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc" event={"ID":"83e940ec-f8da-4d6d-9c83-4720a41c4c09","Type":"ContainerStarted","Data":"a1a61d90f10be9ac38cea3f096aea882998ba66711bcd5992b802338358ec206"}
Sep 20 02:15:01.737641 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:01.737602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4" event={"ID":"9499b9ab-466f-4571-8637-888129394690","Type":"ContainerStarted","Data":"8872d04cc78c6f53a3564e453d2c762d42fbcf397a5bf000764e9c3e6870d899"}
Sep 20 02:15:01.739591 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:01.739560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg" event={"ID":"4582da82-d733-485d-81c2-9ebd15f4857c","Type":"ContainerStarted","Data":"e562e00835761077edc78546af72bce63c6fbfed9a5ec67c198affb4004aaa6e"}
Sep 20 02:15:01.741086 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:01.741061    2565 generic.go:356] "Generic (PLEG): container finished" podID="44c98f1b-d773-4821-a530-273a730b5e71" containerID="b4de1033badac182a842c463cb32c6af57c9b0b700fdd9ee89fe9338088e3e47" exitCode=0
Sep 20 02:15:01.741210 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:01.741128    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct" event={"ID":"44c98f1b-d773-4821-a530-273a730b5e71","Type":"ContainerDied","Data":"b4de1033badac182a842c463cb32c6af57c9b0b700fdd9ee89fe9338088e3e47"}
Sep 20 02:15:01.742541 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:01.742520    2565 generic.go:356] "Generic (PLEG): container finished" podID="83e940ec-f8da-4d6d-9c83-4720a41c4c09" containerID="477c12cc2ad75a9cb2affe3e8a250ff7319ceac41ed6f15870636fd4316fa736" exitCode=0
Sep 20 02:15:01.742626 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:01.742557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc" event={"ID":"83e940ec-f8da-4d6d-9c83-4720a41c4c09","Type":"ContainerDied","Data":"477c12cc2ad75a9cb2affe3e8a250ff7319ceac41ed6f15870636fd4316fa736"}
Sep 20 02:15:01.759676 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:01.759610    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4" podStartSLOduration=1.759579376 podStartE2EDuration="1.759579376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:15:01.754898259 +0000 UTC m=+1347.039910195" watchObservedRunningTime="2026-09-20 02:15:01.759579376 +0000 UTC m=+1347.044591311"
Sep 20 02:15:01.804571 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:01.804460    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg" podStartSLOduration=1.804444661 podStartE2EDuration="1.804444661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:15:01.803724687 +0000 UTC m=+1347.088736621" watchObservedRunningTime="2026-09-20 02:15:01.804444661 +0000 UTC m=+1347.089456601"
Sep 20 02:15:02.749941 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:02.749900    2565 generic.go:356] "Generic (PLEG): container finished" podID="4582da82-d733-485d-81c2-9ebd15f4857c" containerID="e562e00835761077edc78546af72bce63c6fbfed9a5ec67c198affb4004aaa6e" exitCode=0
Sep 20 02:15:02.750369 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:02.749988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg" event={"ID":"4582da82-d733-485d-81c2-9ebd15f4857c","Type":"ContainerDied","Data":"e562e00835761077edc78546af72bce63c6fbfed9a5ec67c198affb4004aaa6e"}
Sep 20 02:15:02.751584 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:02.751564    2565 generic.go:356] "Generic (PLEG): container finished" podID="9499b9ab-466f-4571-8637-888129394690" containerID="8872d04cc78c6f53a3564e453d2c762d42fbcf397a5bf000764e9c3e6870d899" exitCode=0
Sep 20 02:15:02.751673 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:02.751619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4" event={"ID":"9499b9ab-466f-4571-8637-888129394690","Type":"ContainerDied","Data":"8872d04cc78c6f53a3564e453d2c762d42fbcf397a5bf000764e9c3e6870d899"}
Sep 20 02:15:02.926646 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:02.926612    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct"
Sep 20 02:15:02.929031 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:02.929006    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc"
Sep 20 02:15:03.758141 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:03.758114    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct"
Sep 20 02:15:03.758596 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:03.758110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct" event={"ID":"44c98f1b-d773-4821-a530-273a730b5e71","Type":"ContainerDied","Data":"4bd4aa995193ffba6bda939a7dd1b8818c8292c5fb8b63ca9a4233ae4f381b72"}
Sep 20 02:15:03.758596 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:03.758240    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bd4aa995193ffba6bda939a7dd1b8818c8292c5fb8b63ca9a4233ae4f381b72"
Sep 20 02:15:03.759523 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:03.759502    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc"
Sep 20 02:15:03.759651 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:03.759537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831175-h57wc" event={"ID":"83e940ec-f8da-4d6d-9c83-4720a41c4c09","Type":"ContainerDied","Data":"a1a61d90f10be9ac38cea3f096aea882998ba66711bcd5992b802338358ec206"}
Sep 20 02:15:03.759651 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:03.759579    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1a61d90f10be9ac38cea3f096aea882998ba66711bcd5992b802338358ec206"
Sep 20 02:15:03.903407 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:03.903383    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg"
Sep 20 02:15:03.932369 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:03.932345    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4"
Sep 20 02:15:04.766320 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:04.766290    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg"
Sep 20 02:15:04.766753 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:04.766330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg" event={"ID":"4582da82-d733-485d-81c2-9ebd15f4857c","Type":"ContainerDied","Data":"9437ac060a206f75a96792b6b7c9b85ebc84c26866dac009ab1ccf5eb7181fc6"}
Sep 20 02:15:04.766753 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:04.766376    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9437ac060a206f75a96792b6b7c9b85ebc84c26866dac009ab1ccf5eb7181fc6"
Sep 20 02:15:04.767646 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:04.767625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4" event={"ID":"9499b9ab-466f-4571-8637-888129394690","Type":"ContainerDied","Data":"0868a9066dcc030c6c7f3be9b81a96f7b67aa863eba53205d9791eb9fb5b5eab"}
Sep 20 02:15:04.767646 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:04.767644    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4"
Sep 20 02:15:04.767828 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:04.767659    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0868a9066dcc030c6c7f3be9b81a96f7b67aa863eba53205d9791eb9fb5b5eab"
Sep 20 02:15:05.844380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844345    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"]
Sep 20 02:15:05.844819 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844784    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9499b9ab-466f-4571-8637-888129394690" containerName="cleanup"
Sep 20 02:15:05.844819 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844812    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9499b9ab-466f-4571-8637-888129394690" containerName="cleanup"
Sep 20 02:15:05.844923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844842    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4582da82-d733-485d-81c2-9ebd15f4857c" containerName="cleanup"
Sep 20 02:15:05.844923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844851    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4582da82-d733-485d-81c2-9ebd15f4857c" containerName="cleanup"
Sep 20 02:15:05.844923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844863    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83e940ec-f8da-4d6d-9c83-4720a41c4c09" containerName="cleanup"
Sep 20 02:15:05.844923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844871    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="83e940ec-f8da-4d6d-9c83-4720a41c4c09" containerName="cleanup"
Sep 20 02:15:05.844923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844890    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44c98f1b-d773-4821-a530-273a730b5e71" containerName="cleanup"
Sep 20 02:15:05.844923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844895    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="44c98f1b-d773-4821-a530-273a730b5e71" containerName="cleanup"
Sep 20 02:15:05.845121 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844959    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4582da82-d733-485d-81c2-9ebd15f4857c" containerName="cleanup"
Sep 20 02:15:05.845121 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844969    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="83e940ec-f8da-4d6d-9c83-4720a41c4c09" containerName="cleanup"
Sep 20 02:15:05.845121 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844976    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9499b9ab-466f-4571-8637-888129394690" containerName="cleanup"
Sep 20 02:15:05.845121 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.844983    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="44c98f1b-d773-4821-a530-273a730b5e71" containerName="cleanup"
Sep 20 02:15:05.848099 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.848083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:05.850434 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.850413    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-317780-dockercfg-47kcq\""
Sep 20 02:15:05.850539 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.850465    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-317780\""
Sep 20 02:15:05.858500 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.858475    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"]
Sep 20 02:15:05.874544 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.874513    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"]
Sep 20 02:15:05.878136 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.878114    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:05.889364 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.889337    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"]
Sep 20 02:15:05.932859 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.932830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74r9x\" (UniqueName: \"kubernetes.io/projected/01fe9a43-7876-4e09-9da1-61b761ae2236-kube-api-access-74r9x\") pod \"payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t\" (UID: \"01fe9a43-7876-4e09-9da1-61b761ae2236\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:05.933007 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:05.932959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01fe9a43-7876-4e09-9da1-61b761ae2236-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t\" (UID: \"01fe9a43-7876-4e09-9da1-61b761ae2236\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:06.033887 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.033854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74r9x\" (UniqueName: \"kubernetes.io/projected/01fe9a43-7876-4e09-9da1-61b761ae2236-kube-api-access-74r9x\") pod \"payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t\" (UID: \"01fe9a43-7876-4e09-9da1-61b761ae2236\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:06.034081 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.034022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj94q\" (UniqueName: \"kubernetes.io/projected/14a20193-20a3-4316-9dba-3f9549696b19-kube-api-access-dj94q\") pod \"payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6\" (UID: \"14a20193-20a3-4316-9dba-3f9549696b19\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:06.034152 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.034089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a20193-20a3-4316-9dba-3f9549696b19-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6\" (UID: \"14a20193-20a3-4316-9dba-3f9549696b19\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:06.034213 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.034148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01fe9a43-7876-4e09-9da1-61b761ae2236-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t\" (UID: \"01fe9a43-7876-4e09-9da1-61b761ae2236\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:06.034750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.034730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01fe9a43-7876-4e09-9da1-61b761ae2236-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t\" (UID: \"01fe9a43-7876-4e09-9da1-61b761ae2236\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:06.044840 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.044812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74r9x\" (UniqueName: \"kubernetes.io/projected/01fe9a43-7876-4e09-9da1-61b761ae2236-kube-api-access-74r9x\") pod \"payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t\" (UID: \"01fe9a43-7876-4e09-9da1-61b761ae2236\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:06.134952 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.134871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj94q\" (UniqueName: \"kubernetes.io/projected/14a20193-20a3-4316-9dba-3f9549696b19-kube-api-access-dj94q\") pod \"payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6\" (UID: \"14a20193-20a3-4316-9dba-3f9549696b19\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:06.134952 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.134933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a20193-20a3-4316-9dba-3f9549696b19-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6\" (UID: \"14a20193-20a3-4316-9dba-3f9549696b19\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:06.135605 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.135585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a20193-20a3-4316-9dba-3f9549696b19-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6\" (UID: \"14a20193-20a3-4316-9dba-3f9549696b19\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:06.142913 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.142886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj94q\" (UniqueName: \"kubernetes.io/projected/14a20193-20a3-4316-9dba-3f9549696b19-kube-api-access-dj94q\") pod \"payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6\" (UID: \"14a20193-20a3-4316-9dba-3f9549696b19\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:06.160697 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.160674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:06.189936 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.189910    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:06.437346 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.437319    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"]
Sep 20 02:15:06.438954 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:15:06.438930    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fe9a43_7876_4e09_9da1_61b761ae2236.slice/crio-a05aa5f815868abb63481cf8fc90941b32ede5c78b6e6a3d3f14884131f80763 WatchSource:0}: Error finding container a05aa5f815868abb63481cf8fc90941b32ede5c78b6e6a3d3f14884131f80763: Status 404 returned error can't find the container with id a05aa5f815868abb63481cf8fc90941b32ede5c78b6e6a3d3f14884131f80763
Sep 20 02:15:06.468489 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.468461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"]
Sep 20 02:15:06.470005 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:15:06.469981    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a20193_20a3_4316_9dba_3f9549696b19.slice/crio-37875de028caa8226e8942dded098475d6dc8f90c966578237ddb16a68e7e947 WatchSource:0}: Error finding container 37875de028caa8226e8942dded098475d6dc8f90c966578237ddb16a68e7e947: Status 404 returned error can't find the container with id 37875de028caa8226e8942dded098475d6dc8f90c966578237ddb16a68e7e947
Sep 20 02:15:06.781298 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.781257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t" event={"ID":"01fe9a43-7876-4e09-9da1-61b761ae2236","Type":"ContainerStarted","Data":"00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df"}
Sep 20 02:15:06.781506 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.781323    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t" event={"ID":"01fe9a43-7876-4e09-9da1-61b761ae2236","Type":"ContainerStarted","Data":"a05aa5f815868abb63481cf8fc90941b32ede5c78b6e6a3d3f14884131f80763"}
Sep 20 02:15:06.781506 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.781354    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:06.783212 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.783183    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6" event={"ID":"14a20193-20a3-4316-9dba-3f9549696b19","Type":"ContainerStarted","Data":"ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd"}
Sep 20 02:15:06.783310 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.783241    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:06.783310 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.783264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6" event={"ID":"14a20193-20a3-4316-9dba-3f9549696b19","Type":"ContainerStarted","Data":"37875de028caa8226e8942dded098475d6dc8f90c966578237ddb16a68e7e947"}
Sep 20 02:15:06.799299 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.799246    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t" podStartSLOduration=1.7992273810000001 podStartE2EDuration="1.799227381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:15:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:15:06.797914205 +0000 UTC m=+1352.082926143" watchObservedRunningTime="2026-09-20 02:15:06.799227381 +0000 UTC m=+1352.084239315"
Sep 20 02:15:06.815023 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:06.814975    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6" podStartSLOduration=1.814955624 podStartE2EDuration="1.814955624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:15:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:15:06.813194816 +0000 UTC m=+1352.098206764" watchObservedRunningTime="2026-09-20 02:15:06.814955624 +0000 UTC m=+1352.099967566"
Sep 20 02:15:17.792912 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:17.792878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:15:17.793357 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:17.792952    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:15:35.351286 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:35.351255    2565 scope.go:117] "RemoveContainer" containerID="9f2973177abd0b31f086e17cc91b77eb854d9ef056d4ba46ea21bb67e9989c55"
Sep 20 02:15:35.359813 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:15:35.359772    2565 scope.go:117] "RemoveContainer" containerID="89704f84a95b271ab18a55fab1409c7be861247ba6da503bf91d17d9a03c0038"
Sep 20 02:16:20.730810 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:20.730755    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"]
Sep 20 02:16:20.734602 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:20.734586    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"
Sep 20 02:16:20.737416 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:20.737390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:16:20.737416 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:20.737412    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:16:20.741998 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:20.741956    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"]
Sep 20 02:16:20.900719 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:20.900675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a4a738-9c48-4b79-8cf2-861c7cb94a4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f5813346-7vrhg\" (UID: \"c5a4a738-9c48-4b79-8cf2-861c7cb94a4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"
Sep 20 02:16:21.001503 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:21.001477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a4a738-9c48-4b79-8cf2-861c7cb94a4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f5813346-7vrhg\" (UID: \"c5a4a738-9c48-4b79-8cf2-861c7cb94a4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"
Sep 20 02:16:21.002147 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:21.002126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a4a738-9c48-4b79-8cf2-861c7cb94a4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f5813346-7vrhg\" (UID: \"c5a4a738-9c48-4b79-8cf2-861c7cb94a4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"
Sep 20 02:16:21.045967 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:21.045940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"
Sep 20 02:16:21.319454 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:21.319429    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"]
Sep 20 02:16:21.321248 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:16:21.321223    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a4a738_9c48_4b79_8cf2_861c7cb94a4a.slice/crio-84dfdbe7ee9ddbd485b7e172babbdd3c84fa0eecd4747b3ca81d44515e0dd7e1 WatchSource:0}: Error finding container 84dfdbe7ee9ddbd485b7e172babbdd3c84fa0eecd4747b3ca81d44515e0dd7e1: Status 404 returned error can't find the container with id 84dfdbe7ee9ddbd485b7e172babbdd3c84fa0eecd4747b3ca81d44515e0dd7e1
Sep 20 02:16:22.215288 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:22.215257    2565 generic.go:356] "Generic (PLEG): container finished" podID="c5a4a738-9c48-4b79-8cf2-861c7cb94a4a" containerID="08d3c0cd8df1708438c25becd4e68bb81dfb84b993fbb4c301276598914b7247" exitCode=0
Sep 20 02:16:22.215660 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:22.215297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg" event={"ID":"c5a4a738-9c48-4b79-8cf2-861c7cb94a4a","Type":"ContainerDied","Data":"08d3c0cd8df1708438c25becd4e68bb81dfb84b993fbb4c301276598914b7247"}
Sep 20 02:16:22.215660 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:22.215326    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg" event={"ID":"c5a4a738-9c48-4b79-8cf2-861c7cb94a4a","Type":"ContainerStarted","Data":"84dfdbe7ee9ddbd485b7e172babbdd3c84fa0eecd4747b3ca81d44515e0dd7e1"}
Sep 20 02:16:23.375469 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:23.375447    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"
Sep 20 02:16:23.426694 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:23.426654    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a4a738-9c48-4b79-8cf2-861c7cb94a4a-maas-api-service-ca\") pod \"c5a4a738-9c48-4b79-8cf2-861c7cb94a4a\" (UID: \"c5a4a738-9c48-4b79-8cf2-861c7cb94a4a\") "
Sep 20 02:16:23.427046 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:23.427024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5a4a738-9c48-4b79-8cf2-861c7cb94a4a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5a4a738-9c48-4b79-8cf2-861c7cb94a4a" (UID: "c5a4a738-9c48-4b79-8cf2-861c7cb94a4a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:16:23.528380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:23.528344    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5a4a738-9c48-4b79-8cf2-861c7cb94a4a-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:16:24.232254 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:24.232222    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"
Sep 20 02:16:24.232426 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:24.232265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg" event={"ID":"c5a4a738-9c48-4b79-8cf2-861c7cb94a4a","Type":"ContainerDied","Data":"84dfdbe7ee9ddbd485b7e172babbdd3c84fa0eecd4747b3ca81d44515e0dd7e1"}
Sep 20 02:16:24.232426 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:24.232311    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84dfdbe7ee9ddbd485b7e172babbdd3c84fa0eecd4747b3ca81d44515e0dd7e1"
Sep 20 02:16:35.383633 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:35.383559    2565 scope.go:117] "RemoveContainer" containerID="2f608529e339012be0354a18c90b373670e218701b7948fe4b6ee6576bc18a3c"
Sep 20 02:16:36.427885 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.427850    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"]
Sep 20 02:16:36.428346 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.428128    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv" podUID="40f91726-b0ca-4776-a4b9-73dcf2398d61" containerName="payload-pre-processing" containerID="cri-o://dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef" gracePeriod=30
Sep 20 02:16:36.611486 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.611447    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"]
Sep 20 02:16:36.613850 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.613822    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f5813346-7vrhg"]
Sep 20 02:16:36.692625 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.692549    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:16:36.755675 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.755647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n88s\" (UniqueName: \"kubernetes.io/projected/40f91726-b0ca-4776-a4b9-73dcf2398d61-kube-api-access-2n88s\") pod \"40f91726-b0ca-4776-a4b9-73dcf2398d61\" (UID: \"40f91726-b0ca-4776-a4b9-73dcf2398d61\") "
Sep 20 02:16:36.755886 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.755866    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40f91726-b0ca-4776-a4b9-73dcf2398d61-plugins-config-volume\") pod \"40f91726-b0ca-4776-a4b9-73dcf2398d61\" (UID: \"40f91726-b0ca-4776-a4b9-73dcf2398d61\") "
Sep 20 02:16:36.756207 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.756186    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40f91726-b0ca-4776-a4b9-73dcf2398d61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40f91726-b0ca-4776-a4b9-73dcf2398d61" (UID: "40f91726-b0ca-4776-a4b9-73dcf2398d61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:16:36.757866 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.757835    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40f91726-b0ca-4776-a4b9-73dcf2398d61-kube-api-access-2n88s" (OuterVolumeSpecName: "kube-api-access-2n88s") pod "40f91726-b0ca-4776-a4b9-73dcf2398d61" (UID: "40f91726-b0ca-4776-a4b9-73dcf2398d61"). InnerVolumeSpecName "kube-api-access-2n88s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:16:36.857145 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.857107    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40f91726-b0ca-4776-a4b9-73dcf2398d61-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:16:36.857145 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:36.857138    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n88s\" (UniqueName: \"kubernetes.io/projected/40f91726-b0ca-4776-a4b9-73dcf2398d61-kube-api-access-2n88s\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:16:37.221170 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.221138    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5a4a738-9c48-4b79-8cf2-861c7cb94a4a" path="/var/lib/kubelet/pods/c5a4a738-9c48-4b79-8cf2-861c7cb94a4a/volumes"
Sep 20 02:16:37.306142 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.306108    2565 generic.go:356] "Generic (PLEG): container finished" podID="40f91726-b0ca-4776-a4b9-73dcf2398d61" containerID="dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef" exitCode=0
Sep 20 02:16:37.306324 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.306159    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"
Sep 20 02:16:37.306324 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.306186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv" event={"ID":"40f91726-b0ca-4776-a4b9-73dcf2398d61","Type":"ContainerDied","Data":"dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef"}
Sep 20 02:16:37.306324 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.306239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv" event={"ID":"40f91726-b0ca-4776-a4b9-73dcf2398d61","Type":"ContainerDied","Data":"5e9d135750d294de0fddccd68b3cd511d726252b5a69b4e358f3333ec988d8ac"}
Sep 20 02:16:37.306324 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.306267    2565 scope.go:117] "RemoveContainer" containerID="dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef"
Sep 20 02:16:37.315252 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.315232    2565 scope.go:117] "RemoveContainer" containerID="dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef"
Sep 20 02:16:37.315535 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:16:37.315511    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef\": container with ID starting with dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef not found: ID does not exist" containerID="dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef"
Sep 20 02:16:37.315582 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.315548    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef"} err="failed to get container status \"dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef\": rpc error: code = NotFound desc = could not find container \"dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef\": container with ID starting with dde684658c3f02c59b6bec233959bf61a7a1c1268f2dab211963f9be0ceec7ef not found: ID does not exist"
Sep 20 02:16:37.325958 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.325933    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"]
Sep 20 02:16:37.332260 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:37.332230    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv"]
Sep 20 02:16:39.222078 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:16:39.222033    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40f91726-b0ca-4776-a4b9-73dcf2398d61" path="/var/lib/kubelet/pods/40f91726-b0ca-4776-a4b9-73dcf2398d61/volumes"
Sep 20 02:17:35.404607 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:17:35.404574    2565 scope.go:117] "RemoveContainer" containerID="a558a9c6c5105f2c7dd278da12a7f664b99ea85af5b1c0a96adcb1736ca051e2"
Sep 20 02:18:35.428592 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:35.428559    2565 scope.go:117] "RemoveContainer" containerID="920896042d37ca3011aba011115bbd7cf03e16616c267727fdec4101fab3469f"
Sep 20 02:18:45.504318 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.504288    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"]
Sep 20 02:18:45.506665 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.504713    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5a4a738-9c48-4b79-8cf2-861c7cb94a4a" containerName="revoke-keys"
Sep 20 02:18:45.506665 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.504724    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5a4a738-9c48-4b79-8cf2-861c7cb94a4a" containerName="revoke-keys"
Sep 20 02:18:45.506665 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.504748    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f91726-b0ca-4776-a4b9-73dcf2398d61" containerName="payload-pre-processing"
Sep 20 02:18:45.506665 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.504753    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f91726-b0ca-4776-a4b9-73dcf2398d61" containerName="payload-pre-processing"
Sep 20 02:18:45.506665 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.504833    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5a4a738-9c48-4b79-8cf2-861c7cb94a4a" containerName="revoke-keys"
Sep 20 02:18:45.506665 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.504845    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f91726-b0ca-4776-a4b9-73dcf2398d61" containerName="payload-pre-processing"
Sep 20 02:18:45.507715 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.507700    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:45.509871 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.509850    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a66f8f\""
Sep 20 02:18:45.517300 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.517280    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"]
Sep 20 02:18:45.545934 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.545906    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"]
Sep 20 02:18:45.549413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.549398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:18:45.551551 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.551533    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a66f8f-dockercfg-4bjlq\""
Sep 20 02:18:45.551768 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.551749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2ccr\" (UniqueName: \"kubernetes.io/projected/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-kube-api-access-p2ccr\") pod \"payload-processing-e2e-api-a-a66f8f-64df657685-h64qp\" (UID: \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\") " pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:18:45.551842 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.551780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a66f8f-64df657685-h64qp\" (UID: \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\") " pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:18:45.551882 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.551858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntsvt\" (UniqueName: \"kubernetes.io/projected/75a34468-1411-42e6-9fa3-18bd1c746170-kube-api-access-ntsvt\") pod \"payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7\" (UID: \"75a34468-1411-42e6-9fa3-18bd1c746170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:45.551928 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.551910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a34468-1411-42e6-9fa3-18bd1c746170-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7\" (UID: \"75a34468-1411-42e6-9fa3-18bd1c746170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:45.560724 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.560705    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"]
Sep 20 02:18:45.653278 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.653242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a66f8f-64df657685-h64qp\" (UID: \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\") " pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:18:45.655328 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.655302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntsvt\" (UniqueName: \"kubernetes.io/projected/75a34468-1411-42e6-9fa3-18bd1c746170-kube-api-access-ntsvt\") pod \"payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7\" (UID: \"75a34468-1411-42e6-9fa3-18bd1c746170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:45.655549 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.655532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a34468-1411-42e6-9fa3-18bd1c746170-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7\" (UID: \"75a34468-1411-42e6-9fa3-18bd1c746170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:45.656610 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.656589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2ccr\" (UniqueName: \"kubernetes.io/projected/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-kube-api-access-p2ccr\") pod \"payload-processing-e2e-api-a-a66f8f-64df657685-h64qp\" (UID: \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\") " pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:18:45.657081 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.654410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a66f8f-64df657685-h64qp\" (UID: \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\") " pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:18:45.657225 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.656391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a34468-1411-42e6-9fa3-18bd1c746170-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7\" (UID: \"75a34468-1411-42e6-9fa3-18bd1c746170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:45.665570 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.665542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntsvt\" (UniqueName: \"kubernetes.io/projected/75a34468-1411-42e6-9fa3-18bd1c746170-kube-api-access-ntsvt\") pod \"payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7\" (UID: \"75a34468-1411-42e6-9fa3-18bd1c746170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:45.665570 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.665560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2ccr\" (UniqueName: \"kubernetes.io/projected/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-kube-api-access-p2ccr\") pod \"payload-processing-e2e-api-a-a66f8f-64df657685-h64qp\" (UID: \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\") " pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:18:45.819614 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.819525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:45.859527 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:45.859454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:18:46.095023 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:46.094997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"]
Sep 20 02:18:46.096538 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:18:46.096514    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a34468_1411_42e6_9fa3_18bd1c746170.slice/crio-518dad3d7ea863c037250a7f1fd6757174df0eaf796ba3349bf2d73c9345d59d WatchSource:0}: Error finding container 518dad3d7ea863c037250a7f1fd6757174df0eaf796ba3349bf2d73c9345d59d: Status 404 returned error can't find the container with id 518dad3d7ea863c037250a7f1fd6757174df0eaf796ba3349bf2d73c9345d59d
Sep 20 02:18:46.148920 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:46.148894    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"]
Sep 20 02:18:46.152011 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:18:46.151983    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6a4876_1a4c_402a_978e_0140a1d6a0cd.slice/crio-e5d5d5cf103582b4a5675b20669a11204e963cf64c6e5a988feef38f49ff700a WatchSource:0}: Error finding container e5d5d5cf103582b4a5675b20669a11204e963cf64c6e5a988feef38f49ff700a: Status 404 returned error can't find the container with id e5d5d5cf103582b4a5675b20669a11204e963cf64c6e5a988feef38f49ff700a
Sep 20 02:18:47.038269 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:47.038233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp" event={"ID":"ce6a4876-1a4c-402a-978e-0140a1d6a0cd","Type":"ContainerStarted","Data":"279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c"}
Sep 20 02:18:47.038775 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:47.038286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp" event={"ID":"ce6a4876-1a4c-402a-978e-0140a1d6a0cd","Type":"ContainerStarted","Data":"e5d5d5cf103582b4a5675b20669a11204e963cf64c6e5a988feef38f49ff700a"}
Sep 20 02:18:47.038775 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:47.038349    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:18:47.039939 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:47.039918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7" event={"ID":"75a34468-1411-42e6-9fa3-18bd1c746170","Type":"ContainerStarted","Data":"0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227"}
Sep 20 02:18:47.040037 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:47.039957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7" event={"ID":"75a34468-1411-42e6-9fa3-18bd1c746170","Type":"ContainerStarted","Data":"518dad3d7ea863c037250a7f1fd6757174df0eaf796ba3349bf2d73c9345d59d"}
Sep 20 02:18:47.040037 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:47.039979    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:47.058001 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:47.057948    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp" podStartSLOduration=2.057929741 podStartE2EDuration="2.057929741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:18:47.054245285 +0000 UTC m=+1572.339257221" watchObservedRunningTime="2026-09-20 02:18:47.057929741 +0000 UTC m=+1572.342941680"
Sep 20 02:18:47.071950 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:47.071910    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7" podStartSLOduration=2.071895964 podStartE2EDuration="2.071895964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:18:47.070521073 +0000 UTC m=+1572.355533009" watchObservedRunningTime="2026-09-20 02:18:47.071895964 +0000 UTC m=+1572.356907899"
Sep 20 02:18:58.048983 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:58.048948    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:18:58.049597 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:18:58.049421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:19:20.728195 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.728160    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"]
Sep 20 02:19:20.733091 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.733069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:20.735670 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.735647    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-dd1246-dockercfg-jfgsz\""
Sep 20 02:19:20.735763 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.735647    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-dd1246\""
Sep 20 02:19:20.741992 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.741963    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"]
Sep 20 02:19:20.821817 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.821737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0724e4f6-0274-4948-966b-c64b06608d42-plugins-config-volume\") pod \"payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692\" (UID: \"0724e4f6-0274-4948-966b-c64b06608d42\") " pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:20.822051 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.821953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmhz6\" (UniqueName: \"kubernetes.io/projected/0724e4f6-0274-4948-966b-c64b06608d42-kube-api-access-vmhz6\") pod \"payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692\" (UID: \"0724e4f6-0274-4948-966b-c64b06608d42\") " pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:20.922965 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.922925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhz6\" (UniqueName: \"kubernetes.io/projected/0724e4f6-0274-4948-966b-c64b06608d42-kube-api-access-vmhz6\") pod \"payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692\" (UID: \"0724e4f6-0274-4948-966b-c64b06608d42\") " pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:20.923173 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.922983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0724e4f6-0274-4948-966b-c64b06608d42-plugins-config-volume\") pod \"payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692\" (UID: \"0724e4f6-0274-4948-966b-c64b06608d42\") " pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:20.923655 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.923635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0724e4f6-0274-4948-966b-c64b06608d42-plugins-config-volume\") pod \"payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692\" (UID: \"0724e4f6-0274-4948-966b-c64b06608d42\") " pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:20.930978 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:20.930954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmhz6\" (UniqueName: \"kubernetes.io/projected/0724e4f6-0274-4948-966b-c64b06608d42-kube-api-access-vmhz6\") pod \"payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692\" (UID: \"0724e4f6-0274-4948-966b-c64b06608d42\") " pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:21.046334 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:21.046299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:21.319820 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:21.319776    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"]
Sep 20 02:19:21.321237 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:19:21.321214    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0724e4f6_0274_4948_966b_c64b06608d42.slice/crio-f9af6c750c55087a6607387e95b8d21e989aec71156c39211f66d9fcfc417051 WatchSource:0}: Error finding container f9af6c750c55087a6607387e95b8d21e989aec71156c39211f66d9fcfc417051: Status 404 returned error can't find the container with id f9af6c750c55087a6607387e95b8d21e989aec71156c39211f66d9fcfc417051
Sep 20 02:19:22.262785 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:22.262740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692" event={"ID":"0724e4f6-0274-4948-966b-c64b06608d42","Type":"ContainerStarted","Data":"7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb"}
Sep 20 02:19:22.263176 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:22.262817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692" event={"ID":"0724e4f6-0274-4948-966b-c64b06608d42","Type":"ContainerStarted","Data":"f9af6c750c55087a6607387e95b8d21e989aec71156c39211f66d9fcfc417051"}
Sep 20 02:19:22.263176 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:22.262953    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:22.284809 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:22.282220    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692" podStartSLOduration=2.282192942 podStartE2EDuration="2.282192942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:19:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:19:22.278627735 +0000 UTC m=+1607.563639671" watchObservedRunningTime="2026-09-20 02:19:22.282192942 +0000 UTC m=+1607.567204878"
Sep 20 02:19:32.675871 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:32.675778    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"]
Sep 20 02:19:32.679679 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:32.679660    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"
Sep 20 02:19:32.682377 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:32.682351    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:19:32.683316 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:32.683114    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:19:32.685930 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:32.685906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"]
Sep 20 02:19:32.742325 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:32.742292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a539f2dc-5a5e-43b2-acd8-ee179a81fbd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg\" (UID: \"a539f2dc-5a5e-43b2-acd8-ee179a81fbd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"
Sep 20 02:19:32.844029 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:32.843989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a539f2dc-5a5e-43b2-acd8-ee179a81fbd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg\" (UID: \"a539f2dc-5a5e-43b2-acd8-ee179a81fbd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"
Sep 20 02:19:32.844627 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:32.844604    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a539f2dc-5a5e-43b2-acd8-ee179a81fbd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg\" (UID: \"a539f2dc-5a5e-43b2-acd8-ee179a81fbd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"
Sep 20 02:19:32.992507 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:32.992479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"
Sep 20 02:19:33.263999 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:33.263973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"]
Sep 20 02:19:33.266206 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:19:33.266175    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda539f2dc_5a5e_43b2_acd8_ee179a81fbd0.slice/crio-2e6c95d70ddb0ac860eb9f67080373e015de7b5179560434319fe417ce68b6b6 WatchSource:0}: Error finding container 2e6c95d70ddb0ac860eb9f67080373e015de7b5179560434319fe417ce68b6b6: Status 404 returned error can't find the container with id 2e6c95d70ddb0ac860eb9f67080373e015de7b5179560434319fe417ce68b6b6
Sep 20 02:19:33.269700 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:33.269678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:19:33.334932 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:33.334877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg" event={"ID":"a539f2dc-5a5e-43b2-acd8-ee179a81fbd0","Type":"ContainerStarted","Data":"2e6c95d70ddb0ac860eb9f67080373e015de7b5179560434319fe417ce68b6b6"}
Sep 20 02:19:34.341781 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:34.341743    2565 generic.go:356] "Generic (PLEG): container finished" podID="a539f2dc-5a5e-43b2-acd8-ee179a81fbd0" containerID="11fa0e31331ac79146ba4912424d06d4cc25be54672fa748eb146fa00582c559" exitCode=0
Sep 20 02:19:34.342184 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:34.341817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg" event={"ID":"a539f2dc-5a5e-43b2-acd8-ee179a81fbd0","Type":"ContainerDied","Data":"11fa0e31331ac79146ba4912424d06d4cc25be54672fa748eb146fa00582c559"}
Sep 20 02:19:35.448414 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:35.448384    2565 scope.go:117] "RemoveContainer" containerID="15902c48fa6688aead558436ca3c6b2d03d3065339b0e71cad81c42cc9e10673"
Sep 20 02:19:35.458767 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:35.458744    2565 scope.go:117] "RemoveContainer" containerID="58b50afce35467cfb6c23df2e396f28c9dbe8ec6a40db574c04a7eced18e2dd6"
Sep 20 02:19:35.497727 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:35.497705    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"
Sep 20 02:19:35.571144 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:35.571113    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a539f2dc-5a5e-43b2-acd8-ee179a81fbd0-maas-api-service-ca\") pod \"a539f2dc-5a5e-43b2-acd8-ee179a81fbd0\" (UID: \"a539f2dc-5a5e-43b2-acd8-ee179a81fbd0\") "
Sep 20 02:19:35.571519 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:35.571499    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a539f2dc-5a5e-43b2-acd8-ee179a81fbd0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a539f2dc-5a5e-43b2-acd8-ee179a81fbd0" (UID: "a539f2dc-5a5e-43b2-acd8-ee179a81fbd0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:19:35.672837 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:35.672734    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a539f2dc-5a5e-43b2-acd8-ee179a81fbd0-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:19:36.354462 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:36.354436    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"
Sep 20 02:19:36.354462 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:36.354448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg" event={"ID":"a539f2dc-5a5e-43b2-acd8-ee179a81fbd0","Type":"ContainerDied","Data":"2e6c95d70ddb0ac860eb9f67080373e015de7b5179560434319fe417ce68b6b6"}
Sep 20 02:19:36.354722 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:36.354508    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e6c95d70ddb0ac860eb9f67080373e015de7b5179560434319fe417ce68b6b6"
Sep 20 02:19:47.154529 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.154494    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"]
Sep 20 02:19:47.155039 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.155024    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a539f2dc-5a5e-43b2-acd8-ee179a81fbd0" containerName="revoke-keys"
Sep 20 02:19:47.155087 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.155041    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a539f2dc-5a5e-43b2-acd8-ee179a81fbd0" containerName="revoke-keys"
Sep 20 02:19:47.155122 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.155116    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a539f2dc-5a5e-43b2-acd8-ee179a81fbd0" containerName="revoke-keys"
Sep 20 02:19:47.158445 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.158428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"
Sep 20 02:19:47.160610 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.160587    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:19:47.160610 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.160587    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:19:47.166187 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.165692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"]
Sep 20 02:19:47.288511 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.288474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75d50216-07ee-477f-a51e-356e2c6e7da1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd\" (UID: \"75d50216-07ee-477f-a51e-356e2c6e7da1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"
Sep 20 02:19:47.389473 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.389434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75d50216-07ee-477f-a51e-356e2c6e7da1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd\" (UID: \"75d50216-07ee-477f-a51e-356e2c6e7da1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"
Sep 20 02:19:47.390120 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.390102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75d50216-07ee-477f-a51e-356e2c6e7da1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd\" (UID: \"75d50216-07ee-477f-a51e-356e2c6e7da1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"
Sep 20 02:19:47.469700 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.469614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"
Sep 20 02:19:47.748371 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:47.748345    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"]
Sep 20 02:19:47.749518 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:19:47.749491    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d50216_07ee_477f_a51e_356e2c6e7da1.slice/crio-41c84415feda5efdbf197322f50525334a441c1205762a943add4b1e4d9152da WatchSource:0}: Error finding container 41c84415feda5efdbf197322f50525334a441c1205762a943add4b1e4d9152da: Status 404 returned error can't find the container with id 41c84415feda5efdbf197322f50525334a441c1205762a943add4b1e4d9152da
Sep 20 02:19:48.426835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:48.426715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd" event={"ID":"75d50216-07ee-477f-a51e-356e2c6e7da1","Type":"ContainerStarted","Data":"3e7642b1ad59e9fdf8037f5ab492ef15165fd38836f04a54828a48d760656a83"}
Sep 20 02:19:48.426835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:48.426779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd" event={"ID":"75d50216-07ee-477f-a51e-356e2c6e7da1","Type":"ContainerStarted","Data":"41c84415feda5efdbf197322f50525334a441c1205762a943add4b1e4d9152da"}
Sep 20 02:19:48.446373 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:48.446321    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd" podStartSLOduration=1.446301855 podStartE2EDuration="1.446301855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:19:48.444022274 +0000 UTC m=+1633.729034209" watchObservedRunningTime="2026-09-20 02:19:48.446301855 +0000 UTC m=+1633.731313802"
Sep 20 02:19:49.433078 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:49.433040    2565 generic.go:356] "Generic (PLEG): container finished" podID="75d50216-07ee-477f-a51e-356e2c6e7da1" containerID="3e7642b1ad59e9fdf8037f5ab492ef15165fd38836f04a54828a48d760656a83" exitCode=0
Sep 20 02:19:49.433462 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:49.433127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd" event={"ID":"75d50216-07ee-477f-a51e-356e2c6e7da1","Type":"ContainerDied","Data":"3e7642b1ad59e9fdf8037f5ab492ef15165fd38836f04a54828a48d760656a83"}
Sep 20 02:19:50.579568 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:50.579534    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"
Sep 20 02:19:50.622184 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:50.622141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75d50216-07ee-477f-a51e-356e2c6e7da1-maas-api-service-ca\") pod \"75d50216-07ee-477f-a51e-356e2c6e7da1\" (UID: \"75d50216-07ee-477f-a51e-356e2c6e7da1\") "
Sep 20 02:19:50.622518 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:50.622493    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75d50216-07ee-477f-a51e-356e2c6e7da1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "75d50216-07ee-477f-a51e-356e2c6e7da1" (UID: "75d50216-07ee-477f-a51e-356e2c6e7da1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:19:50.622626 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:50.622591    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75d50216-07ee-477f-a51e-356e2c6e7da1-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:19:51.446084 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:51.446054    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"
Sep 20 02:19:51.446256 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:51.446094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd" event={"ID":"75d50216-07ee-477f-a51e-356e2c6e7da1","Type":"ContainerDied","Data":"41c84415feda5efdbf197322f50525334a441c1205762a943add4b1e4d9152da"}
Sep 20 02:19:51.446256 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:51.446147    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41c84415feda5efdbf197322f50525334a441c1205762a943add4b1e4d9152da"
Sep 20 02:19:52.218810 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.218751    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4"]
Sep 20 02:19:52.220990 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.220959    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8195ba-29831175-cnzg4"]
Sep 20 02:19:52.247962 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.247918    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"]
Sep 20 02:19:52.248232 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.248180    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg" podUID="c4007c92-8a1a-4000-84cd-089129df49c3" containerName="payload-processing" containerID="cri-o://7af39ca2c98395e96cef9283a704456d4d54c082817f65920e3f7cca671db4d9" gracePeriod=30
Sep 20 02:19:52.256861 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.256830    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"]
Sep 20 02:19:52.258948 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.257050    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m" podUID="a9653942-e600-49d5-8bf8-dab0b1e7a167" containerName="payload-pre-processing" containerID="cri-o://1f881e0ac44487bdec5f70834d9e18354505a41eeece0826c0d5effe4e2bf18a" gracePeriod=30
Sep 20 02:19:52.422734 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.422701    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"]
Sep 20 02:19:52.428384 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.428352    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8195ba-n5gkg"]
Sep 20 02:19:52.454632 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.454599    2565 generic.go:356] "Generic (PLEG): container finished" podID="a9653942-e600-49d5-8bf8-dab0b1e7a167" containerID="1f881e0ac44487bdec5f70834d9e18354505a41eeece0826c0d5effe4e2bf18a" exitCode=0
Sep 20 02:19:52.454833 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.454679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m" event={"ID":"a9653942-e600-49d5-8bf8-dab0b1e7a167","Type":"ContainerDied","Data":"1f881e0ac44487bdec5f70834d9e18354505a41eeece0826c0d5effe4e2bf18a"}
Sep 20 02:19:52.457202 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.457165    2565 generic.go:356] "Generic (PLEG): container finished" podID="c4007c92-8a1a-4000-84cd-089129df49c3" containerID="7af39ca2c98395e96cef9283a704456d4d54c082817f65920e3f7cca671db4d9" exitCode=0
Sep 20 02:19:52.457337 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.457248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg" event={"ID":"c4007c92-8a1a-4000-84cd-089129df49c3","Type":"ContainerDied","Data":"7af39ca2c98395e96cef9283a704456d4d54c082817f65920e3f7cca671db4d9"}
Sep 20 02:19:52.525680 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.525379    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:19:52.541080 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.540275    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4007c92-8a1a-4000-84cd-089129df49c3-plugins-config-volume\") pod \"c4007c92-8a1a-4000-84cd-089129df49c3\" (UID: \"c4007c92-8a1a-4000-84cd-089129df49c3\") "
Sep 20 02:19:52.541080 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.540333    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45w6k\" (UniqueName: \"kubernetes.io/projected/c4007c92-8a1a-4000-84cd-089129df49c3-kube-api-access-45w6k\") pod \"c4007c92-8a1a-4000-84cd-089129df49c3\" (UID: \"c4007c92-8a1a-4000-84cd-089129df49c3\") "
Sep 20 02:19:52.541744 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.541560    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4007c92-8a1a-4000-84cd-089129df49c3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c4007c92-8a1a-4000-84cd-089129df49c3" (UID: "c4007c92-8a1a-4000-84cd-089129df49c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:19:52.544363 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.544282    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4007c92-8a1a-4000-84cd-089129df49c3-kube-api-access-45w6k" (OuterVolumeSpecName: "kube-api-access-45w6k") pod "c4007c92-8a1a-4000-84cd-089129df49c3" (UID: "c4007c92-8a1a-4000-84cd-089129df49c3"). InnerVolumeSpecName "kube-api-access-45w6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:19:52.566281 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.566227    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:19:52.641461 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.641430    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9653942-e600-49d5-8bf8-dab0b1e7a167-plugins-config-volume\") pod \"a9653942-e600-49d5-8bf8-dab0b1e7a167\" (UID: \"a9653942-e600-49d5-8bf8-dab0b1e7a167\") "
Sep 20 02:19:52.641461 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.641466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqldl\" (UniqueName: \"kubernetes.io/projected/a9653942-e600-49d5-8bf8-dab0b1e7a167-kube-api-access-sqldl\") pod \"a9653942-e600-49d5-8bf8-dab0b1e7a167\" (UID: \"a9653942-e600-49d5-8bf8-dab0b1e7a167\") "
Sep 20 02:19:52.641908 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.641679    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4007c92-8a1a-4000-84cd-089129df49c3-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:19:52.641908 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.641699    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45w6k\" (UniqueName: \"kubernetes.io/projected/c4007c92-8a1a-4000-84cd-089129df49c3-kube-api-access-45w6k\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:19:52.642010 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.641899    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9653942-e600-49d5-8bf8-dab0b1e7a167-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a9653942-e600-49d5-8bf8-dab0b1e7a167" (UID: "a9653942-e600-49d5-8bf8-dab0b1e7a167"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:19:52.644067 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.644044    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9653942-e600-49d5-8bf8-dab0b1e7a167-kube-api-access-sqldl" (OuterVolumeSpecName: "kube-api-access-sqldl") pod "a9653942-e600-49d5-8bf8-dab0b1e7a167" (UID: "a9653942-e600-49d5-8bf8-dab0b1e7a167"). InnerVolumeSpecName "kube-api-access-sqldl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:19:52.742621 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.742589    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9653942-e600-49d5-8bf8-dab0b1e7a167-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:19:52.742621 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:52.742619    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqldl\" (UniqueName: \"kubernetes.io/projected/a9653942-e600-49d5-8bf8-dab0b1e7a167-kube-api-access-sqldl\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:19:53.221264 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.221192    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9499b9ab-466f-4571-8637-888129394690" path="/var/lib/kubelet/pods/9499b9ab-466f-4571-8637-888129394690/volumes"
Sep 20 02:19:53.221608 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.221468    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a539f2dc-5a5e-43b2-acd8-ee179a81fbd0" path="/var/lib/kubelet/pods/a539f2dc-5a5e-43b2-acd8-ee179a81fbd0/volumes"
Sep 20 02:19:53.463855 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.463816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg" event={"ID":"c4007c92-8a1a-4000-84cd-089129df49c3","Type":"ContainerDied","Data":"641a5127c65c42cf7958cde9643925e838b09db7f757b1f7738513a01ff934ab"}
Sep 20 02:19:53.464058 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.463828    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"
Sep 20 02:19:53.464058 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.463885    2565 scope.go:117] "RemoveContainer" containerID="7af39ca2c98395e96cef9283a704456d4d54c082817f65920e3f7cca671db4d9"
Sep 20 02:19:53.465409 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.465355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m" event={"ID":"a9653942-e600-49d5-8bf8-dab0b1e7a167","Type":"ContainerDied","Data":"d0d4cfc5773f400180e73cce301fed4b5734438aea1f9a0b0cbdf02beed2e3e7"}
Sep 20 02:19:53.465409 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.465366    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"
Sep 20 02:19:53.473145 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.473118    2565 scope.go:117] "RemoveContainer" containerID="1f881e0ac44487bdec5f70834d9e18354505a41eeece0826c0d5effe4e2bf18a"
Sep 20 02:19:53.482814 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.482775    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"]
Sep 20 02:19:53.487259 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.487234    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg"]
Sep 20 02:19:53.496250 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.496223    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"]
Sep 20 02:19:53.502135 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:53.502106    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m"]
Sep 20 02:19:55.221954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:55.221924    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9653942-e600-49d5-8bf8-dab0b1e7a167" path="/var/lib/kubelet/pods/a9653942-e600-49d5-8bf8-dab0b1e7a167/volumes"
Sep 20 02:19:55.222336 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:55.222293    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4007c92-8a1a-4000-84cd-089129df49c3" path="/var/lib/kubelet/pods/c4007c92-8a1a-4000-84cd-089129df49c3/volumes"
Sep 20 02:19:59.362615 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:59.362580    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"]
Sep 20 02:19:59.363114 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:19:59.362816    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy" containerID="cri-o://4771022fb01a97960580af8f222a4dde11e5f74dff55be3e4d5089f3df580558" gracePeriod=30
Sep 20 02:20:04.536723 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.536688    2565 generic.go:356] "Generic (PLEG): container finished" podID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerID="4771022fb01a97960580af8f222a4dde11e5f74dff55be3e4d5089f3df580558" exitCode=0
Sep 20 02:20:04.537127 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.536767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" event={"ID":"7786c5a5-53cd-44d0-b129-f79742ba4723","Type":"ContainerDied","Data":"4771022fb01a97960580af8f222a4dde11e5f74dff55be3e4d5089f3df580558"}
Sep 20 02:20:04.537127 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.536852    2565 scope.go:117] "RemoveContainer" containerID="f25ab95a91cfb1c5e0a856c44fc1a39577f621d05c4262086704bb0c24998e16"
Sep 20 02:20:04.622659 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.622632    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:20:04.658128 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658046    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7786c5a5-53cd-44d0-b129-f79742ba4723-istiod-ca-cert\") pod \"7786c5a5-53cd-44d0-b129-f79742ba4723\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") "
Sep 20 02:20:04.658128 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658120    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-certs\") pod \"7786c5a5-53cd-44d0-b129-f79742ba4723\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") "
Sep 20 02:20:04.658348 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658154    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx86n\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-kube-api-access-fx86n\") pod \"7786c5a5-53cd-44d0-b129-f79742ba4723\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") "
Sep 20 02:20:04.658348 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658208    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-envoy\") pod \"7786c5a5-53cd-44d0-b129-f79742ba4723\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") "
Sep 20 02:20:04.658348 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-podinfo\") pod \"7786c5a5-53cd-44d0-b129-f79742ba4723\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") "
Sep 20 02:20:04.658348 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658262    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-socket\") pod \"7786c5a5-53cd-44d0-b129-f79742ba4723\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") "
Sep 20 02:20:04.658567 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658351    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-data\") pod \"7786c5a5-53cd-44d0-b129-f79742ba4723\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") "
Sep 20 02:20:04.658567 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658370    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7786c5a5-53cd-44d0-b129-f79742ba4723" (UID: "7786c5a5-53cd-44d0-b129-f79742ba4723"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:20:04.658567 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658390    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-token\") pod \"7786c5a5-53cd-44d0-b129-f79742ba4723\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") "
Sep 20 02:20:04.658567 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658447    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7786c5a5-53cd-44d0-b129-f79742ba4723-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7786c5a5-53cd-44d0-b129-f79742ba4723" (UID: "7786c5a5-53cd-44d0-b129-f79742ba4723"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:20:04.658567 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658471    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-credential-socket\") pod \"7786c5a5-53cd-44d0-b129-f79742ba4723\" (UID: \"7786c5a5-53cd-44d0-b129-f79742ba4723\") "
Sep 20 02:20:04.658567 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658542    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7786c5a5-53cd-44d0-b129-f79742ba4723" (UID: "7786c5a5-53cd-44d0-b129-f79742ba4723"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:20:04.658894 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658727    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-data" (OuterVolumeSpecName: "istio-data") pod "7786c5a5-53cd-44d0-b129-f79742ba4723" (UID: "7786c5a5-53cd-44d0-b129-f79742ba4723"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:20:04.658894 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658851    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-socket\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:04.658894 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658872    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-data\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:04.658894 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658885    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7786c5a5-53cd-44d0-b129-f79742ba4723-istiod-ca-cert\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:04.658894 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658896    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-workload-certs\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:04.659159 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.658917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7786c5a5-53cd-44d0-b129-f79742ba4723" (UID: "7786c5a5-53cd-44d0-b129-f79742ba4723"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:20:04.660396 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.660373    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7786c5a5-53cd-44d0-b129-f79742ba4723" (UID: "7786c5a5-53cd-44d0-b129-f79742ba4723"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:20:04.660566 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.660550    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-token" (OuterVolumeSpecName: "istio-token") pod "7786c5a5-53cd-44d0-b129-f79742ba4723" (UID: "7786c5a5-53cd-44d0-b129-f79742ba4723"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:20:04.660827 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.660784    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7786c5a5-53cd-44d0-b129-f79742ba4723" (UID: "7786c5a5-53cd-44d0-b129-f79742ba4723"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 02:20:04.660924 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.660784    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-kube-api-access-fx86n" (OuterVolumeSpecName: "kube-api-access-fx86n") pod "7786c5a5-53cd-44d0-b129-f79742ba4723" (UID: "7786c5a5-53cd-44d0-b129-f79742ba4723"). InnerVolumeSpecName "kube-api-access-fx86n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:20:04.760289 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.760256    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-token\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:04.760289 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.760285    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-credential-socket\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:04.760289 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.760296    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx86n\" (UniqueName: \"kubernetes.io/projected/7786c5a5-53cd-44d0-b129-f79742ba4723-kube-api-access-fx86n\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:04.760538 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.760305    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-envoy\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:04.760538 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.760317    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7786c5a5-53cd-44d0-b129-f79742ba4723-istio-podinfo\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:04.835579 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.835542    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"]
Sep 20 02:20:04.835870 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.835814    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp" podUID="ce6a4876-1a4c-402a-978e-0140a1d6a0cd" containerName="payload-processing" containerID="cri-o://279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c" gracePeriod=30
Sep 20 02:20:04.850685 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.850649    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"]
Sep 20 02:20:04.851043 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.850989    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7" podUID="75a34468-1411-42e6-9fa3-18bd1c746170" containerName="payload-pre-processing" containerID="cri-o://0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227" gracePeriod=30
Sep 20 02:20:04.995895 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.995835    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"]
Sep 20 02:20:04.999555 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:04.999526    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a66f8f-dlxpd"]
Sep 20 02:20:05.118380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.118351    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:20:05.157113 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.157086    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:20:05.164731 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.164708    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2ccr\" (UniqueName: \"kubernetes.io/projected/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-kube-api-access-p2ccr\") pod \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\" (UID: \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\") "
Sep 20 02:20:05.164874 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.164810    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-plugins-config-volume\") pod \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\" (UID: \"ce6a4876-1a4c-402a-978e-0140a1d6a0cd\") "
Sep 20 02:20:05.165143 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.165121    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce6a4876-1a4c-402a-978e-0140a1d6a0cd" (UID: "ce6a4876-1a4c-402a-978e-0140a1d6a0cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:20:05.166752 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.166732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-kube-api-access-p2ccr" (OuterVolumeSpecName: "kube-api-access-p2ccr") pod "ce6a4876-1a4c-402a-978e-0140a1d6a0cd" (UID: "ce6a4876-1a4c-402a-978e-0140a1d6a0cd"). InnerVolumeSpecName "kube-api-access-p2ccr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:20:05.220805 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.220708    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d50216-07ee-477f-a51e-356e2c6e7da1" path="/var/lib/kubelet/pods/75d50216-07ee-477f-a51e-356e2c6e7da1/volumes"
Sep 20 02:20:05.266145 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.266119    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a34468-1411-42e6-9fa3-18bd1c746170-plugins-config-volume\") pod \"75a34468-1411-42e6-9fa3-18bd1c746170\" (UID: \"75a34468-1411-42e6-9fa3-18bd1c746170\") "
Sep 20 02:20:05.266287 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.266202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntsvt\" (UniqueName: \"kubernetes.io/projected/75a34468-1411-42e6-9fa3-18bd1c746170-kube-api-access-ntsvt\") pod \"75a34468-1411-42e6-9fa3-18bd1c746170\" (UID: \"75a34468-1411-42e6-9fa3-18bd1c746170\") "
Sep 20 02:20:05.266456 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.266432    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:05.266456 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.266450    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2ccr\" (UniqueName: \"kubernetes.io/projected/ce6a4876-1a4c-402a-978e-0140a1d6a0cd-kube-api-access-p2ccr\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:05.266649 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.266512    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75a34468-1411-42e6-9fa3-18bd1c746170-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75a34468-1411-42e6-9fa3-18bd1c746170" (UID: "75a34468-1411-42e6-9fa3-18bd1c746170"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:20:05.268216 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.268196    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75a34468-1411-42e6-9fa3-18bd1c746170-kube-api-access-ntsvt" (OuterVolumeSpecName: "kube-api-access-ntsvt") pod "75a34468-1411-42e6-9fa3-18bd1c746170" (UID: "75a34468-1411-42e6-9fa3-18bd1c746170"). InnerVolumeSpecName "kube-api-access-ntsvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:20:05.367124 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.367093    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a34468-1411-42e6-9fa3-18bd1c746170-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:05.367124 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.367117    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntsvt\" (UniqueName: \"kubernetes.io/projected/75a34468-1411-42e6-9fa3-18bd1c746170-kube-api-access-ntsvt\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:05.543592 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.543558    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce6a4876-1a4c-402a-978e-0140a1d6a0cd" containerID="279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c" exitCode=0
Sep 20 02:20:05.544078 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.543616    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"
Sep 20 02:20:05.544078 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.543634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp" event={"ID":"ce6a4876-1a4c-402a-978e-0140a1d6a0cd","Type":"ContainerDied","Data":"279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c"}
Sep 20 02:20:05.544078 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.543680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp" event={"ID":"ce6a4876-1a4c-402a-978e-0140a1d6a0cd","Type":"ContainerDied","Data":"e5d5d5cf103582b4a5675b20669a11204e963cf64c6e5a988feef38f49ff700a"}
Sep 20 02:20:05.544078 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.543719    2565 scope.go:117] "RemoveContainer" containerID="279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c"
Sep 20 02:20:05.545064 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.544984    2565 generic.go:356] "Generic (PLEG): container finished" podID="75a34468-1411-42e6-9fa3-18bd1c746170" containerID="0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227" exitCode=0
Sep 20 02:20:05.545064 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.545028    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"
Sep 20 02:20:05.545230 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.545067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7" event={"ID":"75a34468-1411-42e6-9fa3-18bd1c746170","Type":"ContainerDied","Data":"0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227"}
Sep 20 02:20:05.545230 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.545114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7" event={"ID":"75a34468-1411-42e6-9fa3-18bd1c746170","Type":"ContainerDied","Data":"518dad3d7ea863c037250a7f1fd6757174df0eaf796ba3349bf2d73c9345d59d"}
Sep 20 02:20:05.546977 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.546954    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"
Sep 20 02:20:05.547096 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.546973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj" event={"ID":"7786c5a5-53cd-44d0-b129-f79742ba4723","Type":"ContainerDied","Data":"b9bbafd4261e046edf2c02afa053756dc32143dc45797037dfdbbd0925710c3b"}
Sep 20 02:20:05.554619 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.554600    2565 scope.go:117] "RemoveContainer" containerID="279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c"
Sep 20 02:20:05.554930 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:20:05.554912    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c\": container with ID starting with 279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c not found: ID does not exist" containerID="279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c"
Sep 20 02:20:05.555001 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.554937    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c"} err="failed to get container status \"279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c\": rpc error: code = NotFound desc = could not find container \"279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c\": container with ID starting with 279d1d3531a3e23535ef51fcc93c95a139ccc7c5678b5a4bcffaefa37a15779c not found: ID does not exist"
Sep 20 02:20:05.555001 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.554954    2565 scope.go:117] "RemoveContainer" containerID="0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227"
Sep 20 02:20:05.563059 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.563040    2565 scope.go:117] "RemoveContainer" containerID="0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227"
Sep 20 02:20:05.563377 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:20:05.563355    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227\": container with ID starting with 0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227 not found: ID does not exist" containerID="0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227"
Sep 20 02:20:05.563441 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.563384    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227"} err="failed to get container status \"0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227\": rpc error: code = NotFound desc = could not find container \"0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227\": container with ID starting with 0f48192b8f30ae1e75ebffb953925788f7eeb21a3930712787abfc8fba884227 not found: ID does not exist"
Sep 20 02:20:05.563441 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.563401    2565 scope.go:117] "RemoveContainer" containerID="4771022fb01a97960580af8f222a4dde11e5f74dff55be3e4d5089f3df580558"
Sep 20 02:20:05.565407 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.565388    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"]
Sep 20 02:20:05.569907 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.569884    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp"]
Sep 20 02:20:05.579274 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.579254    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"]
Sep 20 02:20:05.582773 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.582755    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj"]
Sep 20 02:20:05.592294 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.592268    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"]
Sep 20 02:20:05.596442 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:05.596424    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7"]
Sep 20 02:20:07.221310 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:07.221266    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75a34468-1411-42e6-9fa3-18bd1c746170" path="/var/lib/kubelet/pods/75a34468-1411-42e6-9fa3-18bd1c746170/volumes"
Sep 20 02:20:07.221925 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:07.221904    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" path="/var/lib/kubelet/pods/7786c5a5-53cd-44d0-b129-f79742ba4723/volumes"
Sep 20 02:20:07.222352 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:07.222332    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6a4876-1a4c-402a-978e-0140a1d6a0cd" path="/var/lib/kubelet/pods/ce6a4876-1a4c-402a-978e-0140a1d6a0cd/volumes"
Sep 20 02:20:11.868149 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868111    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"]
Sep 20 02:20:11.868585 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868570    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9653942-e600-49d5-8bf8-dab0b1e7a167" containerName="payload-pre-processing"
Sep 20 02:20:11.868632 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868586    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9653942-e600-49d5-8bf8-dab0b1e7a167" containerName="payload-pre-processing"
Sep 20 02:20:11.868632 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868608    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4007c92-8a1a-4000-84cd-089129df49c3" containerName="payload-processing"
Sep 20 02:20:11.868632 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868618    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4007c92-8a1a-4000-84cd-089129df49c3" containerName="payload-processing"
Sep 20 02:20:11.868632 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868629    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75a34468-1411-42e6-9fa3-18bd1c746170" containerName="payload-pre-processing"
Sep 20 02:20:11.868759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868635    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="75a34468-1411-42e6-9fa3-18bd1c746170" containerName="payload-pre-processing"
Sep 20 02:20:11.868759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868642    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d50216-07ee-477f-a51e-356e2c6e7da1" containerName="revoke-keys"
Sep 20 02:20:11.868759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868648    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d50216-07ee-477f-a51e-356e2c6e7da1" containerName="revoke-keys"
Sep 20 02:20:11.868759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868661    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy"
Sep 20 02:20:11.868759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868667    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy"
Sep 20 02:20:11.868759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868673    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6a4876-1a4c-402a-978e-0140a1d6a0cd" containerName="payload-processing"
Sep 20 02:20:11.868759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868681    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6a4876-1a4c-402a-978e-0140a1d6a0cd" containerName="payload-processing"
Sep 20 02:20:11.868759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868692    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy"
Sep 20 02:20:11.868759 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868698    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy"
Sep 20 02:20:11.869049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868762    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9653942-e600-49d5-8bf8-dab0b1e7a167" containerName="payload-pre-processing"
Sep 20 02:20:11.869049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868774    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4007c92-8a1a-4000-84cd-089129df49c3" containerName="payload-processing"
Sep 20 02:20:11.869049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868782    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="75a34468-1411-42e6-9fa3-18bd1c746170" containerName="payload-pre-processing"
Sep 20 02:20:11.869049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868801    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy"
Sep 20 02:20:11.869049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868808    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6a4876-1a4c-402a-978e-0140a1d6a0cd" containerName="payload-processing"
Sep 20 02:20:11.869049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.868814    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d50216-07ee-477f-a51e-356e2c6e7da1" containerName="revoke-keys"
Sep 20 02:20:11.873110 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.873094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"
Sep 20 02:20:11.876223 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.876195    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:20:11.876362 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.876279    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:20:11.878431 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.878406    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"]
Sep 20 02:20:11.930441 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:11.930405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bd56eb-7fad-40c0-a94a-43abc2e60fca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w\" (UID: \"79bd56eb-7fad-40c0-a94a-43abc2e60fca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"
Sep 20 02:20:12.032040 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:12.031998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bd56eb-7fad-40c0-a94a-43abc2e60fca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w\" (UID: \"79bd56eb-7fad-40c0-a94a-43abc2e60fca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"
Sep 20 02:20:12.032624 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:12.032600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bd56eb-7fad-40c0-a94a-43abc2e60fca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w\" (UID: \"79bd56eb-7fad-40c0-a94a-43abc2e60fca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"
Sep 20 02:20:12.184319 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:12.184228    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"
Sep 20 02:20:12.463361 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:12.463332    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"]
Sep 20 02:20:12.464889 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:20:12.464862    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bd56eb_7fad_40c0_a94a_43abc2e60fca.slice/crio-54193eb72ec00096522816dae74de67b6f46a8b47f5016826ee9bf861003df71 WatchSource:0}: Error finding container 54193eb72ec00096522816dae74de67b6f46a8b47f5016826ee9bf861003df71: Status 404 returned error can't find the container with id 54193eb72ec00096522816dae74de67b6f46a8b47f5016826ee9bf861003df71
Sep 20 02:20:12.591366 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:12.591334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w" event={"ID":"79bd56eb-7fad-40c0-a94a-43abc2e60fca","Type":"ContainerStarted","Data":"54193eb72ec00096522816dae74de67b6f46a8b47f5016826ee9bf861003df71"}
Sep 20 02:20:13.597861 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:13.597825    2565 generic.go:356] "Generic (PLEG): container finished" podID="79bd56eb-7fad-40c0-a94a-43abc2e60fca" containerID="5ea19aca66c842c020b19867c5404e9993f31e36760914b32f6f0cddf02fed82" exitCode=0
Sep 20 02:20:13.598254 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:13.597917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w" event={"ID":"79bd56eb-7fad-40c0-a94a-43abc2e60fca","Type":"ContainerDied","Data":"5ea19aca66c842c020b19867c5404e9993f31e36760914b32f6f0cddf02fed82"}
Sep 20 02:20:14.743431 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:14.743408    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"
Sep 20 02:20:14.859468 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:14.858713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bd56eb-7fad-40c0-a94a-43abc2e60fca-maas-api-service-ca\") pod \"79bd56eb-7fad-40c0-a94a-43abc2e60fca\" (UID: \"79bd56eb-7fad-40c0-a94a-43abc2e60fca\") "
Sep 20 02:20:14.861913 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:14.859910    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79bd56eb-7fad-40c0-a94a-43abc2e60fca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79bd56eb-7fad-40c0-a94a-43abc2e60fca" (UID: "79bd56eb-7fad-40c0-a94a-43abc2e60fca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:20:14.960313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:14.960279    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79bd56eb-7fad-40c0-a94a-43abc2e60fca-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:15.609838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:15.609771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w" event={"ID":"79bd56eb-7fad-40c0-a94a-43abc2e60fca","Type":"ContainerDied","Data":"54193eb72ec00096522816dae74de67b6f46a8b47f5016826ee9bf861003df71"}
Sep 20 02:20:15.609838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:15.609829    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"
Sep 20 02:20:15.610065 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:15.609853    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54193eb72ec00096522816dae74de67b6f46a8b47f5016826ee9bf861003df71"
Sep 20 02:20:27.387342 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.387304    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"]
Sep 20 02:20:27.388036 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.387552    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692" podUID="0724e4f6-0274-4948-966b-c64b06608d42" containerName="payload-processing" containerID="cri-o://7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb" gracePeriod=30
Sep 20 02:20:27.673144 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.673115    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:20:27.678761 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.678734    2565 generic.go:356] "Generic (PLEG): container finished" podID="0724e4f6-0274-4948-966b-c64b06608d42" containerID="7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb" exitCode=0
Sep 20 02:20:27.678923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.678767    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"
Sep 20 02:20:27.678923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.678817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692" event={"ID":"0724e4f6-0274-4948-966b-c64b06608d42","Type":"ContainerDied","Data":"7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb"}
Sep 20 02:20:27.678923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.678879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692" event={"ID":"0724e4f6-0274-4948-966b-c64b06608d42","Type":"ContainerDied","Data":"f9af6c750c55087a6607387e95b8d21e989aec71156c39211f66d9fcfc417051"}
Sep 20 02:20:27.678923 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.678908    2565 scope.go:117] "RemoveContainer" containerID="7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb"
Sep 20 02:20:27.687382 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.687326    2565 scope.go:117] "RemoveContainer" containerID="7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb"
Sep 20 02:20:27.687755 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:20:27.687729    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb\": container with ID starting with 7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb not found: ID does not exist" containerID="7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb"
Sep 20 02:20:27.687909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.687765    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb"} err="failed to get container status \"7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb\": rpc error: code = NotFound desc = could not find container \"7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb\": container with ID starting with 7c19a7900ce8e9435c6f132e4ec3e9a3945eeb60c55da060bbe95527c2faf0eb not found: ID does not exist"
Sep 20 02:20:27.699812 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.694726    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"]
Sep 20 02:20:27.704741 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.704713    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dd1246-4jt6w"]
Sep 20 02:20:27.795943 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.795917    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0724e4f6-0274-4948-966b-c64b06608d42-plugins-config-volume\") pod \"0724e4f6-0274-4948-966b-c64b06608d42\" (UID: \"0724e4f6-0274-4948-966b-c64b06608d42\") "
Sep 20 02:20:27.796142 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.796012    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmhz6\" (UniqueName: \"kubernetes.io/projected/0724e4f6-0274-4948-966b-c64b06608d42-kube-api-access-vmhz6\") pod \"0724e4f6-0274-4948-966b-c64b06608d42\" (UID: \"0724e4f6-0274-4948-966b-c64b06608d42\") "
Sep 20 02:20:27.796337 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.796311    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0724e4f6-0274-4948-966b-c64b06608d42-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0724e4f6-0274-4948-966b-c64b06608d42" (UID: "0724e4f6-0274-4948-966b-c64b06608d42"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:20:27.798001 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.797982    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0724e4f6-0274-4948-966b-c64b06608d42-kube-api-access-vmhz6" (OuterVolumeSpecName: "kube-api-access-vmhz6") pod "0724e4f6-0274-4948-966b-c64b06608d42" (UID: "0724e4f6-0274-4948-966b-c64b06608d42"). InnerVolumeSpecName "kube-api-access-vmhz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:20:27.896945 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.896854    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmhz6\" (UniqueName: \"kubernetes.io/projected/0724e4f6-0274-4948-966b-c64b06608d42-kube-api-access-vmhz6\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:27.896945 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:27.896886    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0724e4f6-0274-4948-966b-c64b06608d42-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:28.000208 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:28.000175    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"]
Sep 20 02:20:28.003873 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:28.003847    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692"]
Sep 20 02:20:29.221173 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:29.221141    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0724e4f6-0274-4948-966b-c64b06608d42" path="/var/lib/kubelet/pods/0724e4f6-0274-4948-966b-c64b06608d42/volumes"
Sep 20 02:20:29.221527 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:29.221455    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79bd56eb-7fad-40c0-a94a-43abc2e60fca" path="/var/lib/kubelet/pods/79bd56eb-7fad-40c0-a94a-43abc2e60fca/volumes"
Sep 20 02:20:34.361985 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.361947    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"]
Sep 20 02:20:34.362412 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.362398    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0724e4f6-0274-4948-966b-c64b06608d42" containerName="payload-processing"
Sep 20 02:20:34.362458 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.362413    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0724e4f6-0274-4948-966b-c64b06608d42" containerName="payload-processing"
Sep 20 02:20:34.362458 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.362434    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79bd56eb-7fad-40c0-a94a-43abc2e60fca" containerName="revoke-keys"
Sep 20 02:20:34.362458 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.362439    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="79bd56eb-7fad-40c0-a94a-43abc2e60fca" containerName="revoke-keys"
Sep 20 02:20:34.362554 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.362505    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7786c5a5-53cd-44d0-b129-f79742ba4723" containerName="istio-proxy"
Sep 20 02:20:34.362554 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.362515    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="79bd56eb-7fad-40c0-a94a-43abc2e60fca" containerName="revoke-keys"
Sep 20 02:20:34.362554 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.362520    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0724e4f6-0274-4948-966b-c64b06608d42" containerName="payload-processing"
Sep 20 02:20:34.366725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.366709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"
Sep 20 02:20:34.369814 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.369773    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:20:34.370056 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.369862    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:20:34.372050 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.372026    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"]
Sep 20 02:20:34.459366 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.459327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a789c03-c952-4e40-8a5a-8f4ee4ac42a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq\" (UID: \"2a789c03-c952-4e40-8a5a-8f4ee4ac42a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"
Sep 20 02:20:34.560429 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.560392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a789c03-c952-4e40-8a5a-8f4ee4ac42a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq\" (UID: \"2a789c03-c952-4e40-8a5a-8f4ee4ac42a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"
Sep 20 02:20:34.561124 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.561098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a789c03-c952-4e40-8a5a-8f4ee4ac42a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq\" (UID: \"2a789c03-c952-4e40-8a5a-8f4ee4ac42a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"
Sep 20 02:20:34.678263 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.678189    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"
Sep 20 02:20:34.949949 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:34.949920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"]
Sep 20 02:20:34.951932 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:20:34.951908    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a789c03_c952_4e40_8a5a_8f4ee4ac42a0.slice/crio-d4c1dcc45ef6a06e86d2f2272f40c75d42e7853a23cb301d4e19eba8f8c84294 WatchSource:0}: Error finding container d4c1dcc45ef6a06e86d2f2272f40c75d42e7853a23cb301d4e19eba8f8c84294: Status 404 returned error can't find the container with id d4c1dcc45ef6a06e86d2f2272f40c75d42e7853a23cb301d4e19eba8f8c84294
Sep 20 02:20:35.728443 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:35.728407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq" event={"ID":"2a789c03-c952-4e40-8a5a-8f4ee4ac42a0","Type":"ContainerStarted","Data":"ef80193c6f8757b4d2e62ce9d092d7e343a1be1db4d3baf31905622527933253"}
Sep 20 02:20:35.728869 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:35.728467    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq" event={"ID":"2a789c03-c952-4e40-8a5a-8f4ee4ac42a0","Type":"ContainerStarted","Data":"d4c1dcc45ef6a06e86d2f2272f40c75d42e7853a23cb301d4e19eba8f8c84294"}
Sep 20 02:20:35.745212 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:35.745169    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq" podStartSLOduration=1.7451556190000002 podStartE2EDuration="1.745155619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:20:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:20:35.743726237 +0000 UTC m=+1681.028738172" watchObservedRunningTime="2026-09-20 02:20:35.745155619 +0000 UTC m=+1681.030167555"
Sep 20 02:20:36.736140 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:36.736102    2565 generic.go:356] "Generic (PLEG): container finished" podID="2a789c03-c952-4e40-8a5a-8f4ee4ac42a0" containerID="ef80193c6f8757b4d2e62ce9d092d7e343a1be1db4d3baf31905622527933253" exitCode=0
Sep 20 02:20:36.736521 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:36.736179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq" event={"ID":"2a789c03-c952-4e40-8a5a-8f4ee4ac42a0","Type":"ContainerDied","Data":"ef80193c6f8757b4d2e62ce9d092d7e343a1be1db4d3baf31905622527933253"}
Sep 20 02:20:37.879220 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:37.879196    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"
Sep 20 02:20:37.993753 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:37.993676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a789c03-c952-4e40-8a5a-8f4ee4ac42a0-maas-api-service-ca\") pod \"2a789c03-c952-4e40-8a5a-8f4ee4ac42a0\" (UID: \"2a789c03-c952-4e40-8a5a-8f4ee4ac42a0\") "
Sep 20 02:20:37.994076 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:37.994045    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a789c03-c952-4e40-8a5a-8f4ee4ac42a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2a789c03-c952-4e40-8a5a-8f4ee4ac42a0" (UID: "2a789c03-c952-4e40-8a5a-8f4ee4ac42a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:20:38.095023 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:38.094987    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a789c03-c952-4e40-8a5a-8f4ee4ac42a0-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:38.749555 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:38.749524    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"
Sep 20 02:20:38.749725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:38.749566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq" event={"ID":"2a789c03-c952-4e40-8a5a-8f4ee4ac42a0","Type":"ContainerDied","Data":"d4c1dcc45ef6a06e86d2f2272f40c75d42e7853a23cb301d4e19eba8f8c84294"}
Sep 20 02:20:38.749725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:38.749614    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4c1dcc45ef6a06e86d2f2272f40c75d42e7853a23cb301d4e19eba8f8c84294"
Sep 20 02:20:44.853275 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:44.853241    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg"]
Sep 20 02:20:44.855224 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:44.855201    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4559b3-29831175-7wwsg"]
Sep 20 02:20:44.879276 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:44.879245    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"]
Sep 20 02:20:44.879510 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:44.879483    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f" podUID="0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8" containerName="payload-processing" containerID="cri-o://e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de" gracePeriod=30
Sep 20 02:20:44.888117 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:44.887856    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"]
Sep 20 02:20:44.888561 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:44.888135    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr" podUID="de333512-1a47-4be0-b6f5-ffecf891231c" containerName="payload-pre-processing" containerID="cri-o://57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d" gracePeriod=30
Sep 20 02:20:45.040662 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.040611    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"]
Sep 20 02:20:45.043048 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.043002    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4559b3-n8zjq"]
Sep 20 02:20:45.145281 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.145259    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:20:45.174504 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.174483    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:20:45.233405 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.233352    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a789c03-c952-4e40-8a5a-8f4ee4ac42a0" path="/var/lib/kubelet/pods/2a789c03-c952-4e40-8a5a-8f4ee4ac42a0/volumes"
Sep 20 02:20:45.233848 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.233828    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4582da82-d733-485d-81c2-9ebd15f4857c" path="/var/lib/kubelet/pods/4582da82-d733-485d-81c2-9ebd15f4857c/volumes"
Sep 20 02:20:45.268724 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.268699    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de333512-1a47-4be0-b6f5-ffecf891231c-plugins-config-volume\") pod \"de333512-1a47-4be0-b6f5-ffecf891231c\" (UID: \"de333512-1a47-4be0-b6f5-ffecf891231c\") "
Sep 20 02:20:45.268899 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.268814    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9778\" (UniqueName: \"kubernetes.io/projected/de333512-1a47-4be0-b6f5-ffecf891231c-kube-api-access-n9778\") pod \"de333512-1a47-4be0-b6f5-ffecf891231c\" (UID: \"de333512-1a47-4be0-b6f5-ffecf891231c\") "
Sep 20 02:20:45.268948 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.268898    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-plugins-config-volume\") pod \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\" (UID: \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\") "
Sep 20 02:20:45.268948 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.268923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlkcf\" (UniqueName: \"kubernetes.io/projected/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-kube-api-access-dlkcf\") pod \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\" (UID: \"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8\") "
Sep 20 02:20:45.269070 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.269041    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de333512-1a47-4be0-b6f5-ffecf891231c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de333512-1a47-4be0-b6f5-ffecf891231c" (UID: "de333512-1a47-4be0-b6f5-ffecf891231c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:20:45.269165 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.269136    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de333512-1a47-4be0-b6f5-ffecf891231c-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:45.269294 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.269280    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8" (UID: "0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:20:45.270769 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.270749    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de333512-1a47-4be0-b6f5-ffecf891231c-kube-api-access-n9778" (OuterVolumeSpecName: "kube-api-access-n9778") pod "de333512-1a47-4be0-b6f5-ffecf891231c" (UID: "de333512-1a47-4be0-b6f5-ffecf891231c"). InnerVolumeSpecName "kube-api-access-n9778". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:20:45.271045 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.271024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-kube-api-access-dlkcf" (OuterVolumeSpecName: "kube-api-access-dlkcf") pod "0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8" (UID: "0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8"). InnerVolumeSpecName "kube-api-access-dlkcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:20:45.369838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.369782    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9778\" (UniqueName: \"kubernetes.io/projected/de333512-1a47-4be0-b6f5-ffecf891231c-kube-api-access-n9778\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:45.369838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.369830    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:45.369838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.369840    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlkcf\" (UniqueName: \"kubernetes.io/projected/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8-kube-api-access-dlkcf\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:45.788475 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.788440    2565 generic.go:356] "Generic (PLEG): container finished" podID="0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8" containerID="e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de" exitCode=0
Sep 20 02:20:45.788689 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.788481    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"
Sep 20 02:20:45.788689 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.788528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f" event={"ID":"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8","Type":"ContainerDied","Data":"e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de"}
Sep 20 02:20:45.788689 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.788573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f" event={"ID":"0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8","Type":"ContainerDied","Data":"0086149f4700c7fe6ced73ce6ee8bc86a8530d7ca0fe495ddc86d0d25cf0b973"}
Sep 20 02:20:45.788689 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.788594    2565 scope.go:117] "RemoveContainer" containerID="e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de"
Sep 20 02:20:45.790034 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.790012    2565 generic.go:356] "Generic (PLEG): container finished" podID="de333512-1a47-4be0-b6f5-ffecf891231c" containerID="57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d" exitCode=0
Sep 20 02:20:45.790153 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.790064    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"
Sep 20 02:20:45.790153 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.790105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr" event={"ID":"de333512-1a47-4be0-b6f5-ffecf891231c","Type":"ContainerDied","Data":"57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d"}
Sep 20 02:20:45.790228 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.790160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr" event={"ID":"de333512-1a47-4be0-b6f5-ffecf891231c","Type":"ContainerDied","Data":"87dbe5a5a2cdc22998931edda09ba747cde89d18089a2cbdcbfb5e030e20a59a"}
Sep 20 02:20:45.797598 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.797575    2565 scope.go:117] "RemoveContainer" containerID="e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de"
Sep 20 02:20:45.797883 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:20:45.797863    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de\": container with ID starting with e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de not found: ID does not exist" containerID="e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de"
Sep 20 02:20:45.797975 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.797893    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de"} err="failed to get container status \"e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de\": rpc error: code = NotFound desc = could not find container \"e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de\": container with ID starting with e0600cd93d56aa9d36cc2f7618fe4e6f7b15a672a22923ffc3b28fcb5bcbd2de not found: ID does not exist"
Sep 20 02:20:45.797975 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.797910    2565 scope.go:117] "RemoveContainer" containerID="57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d"
Sep 20 02:20:45.806013 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.805998    2565 scope.go:117] "RemoveContainer" containerID="57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d"
Sep 20 02:20:45.806305 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:20:45.806286    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d\": container with ID starting with 57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d not found: ID does not exist" containerID="57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d"
Sep 20 02:20:45.806369 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.806316    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d"} err="failed to get container status \"57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d\": rpc error: code = NotFound desc = could not find container \"57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d\": container with ID starting with 57609a7b0363b941c4575b55827b335ab852cc1e627284a5cdb735dd953a0e0d not found: ID does not exist"
Sep 20 02:20:45.814253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.814232    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"]
Sep 20 02:20:45.817196 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.817171    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f"]
Sep 20 02:20:45.826525 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.826505    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"]
Sep 20 02:20:45.829538 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:45.829516    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr"]
Sep 20 02:20:47.221053 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:47.221020    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8" path="/var/lib/kubelet/pods/0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8/volumes"
Sep 20 02:20:47.221413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:47.221378    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de333512-1a47-4be0-b6f5-ffecf891231c" path="/var/lib/kubelet/pods/de333512-1a47-4be0-b6f5-ffecf891231c/volumes"
Sep 20 02:20:51.770358 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770324    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"]
Sep 20 02:20:51.770725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770712    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8" containerName="payload-processing"
Sep 20 02:20:51.770725 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770726    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8" containerName="payload-processing"
Sep 20 02:20:51.770833 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770746    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de333512-1a47-4be0-b6f5-ffecf891231c" containerName="payload-pre-processing"
Sep 20 02:20:51.770833 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770752    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de333512-1a47-4be0-b6f5-ffecf891231c" containerName="payload-pre-processing"
Sep 20 02:20:51.770833 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770760    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a789c03-c952-4e40-8a5a-8f4ee4ac42a0" containerName="revoke-keys"
Sep 20 02:20:51.770833 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770765    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a789c03-c952-4e40-8a5a-8f4ee4ac42a0" containerName="revoke-keys"
Sep 20 02:20:51.770833 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770832    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a789c03-c952-4e40-8a5a-8f4ee4ac42a0" containerName="revoke-keys"
Sep 20 02:20:51.770987 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770842    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de333512-1a47-4be0-b6f5-ffecf891231c" containerName="payload-pre-processing"
Sep 20 02:20:51.770987 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.770850    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f7d6ddc-7bcc-4df2-84e5-c7b780cb8cc8" containerName="payload-processing"
Sep 20 02:20:51.775404 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.775382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"
Sep 20 02:20:51.778632 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.778610    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:20:51.778950 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.778663    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:20:51.780775 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.780750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"]
Sep 20 02:20:51.933573 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:51.933534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b91c677-1ad9-4e30-a1f1-075a3f863ac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h\" (UID: \"4b91c677-1ad9-4e30-a1f1-075a3f863ac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"
Sep 20 02:20:52.035032 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:52.034947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b91c677-1ad9-4e30-a1f1-075a3f863ac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h\" (UID: \"4b91c677-1ad9-4e30-a1f1-075a3f863ac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"
Sep 20 02:20:52.035568 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:52.035547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b91c677-1ad9-4e30-a1f1-075a3f863ac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h\" (UID: \"4b91c677-1ad9-4e30-a1f1-075a3f863ac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"
Sep 20 02:20:52.087954 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:52.087926    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"
Sep 20 02:20:52.356705 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:52.356677    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"]
Sep 20 02:20:52.358992 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:20:52.358964    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b91c677_1ad9_4e30_a1f1_075a3f863ac1.slice/crio-e0e4cc666a4388ec55a5c18b4a56e7538d621cbdcde97a6d083f3c67d055c79b WatchSource:0}: Error finding container e0e4cc666a4388ec55a5c18b4a56e7538d621cbdcde97a6d083f3c67d055c79b: Status 404 returned error can't find the container with id e0e4cc666a4388ec55a5c18b4a56e7538d621cbdcde97a6d083f3c67d055c79b
Sep 20 02:20:52.832351 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:52.832311    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h" event={"ID":"4b91c677-1ad9-4e30-a1f1-075a3f863ac1","Type":"ContainerStarted","Data":"53c1cfc5bd5999f2a2a557ccc4e9b88dc37bedf1d4e12097973cd5b32fe2838a"}
Sep 20 02:20:52.832928 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:52.832369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h" event={"ID":"4b91c677-1ad9-4e30-a1f1-075a3f863ac1","Type":"ContainerStarted","Data":"e0e4cc666a4388ec55a5c18b4a56e7538d621cbdcde97a6d083f3c67d055c79b"}
Sep 20 02:20:52.849710 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:52.847524    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h" podStartSLOduration=1.847503087 podStartE2EDuration="1.847503087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:20:52.845836254 +0000 UTC m=+1698.130848207" watchObservedRunningTime="2026-09-20 02:20:52.847503087 +0000 UTC m=+1698.132515023"
Sep 20 02:20:53.844847 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:53.844806    2565 generic.go:356] "Generic (PLEG): container finished" podID="4b91c677-1ad9-4e30-a1f1-075a3f863ac1" containerID="53c1cfc5bd5999f2a2a557ccc4e9b88dc37bedf1d4e12097973cd5b32fe2838a" exitCode=0
Sep 20 02:20:53.845231 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:53.844881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h" event={"ID":"4b91c677-1ad9-4e30-a1f1-075a3f863ac1","Type":"ContainerDied","Data":"53c1cfc5bd5999f2a2a557ccc4e9b88dc37bedf1d4e12097973cd5b32fe2838a"}
Sep 20 02:20:54.986066 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:54.986043    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"
Sep 20 02:20:55.064253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:55.064214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b91c677-1ad9-4e30-a1f1-075a3f863ac1-maas-api-service-ca\") pod \"4b91c677-1ad9-4e30-a1f1-075a3f863ac1\" (UID: \"4b91c677-1ad9-4e30-a1f1-075a3f863ac1\") "
Sep 20 02:20:55.064589 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:55.064564    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b91c677-1ad9-4e30-a1f1-075a3f863ac1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b91c677-1ad9-4e30-a1f1-075a3f863ac1" (UID: "4b91c677-1ad9-4e30-a1f1-075a3f863ac1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:20:55.165847 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:55.165767    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b91c677-1ad9-4e30-a1f1-075a3f863ac1-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:20:55.856467 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:55.856435    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"
Sep 20 02:20:55.856674 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:55.856430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h" event={"ID":"4b91c677-1ad9-4e30-a1f1-075a3f863ac1","Type":"ContainerDied","Data":"e0e4cc666a4388ec55a5c18b4a56e7538d621cbdcde97a6d083f3c67d055c79b"}
Sep 20 02:20:55.856674 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:20:55.856554    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0e4cc666a4388ec55a5c18b4a56e7538d621cbdcde97a6d083f3c67d055c79b"
Sep 20 02:21:02.416137 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.416050    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"]
Sep 20 02:21:02.416615 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.416311    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr" podUID="2aed0c73-536a-469d-9710-e6e2fc9df99f" containerName="payload-processing" containerID="cri-o://8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0" gracePeriod=30
Sep 20 02:21:02.422562 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.422532    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"]
Sep 20 02:21:02.422805 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.422758    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2" podUID="7839bfbd-953d-4eeb-9e11-d5ffa0641d7b" containerName="payload-pre-processing" containerID="cri-o://ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b" gracePeriod=30
Sep 20 02:21:02.576506 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.576439    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"]
Sep 20 02:21:02.578498 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.578465    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-90811b-h886h"]
Sep 20 02:21:02.733187 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.733162    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:21:02.736157 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.736130    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:21:02.838293 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.838251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-plugins-config-volume\") pod \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\" (UID: \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\") "
Sep 20 02:21:02.838293 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.838298    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6sgc\" (UniqueName: \"kubernetes.io/projected/2aed0c73-536a-469d-9710-e6e2fc9df99f-kube-api-access-j6sgc\") pod \"2aed0c73-536a-469d-9710-e6e2fc9df99f\" (UID: \"2aed0c73-536a-469d-9710-e6e2fc9df99f\") "
Sep 20 02:21:02.838536 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.838336    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwdqd\" (UniqueName: \"kubernetes.io/projected/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-kube-api-access-xwdqd\") pod \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\" (UID: \"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b\") "
Sep 20 02:21:02.838536 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.838379    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2aed0c73-536a-469d-9710-e6e2fc9df99f-plugins-config-volume\") pod \"2aed0c73-536a-469d-9710-e6e2fc9df99f\" (UID: \"2aed0c73-536a-469d-9710-e6e2fc9df99f\") "
Sep 20 02:21:02.838939 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.838753    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7839bfbd-953d-4eeb-9e11-d5ffa0641d7b" (UID: "7839bfbd-953d-4eeb-9e11-d5ffa0641d7b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:21:02.839076 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.838963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aed0c73-536a-469d-9710-e6e2fc9df99f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2aed0c73-536a-469d-9710-e6e2fc9df99f" (UID: "2aed0c73-536a-469d-9710-e6e2fc9df99f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:21:02.840645 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.840615    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aed0c73-536a-469d-9710-e6e2fc9df99f-kube-api-access-j6sgc" (OuterVolumeSpecName: "kube-api-access-j6sgc") pod "2aed0c73-536a-469d-9710-e6e2fc9df99f" (UID: "2aed0c73-536a-469d-9710-e6e2fc9df99f"). InnerVolumeSpecName "kube-api-access-j6sgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:21:02.840741 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.840693    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-kube-api-access-xwdqd" (OuterVolumeSpecName: "kube-api-access-xwdqd") pod "7839bfbd-953d-4eeb-9e11-d5ffa0641d7b" (UID: "7839bfbd-953d-4eeb-9e11-d5ffa0641d7b"). InnerVolumeSpecName "kube-api-access-xwdqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:21:02.893299 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.893262    2565 generic.go:356] "Generic (PLEG): container finished" podID="2aed0c73-536a-469d-9710-e6e2fc9df99f" containerID="8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0" exitCode=0
Sep 20 02:21:02.893482 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.893310    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"
Sep 20 02:21:02.893482 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.893345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr" event={"ID":"2aed0c73-536a-469d-9710-e6e2fc9df99f","Type":"ContainerDied","Data":"8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0"}
Sep 20 02:21:02.893482 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.893397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr" event={"ID":"2aed0c73-536a-469d-9710-e6e2fc9df99f","Type":"ContainerDied","Data":"6eccd228dcea7d53fd14bd716c2fbc3055c5851ca0ec4d2876276abdd24319f9"}
Sep 20 02:21:02.893482 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.893425    2565 scope.go:117] "RemoveContainer" containerID="8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0"
Sep 20 02:21:02.894731 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.894710    2565 generic.go:356] "Generic (PLEG): container finished" podID="7839bfbd-953d-4eeb-9e11-d5ffa0641d7b" containerID="ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b" exitCode=0
Sep 20 02:21:02.894848 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.894759    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"
Sep 20 02:21:02.894848 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.894763    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2" event={"ID":"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b","Type":"ContainerDied","Data":"ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b"}
Sep 20 02:21:02.894927 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.894843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2" event={"ID":"7839bfbd-953d-4eeb-9e11-d5ffa0641d7b","Type":"ContainerDied","Data":"2f8961b5481f9b0e641577766d70e1b3aead5e82c6ed611a44339a596f06f6a9"}
Sep 20 02:21:02.903325 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.903277    2565 scope.go:117] "RemoveContainer" containerID="8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0"
Sep 20 02:21:02.903594 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:21:02.903575    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0\": container with ID starting with 8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0 not found: ID does not exist" containerID="8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0"
Sep 20 02:21:02.903656 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.903601    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0"} err="failed to get container status \"8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0\": rpc error: code = NotFound desc = could not find container \"8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0\": container with ID starting with 8b43a796f77ae6a285a0b4f7ff9c75ca3dfcab9b4ba2f4da7eaa8dd977352ca0 not found: ID does not exist"
Sep 20 02:21:02.903656 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.903617    2565 scope.go:117] "RemoveContainer" containerID="ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b"
Sep 20 02:21:02.911713 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.911699    2565 scope.go:117] "RemoveContainer" containerID="ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b"
Sep 20 02:21:02.912032 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:21:02.912014    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b\": container with ID starting with ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b not found: ID does not exist" containerID="ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b"
Sep 20 02:21:02.912084 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.912039    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b"} err="failed to get container status \"ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b\": rpc error: code = NotFound desc = could not find container \"ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b\": container with ID starting with ebb66b495954ca04183b4cd627e5b1eb1bf4b20d03d99450a7863d919d278f0b not found: ID does not exist"
Sep 20 02:21:02.918009 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.917987    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"]
Sep 20 02:21:02.924181 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.924154    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr"]
Sep 20 02:21:02.933596 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.933568    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"]
Sep 20 02:21:02.937292 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.937269    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2"]
Sep 20 02:21:02.939896 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.939876    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:02.939969 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.939899    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6sgc\" (UniqueName: \"kubernetes.io/projected/2aed0c73-536a-469d-9710-e6e2fc9df99f-kube-api-access-j6sgc\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:02.939969 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.939913    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwdqd\" (UniqueName: \"kubernetes.io/projected/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b-kube-api-access-xwdqd\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:02.939969 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:02.939925    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2aed0c73-536a-469d-9710-e6e2fc9df99f-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:03.220962 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:03.220932    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aed0c73-536a-469d-9710-e6e2fc9df99f" path="/var/lib/kubelet/pods/2aed0c73-536a-469d-9710-e6e2fc9df99f/volumes"
Sep 20 02:21:03.221284 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:03.221271    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b91c677-1ad9-4e30-a1f1-075a3f863ac1" path="/var/lib/kubelet/pods/4b91c677-1ad9-4e30-a1f1-075a3f863ac1/volumes"
Sep 20 02:21:03.221585 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:03.221575    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7839bfbd-953d-4eeb-9e11-d5ffa0641d7b" path="/var/lib/kubelet/pods/7839bfbd-953d-4eeb-9e11-d5ffa0641d7b/volumes"
Sep 20 02:21:08.910076 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:08.910034    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"]
Sep 20 02:21:08.910678 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:08.910299    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy" containerID="cri-o://0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a" gracePeriod=30
Sep 20 02:21:14.165186 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.165153    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:21:14.242511 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242481    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-data\") pod \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") "
Sep 20 02:21:14.242693 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242525    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-token\") pod \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") "
Sep 20 02:21:14.242693 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242549    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-podinfo\") pod \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") "
Sep 20 02:21:14.242693 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242573    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-socket\") pod \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") "
Sep 20 02:21:14.242693 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242604    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-certs\") pod \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") "
Sep 20 02:21:14.242693 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242660    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-envoy\") pod \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") "
Sep 20 02:21:14.243000 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242704    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-credential-socket\") pod \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") "
Sep 20 02:21:14.243000 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ccv8\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-kube-api-access-2ccv8\") pod \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") "
Sep 20 02:21:14.243000 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242772    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "3899c7f4-a20d-46a7-9e41-63bde7ba26f7" (UID: "3899c7f4-a20d-46a7-9e41-63bde7ba26f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:14.243000 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242821    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istiod-ca-cert\") pod \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\" (UID: \"3899c7f4-a20d-46a7-9e41-63bde7ba26f7\") "
Sep 20 02:21:14.243000 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242912    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3899c7f4-a20d-46a7-9e41-63bde7ba26f7" (UID: "3899c7f4-a20d-46a7-9e41-63bde7ba26f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:14.243000 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.242934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3899c7f4-a20d-46a7-9e41-63bde7ba26f7" (UID: "3899c7f4-a20d-46a7-9e41-63bde7ba26f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:14.243311 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.243172    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3899c7f4-a20d-46a7-9e41-63bde7ba26f7" (UID: "3899c7f4-a20d-46a7-9e41-63bde7ba26f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:14.243311 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.243244    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3899c7f4-a20d-46a7-9e41-63bde7ba26f7" (UID: "3899c7f4-a20d-46a7-9e41-63bde7ba26f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:21:14.243424 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.243334    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-data\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:14.243424 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.243352    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-socket\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:14.243424 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.243366    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-workload-certs\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:14.243424 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.243380    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-credential-socket\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:14.243424 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.243395    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istiod-ca-cert\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:14.244852 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.244826    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "3899c7f4-a20d-46a7-9e41-63bde7ba26f7" (UID: "3899c7f4-a20d-46a7-9e41-63bde7ba26f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:21:14.244983 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.244943    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3899c7f4-a20d-46a7-9e41-63bde7ba26f7" (UID: "3899c7f4-a20d-46a7-9e41-63bde7ba26f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:14.245356 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.245340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-kube-api-access-2ccv8" (OuterVolumeSpecName: "kube-api-access-2ccv8") pod "3899c7f4-a20d-46a7-9e41-63bde7ba26f7" (UID: "3899c7f4-a20d-46a7-9e41-63bde7ba26f7"). InnerVolumeSpecName "kube-api-access-2ccv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:21:14.245356 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.245351    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3899c7f4-a20d-46a7-9e41-63bde7ba26f7" (UID: "3899c7f4-a20d-46a7-9e41-63bde7ba26f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 02:21:14.344070 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.344037    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-token\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:14.344070 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.344062    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-podinfo\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:14.344070 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.344071    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-istio-envoy\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:14.344070 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.344079    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ccv8\" (UniqueName: \"kubernetes.io/projected/3899c7f4-a20d-46a7-9e41-63bde7ba26f7-kube-api-access-2ccv8\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:14.961272 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.961236    2565 generic.go:356] "Generic (PLEG): container finished" podID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerID="0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a" exitCode=0
Sep 20 02:21:14.961450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.961286    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"
Sep 20 02:21:14.961450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.961320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" event={"ID":"3899c7f4-a20d-46a7-9e41-63bde7ba26f7","Type":"ContainerDied","Data":"0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a"}
Sep 20 02:21:14.961450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.961378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn" event={"ID":"3899c7f4-a20d-46a7-9e41-63bde7ba26f7","Type":"ContainerDied","Data":"11a97a02b38d70278fd483e550893d53ca29797f3c6a78722caef23cd21df68a"}
Sep 20 02:21:14.961450 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.961403    2565 scope.go:117] "RemoveContainer" containerID="0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a"
Sep 20 02:21:14.970726 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.970706    2565 scope.go:117] "RemoveContainer" containerID="3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272"
Sep 20 02:21:14.978779 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.978763    2565 scope.go:117] "RemoveContainer" containerID="0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a"
Sep 20 02:21:14.979028 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:21:14.979013    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a\": container with ID starting with 0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a not found: ID does not exist" containerID="0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a"
Sep 20 02:21:14.979074 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.979037    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a"} err="failed to get container status \"0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a\": rpc error: code = NotFound desc = could not find container \"0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a\": container with ID starting with 0e7c12b16b28ff68b320d203fdbb9e1081b50592fc767e5c4ba99efd7f806f7a not found: ID does not exist"
Sep 20 02:21:14.979074 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.979053    2565 scope.go:117] "RemoveContainer" containerID="3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272"
Sep 20 02:21:14.979259 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:21:14.979238    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272\": container with ID starting with 3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272 not found: ID does not exist" containerID="3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272"
Sep 20 02:21:14.979301 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.979266    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272"} err="failed to get container status \"3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272\": rpc error: code = NotFound desc = could not find container \"3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272\": container with ID starting with 3061f9c71b4b531e21f2190c625df15580199e31b8d22e9a8d847d00b2169272 not found: ID does not exist"
Sep 20 02:21:14.982915 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.982893    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"]
Sep 20 02:21:14.986340 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:14.986320    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn"]
Sep 20 02:21:15.221409 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:15.221332    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" path="/var/lib/kubelet/pods/3899c7f4-a20d-46a7-9e41-63bde7ba26f7/volumes"
Sep 20 02:21:25.958742 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.958700    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"]
Sep 20 02:21:25.959292 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959271    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy"
Sep 20 02:21:25.959380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959296    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy"
Sep 20 02:21:25.959380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959321    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7839bfbd-953d-4eeb-9e11-d5ffa0641d7b" containerName="payload-pre-processing"
Sep 20 02:21:25.959380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959330    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7839bfbd-953d-4eeb-9e11-d5ffa0641d7b" containerName="payload-pre-processing"
Sep 20 02:21:25.959380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959347    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aed0c73-536a-469d-9710-e6e2fc9df99f" containerName="payload-processing"
Sep 20 02:21:25.959380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959357    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aed0c73-536a-469d-9710-e6e2fc9df99f" containerName="payload-processing"
Sep 20 02:21:25.959380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959367    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy"
Sep 20 02:21:25.959380 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959375    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy"
Sep 20 02:21:25.959754 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959401    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b91c677-1ad9-4e30-a1f1-075a3f863ac1" containerName="revoke-keys"
Sep 20 02:21:25.959754 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959409    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b91c677-1ad9-4e30-a1f1-075a3f863ac1" containerName="revoke-keys"
Sep 20 02:21:25.959754 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959494    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b91c677-1ad9-4e30-a1f1-075a3f863ac1" containerName="revoke-keys"
Sep 20 02:21:25.959754 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959510    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7839bfbd-953d-4eeb-9e11-d5ffa0641d7b" containerName="payload-pre-processing"
Sep 20 02:21:25.959754 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959523    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aed0c73-536a-469d-9710-e6e2fc9df99f" containerName="payload-processing"
Sep 20 02:21:25.959754 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959534    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy"
Sep 20 02:21:25.959754 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.959544    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3899c7f4-a20d-46a7-9e41-63bde7ba26f7" containerName="istio-proxy"
Sep 20 02:21:25.964353 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.964329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"
Sep 20 02:21:25.967907 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.967885    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:21:25.968042 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.967886    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:21:25.969354 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:25.969333    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"]
Sep 20 02:21:26.054091 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:26.054055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0942554-89b7-48fc-bff6-9614b5482527-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb\" (UID: \"d0942554-89b7-48fc-bff6-9614b5482527\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"
Sep 20 02:21:26.155581 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:26.155547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0942554-89b7-48fc-bff6-9614b5482527-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb\" (UID: \"d0942554-89b7-48fc-bff6-9614b5482527\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"
Sep 20 02:21:26.156151 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:26.156132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0942554-89b7-48fc-bff6-9614b5482527-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb\" (UID: \"d0942554-89b7-48fc-bff6-9614b5482527\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"
Sep 20 02:21:26.276620 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:26.276591    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"
Sep 20 02:21:26.548818 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:26.548776    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"]
Sep 20 02:21:26.550961 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:21:26.550929    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0942554_89b7_48fc_bff6_9614b5482527.slice/crio-0c10fdc855370a4ec3be85db31722ddcd465431ffa1f9ef324e23c8a760c4485 WatchSource:0}: Error finding container 0c10fdc855370a4ec3be85db31722ddcd465431ffa1f9ef324e23c8a760c4485: Status 404 returned error can't find the container with id 0c10fdc855370a4ec3be85db31722ddcd465431ffa1f9ef324e23c8a760c4485
Sep 20 02:21:27.025915 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:27.025883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb" event={"ID":"d0942554-89b7-48fc-bff6-9614b5482527","Type":"ContainerStarted","Data":"e385c070f9eb9160123c0017b1c7ee307f44fc2a31e110116087a5c8a32b9994"}
Sep 20 02:21:27.026334 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:27.025933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb" event={"ID":"d0942554-89b7-48fc-bff6-9614b5482527","Type":"ContainerStarted","Data":"0c10fdc855370a4ec3be85db31722ddcd465431ffa1f9ef324e23c8a760c4485"}
Sep 20 02:21:27.041964 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:27.041918    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb" podStartSLOduration=2.04190319 podStartE2EDuration="2.04190319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:21:27.041203545 +0000 UTC m=+1732.326215481" watchObservedRunningTime="2026-09-20 02:21:27.04190319 +0000 UTC m=+1732.326915124"
Sep 20 02:21:28.032376 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:28.032339    2565 generic.go:356] "Generic (PLEG): container finished" podID="d0942554-89b7-48fc-bff6-9614b5482527" containerID="e385c070f9eb9160123c0017b1c7ee307f44fc2a31e110116087a5c8a32b9994" exitCode=0
Sep 20 02:21:28.032836 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:28.032423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb" event={"ID":"d0942554-89b7-48fc-bff6-9614b5482527","Type":"ContainerDied","Data":"e385c070f9eb9160123c0017b1c7ee307f44fc2a31e110116087a5c8a32b9994"}
Sep 20 02:21:29.172375 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:29.172351    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"
Sep 20 02:21:29.285680 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:29.285648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0942554-89b7-48fc-bff6-9614b5482527-maas-api-service-ca\") pod \"d0942554-89b7-48fc-bff6-9614b5482527\" (UID: \"d0942554-89b7-48fc-bff6-9614b5482527\") "
Sep 20 02:21:29.286037 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:29.286012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0942554-89b7-48fc-bff6-9614b5482527-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d0942554-89b7-48fc-bff6-9614b5482527" (UID: "d0942554-89b7-48fc-bff6-9614b5482527"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:21:29.286152 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:29.286139    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0942554-89b7-48fc-bff6-9614b5482527-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:30.044262 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:30.044232    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"
Sep 20 02:21:30.044433 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:30.044263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb" event={"ID":"d0942554-89b7-48fc-bff6-9614b5482527","Type":"ContainerDied","Data":"0c10fdc855370a4ec3be85db31722ddcd465431ffa1f9ef324e23c8a760c4485"}
Sep 20 02:21:30.044433 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:30.044340    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c10fdc855370a4ec3be85db31722ddcd465431ffa1f9ef324e23c8a760c4485"
Sep 20 02:21:35.534681 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:35.534646    2565 scope.go:117] "RemoveContainer" containerID="e562e00835761077edc78546af72bce63c6fbfed9a5ec67c198affb4004aaa6e"
Sep 20 02:21:35.542452 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:35.542429    2565 scope.go:117] "RemoveContainer" containerID="8872d04cc78c6f53a3564e453d2c762d42fbcf397a5bf000764e9c3e6870d899"
Sep 20 02:21:41.838616 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:41.838579    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"]
Sep 20 02:21:41.840658 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:41.840634    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-b15051-88fxb"]
Sep 20 02:21:43.221244 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:43.221201    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0942554-89b7-48fc-bff6-9614b5482527" path="/var/lib/kubelet/pods/d0942554-89b7-48fc-bff6-9614b5482527/volumes"
Sep 20 02:21:48.250950 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:48.250912    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"]
Sep 20 02:21:48.251413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:48.251181    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy" containerID="cri-o://3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96" gracePeriod=30
Sep 20 02:21:53.499089 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.499064    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:21:53.603420 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istiod-ca-cert\") pod \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") "
Sep 20 02:21:53.603420 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-certs\") pod \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") "
Sep 20 02:21:53.603420 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603399    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-podinfo\") pod \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") "
Sep 20 02:21:53.603704 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-data\") pod \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") "
Sep 20 02:21:53.603704 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603454    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f42bt\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-kube-api-access-f42bt\") pod \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") "
Sep 20 02:21:53.603704 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603488    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-envoy\") pod \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") "
Sep 20 02:21:53.603704 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603527    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-token\") pod \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") "
Sep 20 02:21:53.603704 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603568    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-credential-socket\") pod \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") "
Sep 20 02:21:53.603704 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603608    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-socket\") pod \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\" (UID: \"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430\") "
Sep 20 02:21:53.603704 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603633    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" (UID: "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:53.604119 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603839    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" (UID: "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:53.604119 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.603863    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" (UID: "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:21:53.604119 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.604038    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" (UID: "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:53.604119 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.604058    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" (UID: "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:53.604337 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.604145    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istiod-ca-cert\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:53.604337 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.604162    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-certs\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:53.604337 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.604175    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-data\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:53.604337 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.604187    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-credential-socket\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:53.604337 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.604201    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-workload-socket\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:53.605708 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.605679    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" (UID: "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 02:21:53.605840 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.605772    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" (UID: "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:21:53.605840 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.605778    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" (UID: "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 02:21:53.605926 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.605844    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-kube-api-access-f42bt" (OuterVolumeSpecName: "kube-api-access-f42bt") pod "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" (UID: "bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430"). InnerVolumeSpecName "kube-api-access-f42bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:21:53.705363 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.705329    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-podinfo\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:53.705363 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.705358    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f42bt\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-kube-api-access-f42bt\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:53.705363 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.705369    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-envoy\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:53.705601 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:53.705378    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430-istio-token\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:21:54.171131 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.171093    2565 generic.go:356] "Generic (PLEG): container finished" podID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerID="3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96" exitCode=0
Sep 20 02:21:54.171313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.171145    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"
Sep 20 02:21:54.171313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.171177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" event={"ID":"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430","Type":"ContainerDied","Data":"3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96"}
Sep 20 02:21:54.171313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.171242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c" event={"ID":"bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430","Type":"ContainerDied","Data":"e33301acd5af77031de09b743089710b357ec659d25cb1023798f869fb6ba05e"}
Sep 20 02:21:54.171313 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.171280    2565 scope.go:117] "RemoveContainer" containerID="3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96"
Sep 20 02:21:54.180686 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.180670    2565 scope.go:117] "RemoveContainer" containerID="dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae"
Sep 20 02:21:54.188250 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.188231    2565 scope.go:117] "RemoveContainer" containerID="3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96"
Sep 20 02:21:54.188495 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:21:54.188472    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96\": container with ID starting with 3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96 not found: ID does not exist" containerID="3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96"
Sep 20 02:21:54.188547 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.188503    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96"} err="failed to get container status \"3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96\": rpc error: code = NotFound desc = could not find container \"3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96\": container with ID starting with 3aa692fb25a1ffca3c8029e70216e42b6c5ddbfe75323512ba97d93b315cef96 not found: ID does not exist"
Sep 20 02:21:54.188547 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.188528    2565 scope.go:117] "RemoveContainer" containerID="dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae"
Sep 20 02:21:54.188760 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:21:54.188743    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae\": container with ID starting with dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae not found: ID does not exist" containerID="dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae"
Sep 20 02:21:54.188836 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.188765    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae"} err="failed to get container status \"dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae\": rpc error: code = NotFound desc = could not find container \"dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae\": container with ID starting with dbf3c8b0480a7ea6b0700010cb20a015aecb50cd972fb1ddb7b0223486bb8fae not found: ID does not exist"
Sep 20 02:21:54.192256 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.192234    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"]
Sep 20 02:21:54.198934 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:54.198913    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c"]
Sep 20 02:21:55.219651 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:21:55.219609    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" path="/var/lib/kubelet/pods/bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430/volumes"
Sep 20 02:22:35.584242 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:22:35.584211    2565 scope.go:117] "RemoveContainer" containerID="08d3c0cd8df1708438c25becd4e68bb81dfb84b993fbb4c301276598914b7247"
Sep 20 02:24:55.958894 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.958856    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"]
Sep 20 02:24:55.959413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.959306    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy"
Sep 20 02:24:55.959413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.959323    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy"
Sep 20 02:24:55.959413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.959336    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy"
Sep 20 02:24:55.959413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.959341    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy"
Sep 20 02:24:55.959413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.959362    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0942554-89b7-48fc-bff6-9614b5482527" containerName="revoke-keys"
Sep 20 02:24:55.959413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.959372    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0942554-89b7-48fc-bff6-9614b5482527" containerName="revoke-keys"
Sep 20 02:24:55.959615 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.959427    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy"
Sep 20 02:24:55.959615 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.959433    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc6cbadf-4c23-4a1c-9f8c-c3ad9cab7430" containerName="istio-proxy"
Sep 20 02:24:55.959615 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.959442    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0942554-89b7-48fc-bff6-9614b5482527" containerName="revoke-keys"
Sep 20 02:24:55.962130 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.962111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:24:55.968636 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.968615    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-ec8b82-dockercfg-lt978\""
Sep 20 02:24:55.968720 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.968697    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-ec8b82\""
Sep 20 02:24:55.987386 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:55.987358    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"]
Sep 20 02:24:56.076896 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:56.076861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f70a059-b81d-4beb-bd89-099d83ced14a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb\" (UID: \"6f70a059-b81d-4beb-bd89-099d83ced14a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:24:56.077071 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:56.076963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2ws5\" (UniqueName: \"kubernetes.io/projected/6f70a059-b81d-4beb-bd89-099d83ced14a-kube-api-access-s2ws5\") pod \"payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb\" (UID: \"6f70a059-b81d-4beb-bd89-099d83ced14a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:24:56.177847 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:56.177779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f70a059-b81d-4beb-bd89-099d83ced14a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb\" (UID: \"6f70a059-b81d-4beb-bd89-099d83ced14a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:24:56.178048 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:56.177885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2ws5\" (UniqueName: \"kubernetes.io/projected/6f70a059-b81d-4beb-bd89-099d83ced14a-kube-api-access-s2ws5\") pod \"payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb\" (UID: \"6f70a059-b81d-4beb-bd89-099d83ced14a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:24:56.178491 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:56.178466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f70a059-b81d-4beb-bd89-099d83ced14a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb\" (UID: \"6f70a059-b81d-4beb-bd89-099d83ced14a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:24:56.187568 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:56.187543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2ws5\" (UniqueName: \"kubernetes.io/projected/6f70a059-b81d-4beb-bd89-099d83ced14a-kube-api-access-s2ws5\") pod \"payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb\" (UID: \"6f70a059-b81d-4beb-bd89-099d83ced14a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:24:56.272156 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:56.272106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:24:56.597783 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:56.597754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"]
Sep 20 02:24:56.600662 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:24:56.600634    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f70a059_b81d_4beb_bd89_099d83ced14a.slice/crio-58933ffc96655c2645ee2a4a636d0f71c20ac925314e338b3f182d831940a845 WatchSource:0}: Error finding container 58933ffc96655c2645ee2a4a636d0f71c20ac925314e338b3f182d831940a845: Status 404 returned error can't find the container with id 58933ffc96655c2645ee2a4a636d0f71c20ac925314e338b3f182d831940a845
Sep 20 02:24:57.095126 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:57.095092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb" event={"ID":"6f70a059-b81d-4beb-bd89-099d83ced14a","Type":"ContainerStarted","Data":"fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30"}
Sep 20 02:24:57.095600 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:57.095142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb" event={"ID":"6f70a059-b81d-4beb-bd89-099d83ced14a","Type":"ContainerStarted","Data":"58933ffc96655c2645ee2a4a636d0f71c20ac925314e338b3f182d831940a845"}
Sep 20 02:24:57.095600 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:24:57.095171    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:25:08.102538 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:08.102508    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:25:08.130626 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:08.130577    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb" podStartSLOduration=13.130562068 podStartE2EDuration="13.130562068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:24:57.168245425 +0000 UTC m=+1942.453257360" watchObservedRunningTime="2026-09-20 02:25:08.130562068 +0000 UTC m=+1953.415574003"
Sep 20 02:25:30.139412 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.139328    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"]
Sep 20 02:25:30.143035 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.143017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:25:30.146451 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.146431    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-6be25a-dockercfg-g6k7p\""
Sep 20 02:25:30.146653 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.146640    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-6be25a\""
Sep 20 02:25:30.155921 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.155896    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"]
Sep 20 02:25:30.191083 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.191048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5\" (UID: \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:25:30.191278 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.191124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ncf8\" (UniqueName: \"kubernetes.io/projected/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-kube-api-access-4ncf8\") pod \"payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5\" (UID: \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:25:30.291630 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.291595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5\" (UID: \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:25:30.291630 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.291644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ncf8\" (UniqueName: \"kubernetes.io/projected/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-kube-api-access-4ncf8\") pod \"payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5\" (UID: \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:25:30.292307 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.292287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5\" (UID: \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:25:30.301116 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.301093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ncf8\" (UniqueName: \"kubernetes.io/projected/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-kube-api-access-4ncf8\") pod \"payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5\" (UID: \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:25:30.452997 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.452907    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:25:30.727739 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:30.727704    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"]
Sep 20 02:25:30.729690 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:25:30.729661    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0d3a84_f4e4_4860_8999_d25d1179d2d0.slice/crio-3ca294f1d6beab6a9c224e79755ac95dfdc780136d969eec0c6f188e82e129e5 WatchSource:0}: Error finding container 3ca294f1d6beab6a9c224e79755ac95dfdc780136d969eec0c6f188e82e129e5: Status 404 returned error can't find the container with id 3ca294f1d6beab6a9c224e79755ac95dfdc780136d969eec0c6f188e82e129e5
Sep 20 02:25:31.275710 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:31.275661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5" event={"ID":"6b0d3a84-f4e4-4860-8999-d25d1179d2d0","Type":"ContainerStarted","Data":"5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab"}
Sep 20 02:25:31.276215 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:31.275740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5" event={"ID":"6b0d3a84-f4e4-4860-8999-d25d1179d2d0","Type":"ContainerStarted","Data":"3ca294f1d6beab6a9c224e79755ac95dfdc780136d969eec0c6f188e82e129e5"}
Sep 20 02:25:31.276215 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:31.275891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:25:31.294460 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:31.294411    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5" podStartSLOduration=1.294396165 podStartE2EDuration="1.294396165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:25:31.293296322 +0000 UTC m=+1976.578308262" watchObservedRunningTime="2026-09-20 02:25:31.294396165 +0000 UTC m=+1976.579408099"
Sep 20 02:25:35.627581 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:35.627549    2565 scope.go:117] "RemoveContainer" containerID="11fa0e31331ac79146ba4912424d06d4cc25be54672fa748eb146fa00582c559"
Sep 20 02:25:42.284610 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:25:42.284576    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:26:00.252054 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:00.252024    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5vxjh_7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04/payload-processing/0.log"
Sep 20 02:26:31.358115 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:31.358082    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb_6f70a059-b81d-4beb-bd89-099d83ced14a/payload-processing/0.log"
Sep 20 02:26:31.478962 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:31.478933    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5vxjh_7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04/payload-processing/0.log"
Sep 20 02:26:35.646393 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:35.646363    2565 scope.go:117] "RemoveContainer" containerID="ef80193c6f8757b4d2e62ce9d092d7e343a1be1db4d3baf31905622527933253"
Sep 20 02:26:35.654637 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:35.654617    2565 scope.go:117] "RemoveContainer" containerID="5ea19aca66c842c020b19867c5404e9993f31e36760914b32f6f0cddf02fed82"
Sep 20 02:26:35.661753 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:35.661735    2565 scope.go:117] "RemoveContainer" containerID="3e7642b1ad59e9fdf8037f5ab492ef15165fd38836f04a54828a48d760656a83"
Sep 20 02:26:39.110030 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.109994    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"]
Sep 20 02:26:39.115172 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.115152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:26:39.117626 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.117606    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-d26a0a\""
Sep 20 02:26:39.118036 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.118011    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-d26a0a-dockercfg-rr85b\""
Sep 20 02:26:39.123837 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.123816    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"]
Sep 20 02:26:39.127722 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.127703    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"]
Sep 20 02:26:39.127828 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.127811    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:39.145506 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.145465    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"]
Sep 20 02:26:39.223896 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.223683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c43086a-44c3-450e-9b71-2bd011c19c91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz\" (UID: \"9c43086a-44c3-450e-9b71-2bd011c19c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:26:39.223896 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.223744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea6cce2b-0719-4dcf-b270-a49021185ae6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j\" (UID: \"ea6cce2b-0719-4dcf-b270-a49021185ae6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:39.223896 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.223775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tnr5\" (UniqueName: \"kubernetes.io/projected/ea6cce2b-0719-4dcf-b270-a49021185ae6-kube-api-access-8tnr5\") pod \"payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j\" (UID: \"ea6cce2b-0719-4dcf-b270-a49021185ae6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:39.223896 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.223838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhs5\" (UniqueName: \"kubernetes.io/projected/9c43086a-44c3-450e-9b71-2bd011c19c91-kube-api-access-fmhs5\") pod \"payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz\" (UID: \"9c43086a-44c3-450e-9b71-2bd011c19c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:26:39.325330 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.325292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c43086a-44c3-450e-9b71-2bd011c19c91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz\" (UID: \"9c43086a-44c3-450e-9b71-2bd011c19c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:26:39.325533 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.325337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea6cce2b-0719-4dcf-b270-a49021185ae6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j\" (UID: \"ea6cce2b-0719-4dcf-b270-a49021185ae6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:39.325533 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.325364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tnr5\" (UniqueName: \"kubernetes.io/projected/ea6cce2b-0719-4dcf-b270-a49021185ae6-kube-api-access-8tnr5\") pod \"payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j\" (UID: \"ea6cce2b-0719-4dcf-b270-a49021185ae6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:39.325533 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.325392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhs5\" (UniqueName: \"kubernetes.io/projected/9c43086a-44c3-450e-9b71-2bd011c19c91-kube-api-access-fmhs5\") pod \"payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz\" (UID: \"9c43086a-44c3-450e-9b71-2bd011c19c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:26:39.326113 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.326094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea6cce2b-0719-4dcf-b270-a49021185ae6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j\" (UID: \"ea6cce2b-0719-4dcf-b270-a49021185ae6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:39.326178 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.326096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c43086a-44c3-450e-9b71-2bd011c19c91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz\" (UID: \"9c43086a-44c3-450e-9b71-2bd011c19c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:26:39.333717 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.333692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhs5\" (UniqueName: \"kubernetes.io/projected/9c43086a-44c3-450e-9b71-2bd011c19c91-kube-api-access-fmhs5\") pod \"payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz\" (UID: \"9c43086a-44c3-450e-9b71-2bd011c19c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:26:39.333879 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.333860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tnr5\" (UniqueName: \"kubernetes.io/projected/ea6cce2b-0719-4dcf-b270-a49021185ae6-kube-api-access-8tnr5\") pod \"payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j\" (UID: \"ea6cce2b-0719-4dcf-b270-a49021185ae6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:39.426626 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.426530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:26:39.437909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.437876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:39.701644 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.701616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"]
Sep 20 02:26:39.703498 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:26:39.703471    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c43086a_44c3_450e_9b71_2bd011c19c91.slice/crio-5bd28c9b393683c208e248c80e574d7b20a33a95860b3786ca5996a889418218 WatchSource:0}: Error finding container 5bd28c9b393683c208e248c80e574d7b20a33a95860b3786ca5996a889418218: Status 404 returned error can't find the container with id 5bd28c9b393683c208e248c80e574d7b20a33a95860b3786ca5996a889418218
Sep 20 02:26:39.722132 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:39.722111    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"]
Sep 20 02:26:39.725910 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:26:39.725886    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6cce2b_0719_4dcf_b270_a49021185ae6.slice/crio-0dbe0e2476cbae5e725233bd594b5d44bc78f19becc15c16285e685d572faf9e WatchSource:0}: Error finding container 0dbe0e2476cbae5e725233bd594b5d44bc78f19becc15c16285e685d572faf9e: Status 404 returned error can't find the container with id 0dbe0e2476cbae5e725233bd594b5d44bc78f19becc15c16285e685d572faf9e
Sep 20 02:26:40.631331 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:40.631294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j" event={"ID":"ea6cce2b-0719-4dcf-b270-a49021185ae6","Type":"ContainerStarted","Data":"f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462"}
Sep 20 02:26:40.631851 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:40.631356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j" event={"ID":"ea6cce2b-0719-4dcf-b270-a49021185ae6","Type":"ContainerStarted","Data":"0dbe0e2476cbae5e725233bd594b5d44bc78f19becc15c16285e685d572faf9e"}
Sep 20 02:26:40.631851 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:40.631396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:40.633022 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:40.633002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz" event={"ID":"9c43086a-44c3-450e-9b71-2bd011c19c91","Type":"ContainerStarted","Data":"eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71"}
Sep 20 02:26:40.633085 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:40.633042    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:26:40.633085 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:40.633060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz" event={"ID":"9c43086a-44c3-450e-9b71-2bd011c19c91","Type":"ContainerStarted","Data":"5bd28c9b393683c208e248c80e574d7b20a33a95860b3786ca5996a889418218"}
Sep 20 02:26:40.649618 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:40.649568    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j" podStartSLOduration=1.64955019 podStartE2EDuration="1.64955019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:26:40.648764021 +0000 UTC m=+2045.933775959" watchObservedRunningTime="2026-09-20 02:26:40.64955019 +0000 UTC m=+2045.934562131"
Sep 20 02:26:40.664266 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:40.664222    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz" podStartSLOduration=1.664204186 podStartE2EDuration="1.664204186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 02:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:26:40.664191507 +0000 UTC m=+2045.949203442" watchObservedRunningTime="2026-09-20 02:26:40.664204186 +0000 UTC m=+2045.949216125"
Sep 20 02:26:51.639640 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:51.639611    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:26:51.640031 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:26:51.639732    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:27:06.027570 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.027489    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"]
Sep 20 02:27:06.031142 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.031122    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"
Sep 20 02:27:06.033465 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.033439    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:27:06.033585 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.033531    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:27:06.038182 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.038159    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"]
Sep 20 02:27:06.067174 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.067149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/870822b8-2878-4fe9-9bc6-f7c7a701695c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk\" (UID: \"870822b8-2878-4fe9-9bc6-f7c7a701695c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"
Sep 20 02:27:06.167953 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.167917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/870822b8-2878-4fe9-9bc6-f7c7a701695c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk\" (UID: \"870822b8-2878-4fe9-9bc6-f7c7a701695c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"
Sep 20 02:27:06.168536 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.168511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/870822b8-2878-4fe9-9bc6-f7c7a701695c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk\" (UID: \"870822b8-2878-4fe9-9bc6-f7c7a701695c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"
Sep 20 02:27:06.342990 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.342919    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"
Sep 20 02:27:06.613751 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.613709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"]
Sep 20 02:27:06.616380 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:27:06.616351    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870822b8_2878_4fe9_9bc6_f7c7a701695c.slice/crio-c9ea6e5f72e7ca1756e7edbc021235d5398de01b351f4446006064dc7a0f72fa WatchSource:0}: Error finding container c9ea6e5f72e7ca1756e7edbc021235d5398de01b351f4446006064dc7a0f72fa: Status 404 returned error can't find the container with id c9ea6e5f72e7ca1756e7edbc021235d5398de01b351f4446006064dc7a0f72fa
Sep 20 02:27:06.764317 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:06.764284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk" event={"ID":"870822b8-2878-4fe9-9bc6-f7c7a701695c","Type":"ContainerStarted","Data":"c9ea6e5f72e7ca1756e7edbc021235d5398de01b351f4446006064dc7a0f72fa"}
Sep 20 02:27:07.770327 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:07.770284    2565 generic.go:356] "Generic (PLEG): container finished" podID="870822b8-2878-4fe9-9bc6-f7c7a701695c" containerID="b184ad87a3f3acd2a8133f2a09bad4e364d3096a0f7ca11dcd1c8fd48ac2c7f6" exitCode=0
Sep 20 02:27:07.770726 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:07.770366    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk" event={"ID":"870822b8-2878-4fe9-9bc6-f7c7a701695c","Type":"ContainerDied","Data":"b184ad87a3f3acd2a8133f2a09bad4e364d3096a0f7ca11dcd1c8fd48ac2c7f6"}
Sep 20 02:27:08.912283 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:08.912257    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"
Sep 20 02:27:08.991508 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:08.991475    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/870822b8-2878-4fe9-9bc6-f7c7a701695c-maas-api-service-ca\") pod \"870822b8-2878-4fe9-9bc6-f7c7a701695c\" (UID: \"870822b8-2878-4fe9-9bc6-f7c7a701695c\") "
Sep 20 02:27:08.991784 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:08.991763    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/870822b8-2878-4fe9-9bc6-f7c7a701695c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "870822b8-2878-4fe9-9bc6-f7c7a701695c" (UID: "870822b8-2878-4fe9-9bc6-f7c7a701695c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:27:09.093279 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:09.093191    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/870822b8-2878-4fe9-9bc6-f7c7a701695c-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:27:09.783982 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:09.783952    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"
Sep 20 02:27:09.783982 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:09.783978    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk" event={"ID":"870822b8-2878-4fe9-9bc6-f7c7a701695c","Type":"ContainerDied","Data":"c9ea6e5f72e7ca1756e7edbc021235d5398de01b351f4446006064dc7a0f72fa"}
Sep 20 02:27:09.784188 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:09.784019    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9ea6e5f72e7ca1756e7edbc021235d5398de01b351f4446006064dc7a0f72fa"
Sep 20 02:27:17.023578 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.023544    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"]
Sep 20 02:27:17.023986 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.023764    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j" podUID="ea6cce2b-0719-4dcf-b270-a49021185ae6" containerName="payload-processing" containerID="cri-o://f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462" gracePeriod=30
Sep 20 02:27:17.030120 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.030091    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"]
Sep 20 02:27:17.030384 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.030324    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz" podUID="9c43086a-44c3-450e-9b71-2bd011c19c91" containerName="payload-pre-processing" containerID="cri-o://eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71" gracePeriod=30
Sep 20 02:27:17.236289 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.236263    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"]
Sep 20 02:27:17.242358 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.242172    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d26a0a-zz5kk"]
Sep 20 02:27:17.314607 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.314561    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:27:17.323408 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.323382    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:27:17.369562 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.369522    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tnr5\" (UniqueName: \"kubernetes.io/projected/ea6cce2b-0719-4dcf-b270-a49021185ae6-kube-api-access-8tnr5\") pod \"ea6cce2b-0719-4dcf-b270-a49021185ae6\" (UID: \"ea6cce2b-0719-4dcf-b270-a49021185ae6\") "
Sep 20 02:27:17.369761 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.369590    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmhs5\" (UniqueName: \"kubernetes.io/projected/9c43086a-44c3-450e-9b71-2bd011c19c91-kube-api-access-fmhs5\") pod \"9c43086a-44c3-450e-9b71-2bd011c19c91\" (UID: \"9c43086a-44c3-450e-9b71-2bd011c19c91\") "
Sep 20 02:27:17.369761 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.369664    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c43086a-44c3-450e-9b71-2bd011c19c91-plugins-config-volume\") pod \"9c43086a-44c3-450e-9b71-2bd011c19c91\" (UID: \"9c43086a-44c3-450e-9b71-2bd011c19c91\") "
Sep 20 02:27:17.369761 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.369707    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea6cce2b-0719-4dcf-b270-a49021185ae6-plugins-config-volume\") pod \"ea6cce2b-0719-4dcf-b270-a49021185ae6\" (UID: \"ea6cce2b-0719-4dcf-b270-a49021185ae6\") "
Sep 20 02:27:17.370349 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.370314    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c43086a-44c3-450e-9b71-2bd011c19c91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c43086a-44c3-450e-9b71-2bd011c19c91" (UID: "9c43086a-44c3-450e-9b71-2bd011c19c91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:27:17.370479 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.370353    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6cce2b-0719-4dcf-b270-a49021185ae6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea6cce2b-0719-4dcf-b270-a49021185ae6" (UID: "ea6cce2b-0719-4dcf-b270-a49021185ae6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:27:17.372242 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.372214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c43086a-44c3-450e-9b71-2bd011c19c91-kube-api-access-fmhs5" (OuterVolumeSpecName: "kube-api-access-fmhs5") pod "9c43086a-44c3-450e-9b71-2bd011c19c91" (UID: "9c43086a-44c3-450e-9b71-2bd011c19c91"). InnerVolumeSpecName "kube-api-access-fmhs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:27:17.373112 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.373076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea6cce2b-0719-4dcf-b270-a49021185ae6-kube-api-access-8tnr5" (OuterVolumeSpecName: "kube-api-access-8tnr5") pod "ea6cce2b-0719-4dcf-b270-a49021185ae6" (UID: "ea6cce2b-0719-4dcf-b270-a49021185ae6"). InnerVolumeSpecName "kube-api-access-8tnr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:27:17.471429 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.471391    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tnr5\" (UniqueName: \"kubernetes.io/projected/ea6cce2b-0719-4dcf-b270-a49021185ae6-kube-api-access-8tnr5\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:27:17.471429 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.471418    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmhs5\" (UniqueName: \"kubernetes.io/projected/9c43086a-44c3-450e-9b71-2bd011c19c91-kube-api-access-fmhs5\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:27:17.471429 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.471430    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c43086a-44c3-450e-9b71-2bd011c19c91-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:27:17.471429 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.471438    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea6cce2b-0719-4dcf-b270-a49021185ae6-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:27:17.824233 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.824196    2565 generic.go:356] "Generic (PLEG): container finished" podID="ea6cce2b-0719-4dcf-b270-a49021185ae6" containerID="f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462" exitCode=0
Sep 20 02:27:17.824429 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.824239    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"
Sep 20 02:27:17.824429 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.824279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j" event={"ID":"ea6cce2b-0719-4dcf-b270-a49021185ae6","Type":"ContainerDied","Data":"f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462"}
Sep 20 02:27:17.824429 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.824353    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j" event={"ID":"ea6cce2b-0719-4dcf-b270-a49021185ae6","Type":"ContainerDied","Data":"0dbe0e2476cbae5e725233bd594b5d44bc78f19becc15c16285e685d572faf9e"}
Sep 20 02:27:17.824429 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.824375    2565 scope.go:117] "RemoveContainer" containerID="f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462"
Sep 20 02:27:17.825740 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.825720    2565 generic.go:356] "Generic (PLEG): container finished" podID="9c43086a-44c3-450e-9b71-2bd011c19c91" containerID="eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71" exitCode=0
Sep 20 02:27:17.825881 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.825772    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"
Sep 20 02:27:17.825881 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.825820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz" event={"ID":"9c43086a-44c3-450e-9b71-2bd011c19c91","Type":"ContainerDied","Data":"eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71"}
Sep 20 02:27:17.825881 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.825864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz" event={"ID":"9c43086a-44c3-450e-9b71-2bd011c19c91","Type":"ContainerDied","Data":"5bd28c9b393683c208e248c80e574d7b20a33a95860b3786ca5996a889418218"}
Sep 20 02:27:17.833152 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.833126    2565 scope.go:117] "RemoveContainer" containerID="f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462"
Sep 20 02:27:17.833430 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:27:17.833411    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462\": container with ID starting with f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462 not found: ID does not exist" containerID="f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462"
Sep 20 02:27:17.833508 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.833441    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462"} err="failed to get container status \"f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462\": rpc error: code = NotFound desc = could not find container \"f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462\": container with ID starting with f44d52c4fc2d510c440834c9753e0a7e1d579f310a9fc6db5e58865619ca8462 not found: ID does not exist"
Sep 20 02:27:17.833508 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.833465    2565 scope.go:117] "RemoveContainer" containerID="eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71"
Sep 20 02:27:17.841557 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.841539    2565 scope.go:117] "RemoveContainer" containerID="eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71"
Sep 20 02:27:17.841829 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:27:17.841810    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71\": container with ID starting with eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71 not found: ID does not exist" containerID="eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71"
Sep 20 02:27:17.841903 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.841839    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71"} err="failed to get container status \"eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71\": rpc error: code = NotFound desc = could not find container \"eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71\": container with ID starting with eac4bfcf3e653b907c73875dcb0bb9a8ad670a5c6b69e8e677a35011e1d0ca71 not found: ID does not exist"
Sep 20 02:27:17.850777 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.850755    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"]
Sep 20 02:27:17.857369 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.857344    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j"]
Sep 20 02:27:17.867904 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.867880    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"]
Sep 20 02:27:17.872032 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:17.872013    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz"]
Sep 20 02:27:19.220938 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:19.220908    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="870822b8-2878-4fe9-9bc6-f7c7a701695c" path="/var/lib/kubelet/pods/870822b8-2878-4fe9-9bc6-f7c7a701695c/volumes"
Sep 20 02:27:19.221322 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:19.221289    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c43086a-44c3-450e-9b71-2bd011c19c91" path="/var/lib/kubelet/pods/9c43086a-44c3-450e-9b71-2bd011c19c91/volumes"
Sep 20 02:27:19.221614 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:19.221601    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea6cce2b-0719-4dcf-b270-a49021185ae6" path="/var/lib/kubelet/pods/ea6cce2b-0719-4dcf-b270-a49021185ae6/volumes"
Sep 20 02:27:27.332087 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332051    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"]
Sep 20 02:27:27.332620 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332600    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6cce2b-0719-4dcf-b270-a49021185ae6" containerName="payload-processing"
Sep 20 02:27:27.332705 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332624    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6cce2b-0719-4dcf-b270-a49021185ae6" containerName="payload-processing"
Sep 20 02:27:27.332705 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332671    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="870822b8-2878-4fe9-9bc6-f7c7a701695c" containerName="revoke-keys"
Sep 20 02:27:27.332705 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332681    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="870822b8-2878-4fe9-9bc6-f7c7a701695c" containerName="revoke-keys"
Sep 20 02:27:27.332705 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332694    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c43086a-44c3-450e-9b71-2bd011c19c91" containerName="payload-pre-processing"
Sep 20 02:27:27.332705 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332704    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c43086a-44c3-450e-9b71-2bd011c19c91" containerName="payload-pre-processing"
Sep 20 02:27:27.333006 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332816    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="870822b8-2878-4fe9-9bc6-f7c7a701695c" containerName="revoke-keys"
Sep 20 02:27:27.333006 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332829    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea6cce2b-0719-4dcf-b270-a49021185ae6" containerName="payload-processing"
Sep 20 02:27:27.333006 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.332843    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c43086a-44c3-450e-9b71-2bd011c19c91" containerName="payload-pre-processing"
Sep 20 02:27:27.337706 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.337681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"
Sep 20 02:27:27.340551 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.340323    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:27:27.341277 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.341253    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:27:27.343729 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.343705    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"]
Sep 20 02:27:27.467216 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.467173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30a812d-d228-45ed-85c4-ff8d5fc46320-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2\" (UID: \"a30a812d-d228-45ed-85c4-ff8d5fc46320\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"
Sep 20 02:27:27.568623 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.568589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30a812d-d228-45ed-85c4-ff8d5fc46320-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2\" (UID: \"a30a812d-d228-45ed-85c4-ff8d5fc46320\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"
Sep 20 02:27:27.569222 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.569200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30a812d-d228-45ed-85c4-ff8d5fc46320-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2\" (UID: \"a30a812d-d228-45ed-85c4-ff8d5fc46320\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"
Sep 20 02:27:27.649410 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.649326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"
Sep 20 02:27:27.919304 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:27.919278    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"]
Sep 20 02:27:27.921330 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:27:27.921304    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30a812d_d228_45ed_85c4_ff8d5fc46320.slice/crio-1ad55764e7aed693e8d1d5a8eabe5895a6f85ee51601411f1b78eb1f58bab294 WatchSource:0}: Error finding container 1ad55764e7aed693e8d1d5a8eabe5895a6f85ee51601411f1b78eb1f58bab294: Status 404 returned error can't find the container with id 1ad55764e7aed693e8d1d5a8eabe5895a6f85ee51601411f1b78eb1f58bab294
Sep 20 02:27:28.886377 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:28.886346    2565 generic.go:356] "Generic (PLEG): container finished" podID="a30a812d-d228-45ed-85c4-ff8d5fc46320" containerID="30b111c946cc181c4349b60da75c42bd6ff386a62ef28499fcb99a18a734684e" exitCode=0
Sep 20 02:27:28.886742 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:28.886434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2" event={"ID":"a30a812d-d228-45ed-85c4-ff8d5fc46320","Type":"ContainerDied","Data":"30b111c946cc181c4349b60da75c42bd6ff386a62ef28499fcb99a18a734684e"}
Sep 20 02:27:28.886742 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:28.886490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2" event={"ID":"a30a812d-d228-45ed-85c4-ff8d5fc46320","Type":"ContainerStarted","Data":"1ad55764e7aed693e8d1d5a8eabe5895a6f85ee51601411f1b78eb1f58bab294"}
Sep 20 02:27:30.029137 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:30.029113    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"
Sep 20 02:27:30.195159 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:30.195073    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30a812d-d228-45ed-85c4-ff8d5fc46320-maas-api-service-ca\") pod \"a30a812d-d228-45ed-85c4-ff8d5fc46320\" (UID: \"a30a812d-d228-45ed-85c4-ff8d5fc46320\") "
Sep 20 02:27:30.195457 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:30.195428    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a30a812d-d228-45ed-85c4-ff8d5fc46320-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a30a812d-d228-45ed-85c4-ff8d5fc46320" (UID: "a30a812d-d228-45ed-85c4-ff8d5fc46320"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:27:30.295978 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:30.295948    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30a812d-d228-45ed-85c4-ff8d5fc46320-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:27:30.897215 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:30.897182    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"
Sep 20 02:27:30.897393 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:30.897214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2" event={"ID":"a30a812d-d228-45ed-85c4-ff8d5fc46320","Type":"ContainerDied","Data":"1ad55764e7aed693e8d1d5a8eabe5895a6f85ee51601411f1b78eb1f58bab294"}
Sep 20 02:27:30.897393 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:30.897265    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ad55764e7aed693e8d1d5a8eabe5895a6f85ee51601411f1b78eb1f58bab294"
Sep 20 02:27:35.686805 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:35.686769    2565 scope.go:117] "RemoveContainer" containerID="53c1cfc5bd5999f2a2a557ccc4e9b88dc37bedf1d4e12097973cd5b32fe2838a"
Sep 20 02:27:35.694869 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:35.694850    2565 scope.go:117] "RemoveContainer" containerID="e385c070f9eb9160123c0017b1c7ee307f44fc2a31e110116087a5c8a32b9994"
Sep 20 02:27:43.015123 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.015084    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"]
Sep 20 02:27:43.015765 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.015357    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb" podUID="6f70a059-b81d-4beb-bd89-099d83ced14a" containerName="payload-processing" containerID="cri-o://fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30" gracePeriod=30
Sep 20 02:27:43.200441 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.200409    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"]
Sep 20 02:27:43.206012 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.205986    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ec8b82-6l6d2"]
Sep 20 02:27:43.220736 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.220704    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a30a812d-d228-45ed-85c4-ff8d5fc46320" path="/var/lib/kubelet/pods/a30a812d-d228-45ed-85c4-ff8d5fc46320/volumes"
Sep 20 02:27:43.300361 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.300337    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:27:43.314044 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.314011    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2ws5\" (UniqueName: \"kubernetes.io/projected/6f70a059-b81d-4beb-bd89-099d83ced14a-kube-api-access-s2ws5\") pod \"6f70a059-b81d-4beb-bd89-099d83ced14a\" (UID: \"6f70a059-b81d-4beb-bd89-099d83ced14a\") "
Sep 20 02:27:43.314202 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.314052    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f70a059-b81d-4beb-bd89-099d83ced14a-plugins-config-volume\") pod \"6f70a059-b81d-4beb-bd89-099d83ced14a\" (UID: \"6f70a059-b81d-4beb-bd89-099d83ced14a\") "
Sep 20 02:27:43.314459 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.314433    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f70a059-b81d-4beb-bd89-099d83ced14a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f70a059-b81d-4beb-bd89-099d83ced14a" (UID: "6f70a059-b81d-4beb-bd89-099d83ced14a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:27:43.316256 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.316231    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f70a059-b81d-4beb-bd89-099d83ced14a-kube-api-access-s2ws5" (OuterVolumeSpecName: "kube-api-access-s2ws5") pod "6f70a059-b81d-4beb-bd89-099d83ced14a" (UID: "6f70a059-b81d-4beb-bd89-099d83ced14a"). InnerVolumeSpecName "kube-api-access-s2ws5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:27:43.415262 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.415229    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2ws5\" (UniqueName: \"kubernetes.io/projected/6f70a059-b81d-4beb-bd89-099d83ced14a-kube-api-access-s2ws5\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:27:43.415262 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.415256    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f70a059-b81d-4beb-bd89-099d83ced14a-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:27:43.973153 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.973118    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f70a059-b81d-4beb-bd89-099d83ced14a" containerID="fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30" exitCode=0
Sep 20 02:27:43.973327 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.973164    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"
Sep 20 02:27:43.973327 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.973175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb" event={"ID":"6f70a059-b81d-4beb-bd89-099d83ced14a","Type":"ContainerDied","Data":"fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30"}
Sep 20 02:27:43.973327 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.973216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb" event={"ID":"6f70a059-b81d-4beb-bd89-099d83ced14a","Type":"ContainerDied","Data":"58933ffc96655c2645ee2a4a636d0f71c20ac925314e338b3f182d831940a845"}
Sep 20 02:27:43.973327 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.973237    2565 scope.go:117] "RemoveContainer" containerID="fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30"
Sep 20 02:27:43.982101 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.982079    2565 scope.go:117] "RemoveContainer" containerID="fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30"
Sep 20 02:27:43.982369 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:27:43.982350    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30\": container with ID starting with fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30 not found: ID does not exist" containerID="fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30"
Sep 20 02:27:43.982433 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.982382    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30"} err="failed to get container status \"fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30\": rpc error: code = NotFound desc = could not find container \"fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30\": container with ID starting with fbd46e0938531f77cf78d295f26f2cf7539e79c6d6a4c2ed87c4133b5a361f30 not found: ID does not exist"
Sep 20 02:27:43.993351 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.993331    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"]
Sep 20 02:27:43.995500 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:43.995476    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb"]
Sep 20 02:27:45.220295 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:27:45.220261    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f70a059-b81d-4beb-bd89-099d83ced14a" path="/var/lib/kubelet/pods/6f70a059-b81d-4beb-bd89-099d83ced14a/volumes"
Sep 20 02:28:37.831070 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.831030    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"]
Sep 20 02:28:37.831468 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.831419    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a30a812d-d228-45ed-85c4-ff8d5fc46320" containerName="revoke-keys"
Sep 20 02:28:37.831468 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.831430    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a30a812d-d228-45ed-85c4-ff8d5fc46320" containerName="revoke-keys"
Sep 20 02:28:37.831468 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.831439    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f70a059-b81d-4beb-bd89-099d83ced14a" containerName="payload-processing"
Sep 20 02:28:37.831468 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.831445    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f70a059-b81d-4beb-bd89-099d83ced14a" containerName="payload-processing"
Sep 20 02:28:37.831603 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.831498    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a30a812d-d228-45ed-85c4-ff8d5fc46320" containerName="revoke-keys"
Sep 20 02:28:37.831603 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.831509    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f70a059-b81d-4beb-bd89-099d83ced14a" containerName="payload-processing"
Sep 20 02:28:37.835646 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.835628    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"
Sep 20 02:28:37.838144 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.838115    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:28:37.838248 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.838142    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:28:37.841860 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.841836    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"]
Sep 20 02:28:37.910030 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:37.909992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c9427-01cb-4fae-b6be-14938310e5c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr\" (UID: \"d68c9427-01cb-4fae-b6be-14938310e5c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"
Sep 20 02:28:38.010652 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:38.010612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c9427-01cb-4fae-b6be-14938310e5c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr\" (UID: \"d68c9427-01cb-4fae-b6be-14938310e5c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"
Sep 20 02:28:38.011262 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:38.011243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c9427-01cb-4fae-b6be-14938310e5c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr\" (UID: \"d68c9427-01cb-4fae-b6be-14938310e5c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"
Sep 20 02:28:38.147187 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:38.147098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"
Sep 20 02:28:38.421501 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:38.421476    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"]
Sep 20 02:28:38.422988 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:28:38.422964    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68c9427_01cb_4fae_b6be_14938310e5c2.slice/crio-8443fcc51ea6d629bfcd28c49c2777556d37d6eeab6977ef9a8ab10b2a53111b WatchSource:0}: Error finding container 8443fcc51ea6d629bfcd28c49c2777556d37d6eeab6977ef9a8ab10b2a53111b: Status 404 returned error can't find the container with id 8443fcc51ea6d629bfcd28c49c2777556d37d6eeab6977ef9a8ab10b2a53111b
Sep 20 02:28:39.238750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:39.238709    2565 generic.go:356] "Generic (PLEG): container finished" podID="d68c9427-01cb-4fae-b6be-14938310e5c2" containerID="17649eb623515717feeca6dcc565f6fa14a17393dbbc194f1fc8949bb6de0a92" exitCode=0
Sep 20 02:28:39.239165 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:39.238820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr" event={"ID":"d68c9427-01cb-4fae-b6be-14938310e5c2","Type":"ContainerDied","Data":"17649eb623515717feeca6dcc565f6fa14a17393dbbc194f1fc8949bb6de0a92"}
Sep 20 02:28:39.239165 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:39.238887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr" event={"ID":"d68c9427-01cb-4fae-b6be-14938310e5c2","Type":"ContainerStarted","Data":"8443fcc51ea6d629bfcd28c49c2777556d37d6eeab6977ef9a8ab10b2a53111b"}
Sep 20 02:28:40.376233 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:40.376210    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"
Sep 20 02:28:40.433936 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:40.433902    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c9427-01cb-4fae-b6be-14938310e5c2-maas-api-service-ca\") pod \"d68c9427-01cb-4fae-b6be-14938310e5c2\" (UID: \"d68c9427-01cb-4fae-b6be-14938310e5c2\") "
Sep 20 02:28:40.434266 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:40.434244    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68c9427-01cb-4fae-b6be-14938310e5c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d68c9427-01cb-4fae-b6be-14938310e5c2" (UID: "d68c9427-01cb-4fae-b6be-14938310e5c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:28:40.535364 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:40.535286    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68c9427-01cb-4fae-b6be-14938310e5c2-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:28:41.249454 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:41.249422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr" event={"ID":"d68c9427-01cb-4fae-b6be-14938310e5c2","Type":"ContainerDied","Data":"8443fcc51ea6d629bfcd28c49c2777556d37d6eeab6977ef9a8ab10b2a53111b"}
Sep 20 02:28:41.249615 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:41.249472    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8443fcc51ea6d629bfcd28c49c2777556d37d6eeab6977ef9a8ab10b2a53111b"
Sep 20 02:28:41.249615 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:41.249439    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"
Sep 20 02:28:48.415687 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.415654    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"]
Sep 20 02:28:48.416275 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.415948    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5" podUID="6b0d3a84-f4e4-4860-8999-d25d1179d2d0" containerName="payload-pre-processing" containerID="cri-o://5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab" gracePeriod=30
Sep 20 02:28:48.571582 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.571541    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"]
Sep 20 02:28:48.575349 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.575319    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6be25a-gbhbr"]
Sep 20 02:28:48.687576 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.687547    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:28:48.811435 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.811400    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-plugins-config-volume\") pod \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\" (UID: \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\") "
Sep 20 02:28:48.811584 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.811513    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ncf8\" (UniqueName: \"kubernetes.io/projected/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-kube-api-access-4ncf8\") pod \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\" (UID: \"6b0d3a84-f4e4-4860-8999-d25d1179d2d0\") "
Sep 20 02:28:48.811767 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.811737    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b0d3a84-f4e4-4860-8999-d25d1179d2d0" (UID: "6b0d3a84-f4e4-4860-8999-d25d1179d2d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:28:48.813848 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.813824    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-kube-api-access-4ncf8" (OuterVolumeSpecName: "kube-api-access-4ncf8") pod "6b0d3a84-f4e4-4860-8999-d25d1179d2d0" (UID: "6b0d3a84-f4e4-4860-8999-d25d1179d2d0"). InnerVolumeSpecName "kube-api-access-4ncf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:28:48.912758 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.912716    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:28:48.912758 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:48.912746    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ncf8\" (UniqueName: \"kubernetes.io/projected/6b0d3a84-f4e4-4860-8999-d25d1179d2d0-kube-api-access-4ncf8\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:28:49.225287 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.225251    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68c9427-01cb-4fae-b6be-14938310e5c2" path="/var/lib/kubelet/pods/d68c9427-01cb-4fae-b6be-14938310e5c2/volumes"
Sep 20 02:28:49.293103 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.293068    2565 generic.go:356] "Generic (PLEG): container finished" podID="6b0d3a84-f4e4-4860-8999-d25d1179d2d0" containerID="5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab" exitCode=0
Sep 20 02:28:49.293295 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.293131    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"
Sep 20 02:28:49.293295 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.293150    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5" event={"ID":"6b0d3a84-f4e4-4860-8999-d25d1179d2d0","Type":"ContainerDied","Data":"5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab"}
Sep 20 02:28:49.293295 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.293202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5" event={"ID":"6b0d3a84-f4e4-4860-8999-d25d1179d2d0","Type":"ContainerDied","Data":"3ca294f1d6beab6a9c224e79755ac95dfdc780136d969eec0c6f188e82e129e5"}
Sep 20 02:28:49.293295 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.293223    2565 scope.go:117] "RemoveContainer" containerID="5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab"
Sep 20 02:28:49.301682 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.301666    2565 scope.go:117] "RemoveContainer" containerID="5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab"
Sep 20 02:28:49.301959 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:28:49.301939    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab\": container with ID starting with 5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab not found: ID does not exist" containerID="5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab"
Sep 20 02:28:49.302010 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.301966    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab"} err="failed to get container status \"5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab\": rpc error: code = NotFound desc = could not find container \"5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab\": container with ID starting with 5f0f69d6e28e7a6b2aed326f5fac315d39dbb5bfbcdb9cfc4f80bc0a372348ab not found: ID does not exist"
Sep 20 02:28:49.311106 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.311084    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"]
Sep 20 02:28:49.315372 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:49.315352    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5"]
Sep 20 02:28:51.220952 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:51.220918    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b0d3a84-f4e4-4860-8999-d25d1179d2d0" path="/var/lib/kubelet/pods/6b0d3a84-f4e4-4860-8999-d25d1179d2d0/volumes"
Sep 20 02:28:55.708092 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.708056    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"]
Sep 20 02:28:55.708481 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.708425    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68c9427-01cb-4fae-b6be-14938310e5c2" containerName="revoke-keys"
Sep 20 02:28:55.708481 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.708436    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68c9427-01cb-4fae-b6be-14938310e5c2" containerName="revoke-keys"
Sep 20 02:28:55.708481 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.708454    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b0d3a84-f4e4-4860-8999-d25d1179d2d0" containerName="payload-pre-processing"
Sep 20 02:28:55.708481 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.708460    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b0d3a84-f4e4-4860-8999-d25d1179d2d0" containerName="payload-pre-processing"
Sep 20 02:28:55.708616 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.708518    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68c9427-01cb-4fae-b6be-14938310e5c2" containerName="revoke-keys"
Sep 20 02:28:55.708616 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.708528    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b0d3a84-f4e4-4860-8999-d25d1179d2d0" containerName="payload-pre-processing"
Sep 20 02:28:55.713004 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.712977    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"
Sep 20 02:28:55.715686 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.715517    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:28:55.715686 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.715555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:28:55.719157 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.719125    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"]
Sep 20 02:28:55.779422 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.779385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/834bbd36-82f1-434b-9ced-23637576e9b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc\" (UID: \"834bbd36-82f1-434b-9ced-23637576e9b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"
Sep 20 02:28:55.880114 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.880075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/834bbd36-82f1-434b-9ced-23637576e9b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc\" (UID: \"834bbd36-82f1-434b-9ced-23637576e9b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"
Sep 20 02:28:55.880691 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:55.880669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/834bbd36-82f1-434b-9ced-23637576e9b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc\" (UID: \"834bbd36-82f1-434b-9ced-23637576e9b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"
Sep 20 02:28:56.025473 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:56.025431    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"
Sep 20 02:28:56.295603 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:56.295577    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"]
Sep 20 02:28:56.298447 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:28:56.298419    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834bbd36_82f1_434b_9ced_23637576e9b8.slice/crio-0110ceb95920f365aead562d4e2383a8c518f3c047dc70b4ab9aa3095f6bdecf WatchSource:0}: Error finding container 0110ceb95920f365aead562d4e2383a8c518f3c047dc70b4ab9aa3095f6bdecf: Status 404 returned error can't find the container with id 0110ceb95920f365aead562d4e2383a8c518f3c047dc70b4ab9aa3095f6bdecf
Sep 20 02:28:56.329474 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:56.329435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc" event={"ID":"834bbd36-82f1-434b-9ced-23637576e9b8","Type":"ContainerStarted","Data":"0110ceb95920f365aead562d4e2383a8c518f3c047dc70b4ab9aa3095f6bdecf"}
Sep 20 02:28:57.335943 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:57.335850    2565 generic.go:356] "Generic (PLEG): container finished" podID="834bbd36-82f1-434b-9ced-23637576e9b8" containerID="23315c29823c5b3c7537e1fa0ece93ee6b5975b249d7a14523646876f9ace3e2" exitCode=0
Sep 20 02:28:57.336346 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:57.335941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc" event={"ID":"834bbd36-82f1-434b-9ced-23637576e9b8","Type":"ContainerDied","Data":"23315c29823c5b3c7537e1fa0ece93ee6b5975b249d7a14523646876f9ace3e2"}
Sep 20 02:28:58.469837 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:58.469812    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"
Sep 20 02:28:58.606012 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:58.605927    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/834bbd36-82f1-434b-9ced-23637576e9b8-maas-api-service-ca\") pod \"834bbd36-82f1-434b-9ced-23637576e9b8\" (UID: \"834bbd36-82f1-434b-9ced-23637576e9b8\") "
Sep 20 02:28:58.606302 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:58.606279    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834bbd36-82f1-434b-9ced-23637576e9b8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "834bbd36-82f1-434b-9ced-23637576e9b8" (UID: "834bbd36-82f1-434b-9ced-23637576e9b8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:28:58.707559 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:58.707521    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/834bbd36-82f1-434b-9ced-23637576e9b8-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:28:59.347255 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:59.347219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc" event={"ID":"834bbd36-82f1-434b-9ced-23637576e9b8","Type":"ContainerDied","Data":"0110ceb95920f365aead562d4e2383a8c518f3c047dc70b4ab9aa3095f6bdecf"}
Sep 20 02:28:59.347255 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:59.347254    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"
Sep 20 02:28:59.347511 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:28:59.347265    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0110ceb95920f365aead562d4e2383a8c518f3c047dc70b4ab9aa3095f6bdecf"
Sep 20 02:29:06.296301 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.296262    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct"]
Sep 20 02:29:06.300804 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.300759    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ed9f38-29831175-22sct"]
Sep 20 02:29:06.329047 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.329016    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"]
Sep 20 02:29:06.329330 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.329300    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv" podUID="7dfdc8c9-cf54-4d17-ab80-56243aa91dce" containerName="payload-processing" containerID="cri-o://a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3" gracePeriod=30
Sep 20 02:29:06.338094 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.338061    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"]
Sep 20 02:29:06.338338 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.338292    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s" podUID="faf10c9d-c086-4844-b2c9-fad25e670a34" containerName="payload-pre-processing" containerID="cri-o://dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a" gracePeriod=30
Sep 20 02:29:06.593410 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.593380    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"]
Sep 20 02:29:06.595169 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.595144    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ed9f38-nqfxc"]
Sep 20 02:29:06.617767 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.617745    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:29:06.619855 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.619835    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:29:06.781438 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.781406    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-plugins-config-volume\") pod \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\" (UID: \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\") "
Sep 20 02:29:06.781619 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.781471    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faf10c9d-c086-4844-b2c9-fad25e670a34-plugins-config-volume\") pod \"faf10c9d-c086-4844-b2c9-fad25e670a34\" (UID: \"faf10c9d-c086-4844-b2c9-fad25e670a34\") "
Sep 20 02:29:06.781619 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.781490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pnz9\" (UniqueName: \"kubernetes.io/projected/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-kube-api-access-7pnz9\") pod \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\" (UID: \"7dfdc8c9-cf54-4d17-ab80-56243aa91dce\") "
Sep 20 02:29:06.781619 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.781535    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbmz9\" (UniqueName: \"kubernetes.io/projected/faf10c9d-c086-4844-b2c9-fad25e670a34-kube-api-access-gbmz9\") pod \"faf10c9d-c086-4844-b2c9-fad25e670a34\" (UID: \"faf10c9d-c086-4844-b2c9-fad25e670a34\") "
Sep 20 02:29:06.781909 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.781879    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faf10c9d-c086-4844-b2c9-fad25e670a34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "faf10c9d-c086-4844-b2c9-fad25e670a34" (UID: "faf10c9d-c086-4844-b2c9-fad25e670a34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:29:06.782001 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.781879    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7dfdc8c9-cf54-4d17-ab80-56243aa91dce" (UID: "7dfdc8c9-cf54-4d17-ab80-56243aa91dce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:29:06.783697 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.783670    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf10c9d-c086-4844-b2c9-fad25e670a34-kube-api-access-gbmz9" (OuterVolumeSpecName: "kube-api-access-gbmz9") pod "faf10c9d-c086-4844-b2c9-fad25e670a34" (UID: "faf10c9d-c086-4844-b2c9-fad25e670a34"). InnerVolumeSpecName "kube-api-access-gbmz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:29:06.783769 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.783679    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-kube-api-access-7pnz9" (OuterVolumeSpecName: "kube-api-access-7pnz9") pod "7dfdc8c9-cf54-4d17-ab80-56243aa91dce" (UID: "7dfdc8c9-cf54-4d17-ab80-56243aa91dce"). InnerVolumeSpecName "kube-api-access-7pnz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:29:06.882330 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.882221    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:29:06.882330 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.882267    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faf10c9d-c086-4844-b2c9-fad25e670a34-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:29:06.882330 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.882290    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pnz9\" (UniqueName: \"kubernetes.io/projected/7dfdc8c9-cf54-4d17-ab80-56243aa91dce-kube-api-access-7pnz9\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:29:06.882330 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:06.882302    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbmz9\" (UniqueName: \"kubernetes.io/projected/faf10c9d-c086-4844-b2c9-fad25e670a34-kube-api-access-gbmz9\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:29:07.219854 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.219766    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44c98f1b-d773-4821-a530-273a730b5e71" path="/var/lib/kubelet/pods/44c98f1b-d773-4821-a530-273a730b5e71/volumes"
Sep 20 02:29:07.220122 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.220106    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="834bbd36-82f1-434b-9ced-23637576e9b8" path="/var/lib/kubelet/pods/834bbd36-82f1-434b-9ced-23637576e9b8/volumes"
Sep 20 02:29:07.388191 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.388159    2565 generic.go:356] "Generic (PLEG): container finished" podID="7dfdc8c9-cf54-4d17-ab80-56243aa91dce" containerID="a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3" exitCode=0
Sep 20 02:29:07.388191 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.388190    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"
Sep 20 02:29:07.388656 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.388236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv" event={"ID":"7dfdc8c9-cf54-4d17-ab80-56243aa91dce","Type":"ContainerDied","Data":"a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3"}
Sep 20 02:29:07.388656 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.388285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv" event={"ID":"7dfdc8c9-cf54-4d17-ab80-56243aa91dce","Type":"ContainerDied","Data":"5e66fc15e69e50a5c59ff29f66c75a43b04f551fc73c4ea29d28ebea3d00d1a0"}
Sep 20 02:29:07.388656 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.388309    2565 scope.go:117] "RemoveContainer" containerID="a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3"
Sep 20 02:29:07.389709 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.389682    2565 generic.go:356] "Generic (PLEG): container finished" podID="faf10c9d-c086-4844-b2c9-fad25e670a34" containerID="dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a" exitCode=0
Sep 20 02:29:07.389855 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.389715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s" event={"ID":"faf10c9d-c086-4844-b2c9-fad25e670a34","Type":"ContainerDied","Data":"dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a"}
Sep 20 02:29:07.389855 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.389773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s" event={"ID":"faf10c9d-c086-4844-b2c9-fad25e670a34","Type":"ContainerDied","Data":"0d57cf7fa797add98dc83423c9ed0c099b3b4ef5614c943731aeaf3ef76a73db"}
Sep 20 02:29:07.389855 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.389724    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"
Sep 20 02:29:07.397558 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.397538    2565 scope.go:117] "RemoveContainer" containerID="a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3"
Sep 20 02:29:07.397856 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:29:07.397830    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3\": container with ID starting with a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3 not found: ID does not exist" containerID="a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3"
Sep 20 02:29:07.398046 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.397865    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3"} err="failed to get container status \"a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3\": rpc error: code = NotFound desc = could not find container \"a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3\": container with ID starting with a267dafc1946a874165e8659e73569112276b30e7c9aa50879309896e36e9bc3 not found: ID does not exist"
Sep 20 02:29:07.398046 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.397889    2565 scope.go:117] "RemoveContainer" containerID="dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a"
Sep 20 02:29:07.405603 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.405584    2565 scope.go:117] "RemoveContainer" containerID="dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a"
Sep 20 02:29:07.405941 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:29:07.405920    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a\": container with ID starting with dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a not found: ID does not exist" containerID="dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a"
Sep 20 02:29:07.405991 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.405948    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a"} err="failed to get container status \"dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a\": rpc error: code = NotFound desc = could not find container \"dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a\": container with ID starting with dff273281743cac3b6ef2049357e8e4994249181ce370eff59c1b618085de78a not found: ID does not exist"
Sep 20 02:29:07.418049 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.418018    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"]
Sep 20 02:29:07.422860 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.422840    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s"]
Sep 20 02:29:07.436112 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.436088    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"]
Sep 20 02:29:07.439118 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:07.439095    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv"]
Sep 20 02:29:09.220482 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:09.220448    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dfdc8c9-cf54-4d17-ab80-56243aa91dce" path="/var/lib/kubelet/pods/7dfdc8c9-cf54-4d17-ab80-56243aa91dce/volumes"
Sep 20 02:29:09.220851 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:09.220830    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf10c9d-c086-4844-b2c9-fad25e670a34" path="/var/lib/kubelet/pods/faf10c9d-c086-4844-b2c9-fad25e670a34/volumes"
Sep 20 02:29:13.932235 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932199    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"]
Sep 20 02:29:13.932738 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932719    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="834bbd36-82f1-434b-9ced-23637576e9b8" containerName="revoke-keys"
Sep 20 02:29:13.932835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932743    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="834bbd36-82f1-434b-9ced-23637576e9b8" containerName="revoke-keys"
Sep 20 02:29:13.932835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932774    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faf10c9d-c086-4844-b2c9-fad25e670a34" containerName="payload-pre-processing"
Sep 20 02:29:13.932835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932802    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="faf10c9d-c086-4844-b2c9-fad25e670a34" containerName="payload-pre-processing"
Sep 20 02:29:13.932835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932813    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfdc8c9-cf54-4d17-ab80-56243aa91dce" containerName="payload-processing"
Sep 20 02:29:13.932835 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932822    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfdc8c9-cf54-4d17-ab80-56243aa91dce" containerName="payload-processing"
Sep 20 02:29:13.933083 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932931    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="faf10c9d-c086-4844-b2c9-fad25e670a34" containerName="payload-pre-processing"
Sep 20 02:29:13.933083 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932945    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfdc8c9-cf54-4d17-ab80-56243aa91dce" containerName="payload-processing"
Sep 20 02:29:13.933083 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.932956    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="834bbd36-82f1-434b-9ced-23637576e9b8" containerName="revoke-keys"
Sep 20 02:29:13.936129 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.936108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"
Sep 20 02:29:13.938660 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.938639    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 02:29:13.938779 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.938691    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gscp\""
Sep 20 02:29:13.943111 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.943054    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"]
Sep 20 02:29:13.952156 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:13.952133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8789c3-2221-46c1-8c49-240c2a878b98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w\" (UID: \"8a8789c3-2221-46c1-8c49-240c2a878b98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"
Sep 20 02:29:14.053553 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:14.053522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8789c3-2221-46c1-8c49-240c2a878b98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w\" (UID: \"8a8789c3-2221-46c1-8c49-240c2a878b98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"
Sep 20 02:29:14.054138 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:14.054120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8789c3-2221-46c1-8c49-240c2a878b98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w\" (UID: \"8a8789c3-2221-46c1-8c49-240c2a878b98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"
Sep 20 02:29:14.249444 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:14.249414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"
Sep 20 02:29:14.521018 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:14.520991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"]
Sep 20 02:29:14.522897 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:29:14.522865    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8789c3_2221_46c1_8c49_240c2a878b98.slice/crio-844489d51a30f60585f8095f886ad9bcf84f0bc8534ca74a49fd099ce122e079 WatchSource:0}: Error finding container 844489d51a30f60585f8095f886ad9bcf84f0bc8534ca74a49fd099ce122e079: Status 404 returned error can't find the container with id 844489d51a30f60585f8095f886ad9bcf84f0bc8534ca74a49fd099ce122e079
Sep 20 02:29:15.436910 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:15.436823    2565 generic.go:356] "Generic (PLEG): container finished" podID="8a8789c3-2221-46c1-8c49-240c2a878b98" containerID="15a9afd953e918f58df6db96fddf779237810988ad6dcf2440375ac8d0d51be1" exitCode=0
Sep 20 02:29:15.436910 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:15.436896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w" event={"ID":"8a8789c3-2221-46c1-8c49-240c2a878b98","Type":"ContainerDied","Data":"15a9afd953e918f58df6db96fddf779237810988ad6dcf2440375ac8d0d51be1"}
Sep 20 02:29:15.437299 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:15.436947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w" event={"ID":"8a8789c3-2221-46c1-8c49-240c2a878b98","Type":"ContainerStarted","Data":"844489d51a30f60585f8095f886ad9bcf84f0bc8534ca74a49fd099ce122e079"}
Sep 20 02:29:16.570235 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:16.570211    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"
Sep 20 02:29:16.575360 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:16.575338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8789c3-2221-46c1-8c49-240c2a878b98-maas-api-service-ca\") pod \"8a8789c3-2221-46c1-8c49-240c2a878b98\" (UID: \"8a8789c3-2221-46c1-8c49-240c2a878b98\") "
Sep 20 02:29:16.575650 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:16.575626    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a8789c3-2221-46c1-8c49-240c2a878b98-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a8789c3-2221-46c1-8c49-240c2a878b98" (UID: "8a8789c3-2221-46c1-8c49-240c2a878b98"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:29:16.676689 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:16.676660    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8789c3-2221-46c1-8c49-240c2a878b98-maas-api-service-ca\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:29:17.448039 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:17.448008    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"
Sep 20 02:29:17.448242 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:17.448035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w" event={"ID":"8a8789c3-2221-46c1-8c49-240c2a878b98","Type":"ContainerDied","Data":"844489d51a30f60585f8095f886ad9bcf84f0bc8534ca74a49fd099ce122e079"}
Sep 20 02:29:17.448242 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:17.448124    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="844489d51a30f60585f8095f886ad9bcf84f0bc8534ca74a49fd099ce122e079"
Sep 20 02:29:24.852124 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:24.852085    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"]
Sep 20 02:29:24.852732 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:24.852370    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6" podUID="14a20193-20a3-4316-9dba-3f9549696b19" containerName="payload-processing" containerID="cri-o://ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd" gracePeriod=30
Sep 20 02:29:24.871875 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:24.871847    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"]
Sep 20 02:29:24.872107 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:24.872063    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t" podUID="01fe9a43-7876-4e09-9da1-61b761ae2236" containerName="payload-pre-processing" containerID="cri-o://00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df" gracePeriod=30
Sep 20 02:29:25.059442 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.059410    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"]
Sep 20 02:29:25.061865 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.061834    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-317780-2q46w"]
Sep 20 02:29:25.121116 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.121093    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:29:25.156244 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.156217    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:29:25.159177 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.159157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a20193-20a3-4316-9dba-3f9549696b19-plugins-config-volume\") pod \"14a20193-20a3-4316-9dba-3f9549696b19\" (UID: \"14a20193-20a3-4316-9dba-3f9549696b19\") "
Sep 20 02:29:25.159288 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.159266    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj94q\" (UniqueName: \"kubernetes.io/projected/14a20193-20a3-4316-9dba-3f9549696b19-kube-api-access-dj94q\") pod \"14a20193-20a3-4316-9dba-3f9549696b19\" (UID: \"14a20193-20a3-4316-9dba-3f9549696b19\") "
Sep 20 02:29:25.159509 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.159486    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a20193-20a3-4316-9dba-3f9549696b19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14a20193-20a3-4316-9dba-3f9549696b19" (UID: "14a20193-20a3-4316-9dba-3f9549696b19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:29:25.159564 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.159557    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a20193-20a3-4316-9dba-3f9549696b19-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:29:25.161347 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.161328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a20193-20a3-4316-9dba-3f9549696b19-kube-api-access-dj94q" (OuterVolumeSpecName: "kube-api-access-dj94q") pod "14a20193-20a3-4316-9dba-3f9549696b19" (UID: "14a20193-20a3-4316-9dba-3f9549696b19"). InnerVolumeSpecName "kube-api-access-dj94q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:29:25.220367 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.220328    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a8789c3-2221-46c1-8c49-240c2a878b98" path="/var/lib/kubelet/pods/8a8789c3-2221-46c1-8c49-240c2a878b98/volumes"
Sep 20 02:29:25.260105 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.260079    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01fe9a43-7876-4e09-9da1-61b761ae2236-plugins-config-volume\") pod \"01fe9a43-7876-4e09-9da1-61b761ae2236\" (UID: \"01fe9a43-7876-4e09-9da1-61b761ae2236\") "
Sep 20 02:29:25.260224 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.260121    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74r9x\" (UniqueName: \"kubernetes.io/projected/01fe9a43-7876-4e09-9da1-61b761ae2236-kube-api-access-74r9x\") pod \"01fe9a43-7876-4e09-9da1-61b761ae2236\" (UID: \"01fe9a43-7876-4e09-9da1-61b761ae2236\") "
Sep 20 02:29:25.260358 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.260339    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj94q\" (UniqueName: \"kubernetes.io/projected/14a20193-20a3-4316-9dba-3f9549696b19-kube-api-access-dj94q\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:29:25.260424 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.260402    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01fe9a43-7876-4e09-9da1-61b761ae2236-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01fe9a43-7876-4e09-9da1-61b761ae2236" (UID: "01fe9a43-7876-4e09-9da1-61b761ae2236"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 02:29:25.262210 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.262190    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01fe9a43-7876-4e09-9da1-61b761ae2236-kube-api-access-74r9x" (OuterVolumeSpecName: "kube-api-access-74r9x") pod "01fe9a43-7876-4e09-9da1-61b761ae2236" (UID: "01fe9a43-7876-4e09-9da1-61b761ae2236"). InnerVolumeSpecName "kube-api-access-74r9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 02:29:25.361657 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.361586    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74r9x\" (UniqueName: \"kubernetes.io/projected/01fe9a43-7876-4e09-9da1-61b761ae2236-kube-api-access-74r9x\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:29:25.361657 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.361612    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01fe9a43-7876-4e09-9da1-61b761ae2236-plugins-config-volume\") on node \"ip-10-0-135-222.ec2.internal\" DevicePath \"\""
Sep 20 02:29:25.488750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.488719    2565 generic.go:356] "Generic (PLEG): container finished" podID="01fe9a43-7876-4e09-9da1-61b761ae2236" containerID="00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df" exitCode=0
Sep 20 02:29:25.488750 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.488758    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"
Sep 20 02:29:25.488994 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.488822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t" event={"ID":"01fe9a43-7876-4e09-9da1-61b761ae2236","Type":"ContainerDied","Data":"00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df"}
Sep 20 02:29:25.488994 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.488876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t" event={"ID":"01fe9a43-7876-4e09-9da1-61b761ae2236","Type":"ContainerDied","Data":"a05aa5f815868abb63481cf8fc90941b32ede5c78b6e6a3d3f14884131f80763"}
Sep 20 02:29:25.488994 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.488906    2565 scope.go:117] "RemoveContainer" containerID="00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df"
Sep 20 02:29:25.490020 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.489994    2565 generic.go:356] "Generic (PLEG): container finished" podID="14a20193-20a3-4316-9dba-3f9549696b19" containerID="ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd" exitCode=0
Sep 20 02:29:25.490096 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.490025    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"
Sep 20 02:29:25.490096 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.490082    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6" event={"ID":"14a20193-20a3-4316-9dba-3f9549696b19","Type":"ContainerDied","Data":"ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd"}
Sep 20 02:29:25.490198 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.490134    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6" event={"ID":"14a20193-20a3-4316-9dba-3f9549696b19","Type":"ContainerDied","Data":"37875de028caa8226e8942dded098475d6dc8f90c966578237ddb16a68e7e947"}
Sep 20 02:29:25.497865 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.497848    2565 scope.go:117] "RemoveContainer" containerID="00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df"
Sep 20 02:29:25.498137 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:29:25.498119    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df\": container with ID starting with 00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df not found: ID does not exist" containerID="00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df"
Sep 20 02:29:25.498184 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.498145    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df"} err="failed to get container status \"00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df\": rpc error: code = NotFound desc = could not find container \"00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df\": container with ID starting with 00ae0cecb6ec67f1c7beaba148be2f0e2cb1eefb980c34a21cae6e66dfb634df not found: ID does not exist"
Sep 20 02:29:25.498184 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.498161    2565 scope.go:117] "RemoveContainer" containerID="ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd"
Sep 20 02:29:25.505527 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.505508    2565 scope.go:117] "RemoveContainer" containerID="ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd"
Sep 20 02:29:25.505772 ip-10-0-135-222 kubenswrapper[2565]: E0920 02:29:25.505756    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd\": container with ID starting with ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd not found: ID does not exist" containerID="ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd"
Sep 20 02:29:25.505838 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.505778    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd"} err="failed to get container status \"ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd\": rpc error: code = NotFound desc = could not find container \"ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd\": container with ID starting with ec7c3e68512cad9b619cbee5edc2c29f6e6da36eaf52acc7b0755cdd50878cfd not found: ID does not exist"
Sep 20 02:29:25.509252 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.509229    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"]
Sep 20 02:29:25.513546 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.513527    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6"]
Sep 20 02:29:25.523620 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.523600    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"]
Sep 20 02:29:25.527751 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:25.527730    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t"]
Sep 20 02:29:27.219626 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:27.219583    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01fe9a43-7876-4e09-9da1-61b761ae2236" path="/var/lib/kubelet/pods/01fe9a43-7876-4e09-9da1-61b761ae2236/volumes"
Sep 20 02:29:27.220144 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:27.220118    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14a20193-20a3-4316-9dba-3f9549696b19" path="/var/lib/kubelet/pods/14a20193-20a3-4316-9dba-3f9549696b19/volumes"
Sep 20 02:29:35.737670 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:29:35.737636    2565 scope.go:117] "RemoveContainer" containerID="b4de1033badac182a842c463cb32c6af57c9b0b700fdd9ee89fe9338088e3e47"
Sep 20 02:33:35.804461 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:33:35.804428    2565 scope.go:117] "RemoveContainer" containerID="30b111c946cc181c4349b60da75c42bd6ff386a62ef28499fcb99a18a734684e"
Sep 20 02:33:35.812721 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:33:35.812699    2565 scope.go:117] "RemoveContainer" containerID="b184ad87a3f3acd2a8133f2a09bad4e364d3096a0f7ca11dcd1c8fd48ac2c7f6"
Sep 20 02:35:35.844878 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:35.844846    2565 scope.go:117] "RemoveContainer" containerID="23315c29823c5b3c7537e1fa0ece93ee6b5975b249d7a14523646876f9ace3e2"
Sep 20 02:35:35.854178 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:35.854142    2565 scope.go:117] "RemoveContainer" containerID="17649eb623515717feeca6dcc565f6fa14a17393dbbc194f1fc8949bb6de0a92"
Sep 20 02:35:35.863107 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:35.863075    2565 scope.go:117] "RemoveContainer" containerID="15a9afd953e918f58df6db96fddf779237810988ad6dcf2440375ac8d0d51be1"
Sep 20 02:35:47.362769 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:47.362741    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wz2f7_26417512-ed68-41e2-9486-2e2d4ee07afa/server/0.log"
Sep 20 02:35:47.489507 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:47.489475    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mkhdd_db2d4122-2147-4e94-8bad-1e8821760679/manager/0.log"
Sep 20 02:35:47.747125 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:47.747098    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw_3ae84d85-67eb-4cc5-bc27-94a40b6bac5d/copy-manifests/0.log"
Sep 20 02:35:47.753494 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:47.753472    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw_3ae84d85-67eb-4cc5-bc27-94a40b6bac5d/manager/0.log"
Sep 20 02:35:48.423060 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:48.423025    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29831175-h57wc_83e940ec-f8da-4d6d-9c83-4720a41c4c09/cleanup/0.log"
Sep 20 02:35:50.489475 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:50.489444    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs_84cbc648-0538-45fb-99f2-d7596e112005/istio-proxy/0.log"
Sep 20 02:35:50.616619 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:50.616582    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l7zjx_323c9baf-f1aa-4fac-a993-85d0ed4fce36/discovery/0.log"
Sep 20 02:35:50.957905 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:50.957804    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7ncht_d9a422bb-fdbb-4f7a-a837-a69d24e76069/istio-proxy/1.log"
Sep 20 02:35:51.203601 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:51.203567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5vxjh_7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04/payload-processing/0.log"
Sep 20 02:35:51.776865 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:51.776833    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5lgmv_e12eb8f9-3a7c-4cda-b0b1-0d601794d811/main/0.log"
Sep 20 02:35:52.118225 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:52.118146    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgw8mb_3c0cafe2-a7c9-4119-9c50-0ac4dfb11278/main/0.log"
Sep 20 02:35:52.227165 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:35:52.227128    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dxndd_554e4ba0-63a2-4198-8a60-6ff620afedba/main/0.log"
Sep 20 02:36:00.949312 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:00.949229    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lhndp_f55f74b3-998f-4803-8995-148073e16174/global-pull-secret-syncer/0.log"
Sep 20 02:36:01.098751 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:01.098716    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rltqw_486a3522-0cdd-482e-b43b-02a90ec19912/konnectivity-agent/0.log"
Sep 20 02:36:01.197655 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:01.197623    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-222.ec2.internal_45060ece5796fbf6dec687e90e5bcb28/haproxy/0.log"
Sep 20 02:36:07.995816 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:07.995774    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-77dd7f697d-bs925_0c1b1290-0aa9-4794-b968-e6c393f0d59a/metrics-server/0.log"
Sep 20 02:36:08.031589 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.031561    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-d59xz_f5bcd148-a2a7-43fb-90bf-b13e227837dd/monitoring-plugin/0.log"
Sep 20 02:36:08.295198 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.295127    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5h8b_8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf/node-exporter/0.log"
Sep 20 02:36:08.316650 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.316627    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5h8b_8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf/kube-rbac-proxy/0.log"
Sep 20 02:36:08.335949 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.335927    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5h8b_8034b0b3-ccfc-4c9a-86b8-fdc16138e6cf/init-textfile/0.log"
Sep 20 02:36:08.455336 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.455306    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_670bc865-51ba-401f-abac-bfda88c161b5/prometheus/0.log"
Sep 20 02:36:08.478889 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.478860    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_670bc865-51ba-401f-abac-bfda88c161b5/config-reloader/0.log"
Sep 20 02:36:08.502274 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.502246    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_670bc865-51ba-401f-abac-bfda88c161b5/thanos-sidecar/0.log"
Sep 20 02:36:08.529685 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.529664    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_670bc865-51ba-401f-abac-bfda88c161b5/kube-rbac-proxy-web/0.log"
Sep 20 02:36:08.556511 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.556480    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_670bc865-51ba-401f-abac-bfda88c161b5/kube-rbac-proxy/0.log"
Sep 20 02:36:08.580397 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.580377    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_670bc865-51ba-401f-abac-bfda88c161b5/kube-rbac-proxy-thanos/0.log"
Sep 20 02:36:08.605872 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.605838    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_670bc865-51ba-401f-abac-bfda88c161b5/init-config-reloader/0.log"
Sep 20 02:36:08.693967 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:08.693943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-4zzkg_4f8a5a4e-455f-45ef-b011-f11ddf379434/prometheus-operator-admission-webhook/0.log"
Sep 20 02:36:11.412837 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.412800    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"]
Sep 20 02:36:11.413217 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.413138    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fe9a43-7876-4e09-9da1-61b761ae2236" containerName="payload-pre-processing"
Sep 20 02:36:11.413217 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.413150    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fe9a43-7876-4e09-9da1-61b761ae2236" containerName="payload-pre-processing"
Sep 20 02:36:11.413217 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.413159    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8789c3-2221-46c1-8c49-240c2a878b98" containerName="revoke-keys"
Sep 20 02:36:11.413217 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.413165    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8789c3-2221-46c1-8c49-240c2a878b98" containerName="revoke-keys"
Sep 20 02:36:11.413217 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.413174    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14a20193-20a3-4316-9dba-3f9549696b19" containerName="payload-processing"
Sep 20 02:36:11.413217 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.413181    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a20193-20a3-4316-9dba-3f9549696b19" containerName="payload-processing"
Sep 20 02:36:11.413413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.413246    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="14a20193-20a3-4316-9dba-3f9549696b19" containerName="payload-processing"
Sep 20 02:36:11.413413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.413253    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8789c3-2221-46c1-8c49-240c2a878b98" containerName="revoke-keys"
Sep 20 02:36:11.413413 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.413259    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="01fe9a43-7876-4e09-9da1-61b761ae2236" containerName="payload-pre-processing"
Sep 20 02:36:11.415975 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.415958    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.418228 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.418204    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqx6h\"/\"openshift-service-ca.crt\""
Sep 20 02:36:11.419043 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.419023    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gqx6h\"/\"default-dockercfg-bbk9m\""
Sep 20 02:36:11.419146 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.419040    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqx6h\"/\"kube-root-ca.crt\""
Sep 20 02:36:11.425369 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.425345    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"]
Sep 20 02:36:11.537284 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.537254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-podres\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.537471 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.537324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-proc\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.537471 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.537395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-lib-modules\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.537471 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.537433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9kzd\" (UniqueName: \"kubernetes.io/projected/b5632f2a-80f5-493f-9a5a-7068b339e820-kube-api-access-j9kzd\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.537471 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.537463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-sys\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.559637 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.559595    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-4f587_2be99b1a-29cb-40cc-bb17-c765d5fa7752/download-server/0.log"
Sep 20 02:36:11.638079 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.638039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-proc\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.638253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.638096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-lib-modules\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.638253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.638122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9kzd\" (UniqueName: \"kubernetes.io/projected/b5632f2a-80f5-493f-9a5a-7068b339e820-kube-api-access-j9kzd\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.638253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.638146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-sys\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.638253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.638169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-podres\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.638253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.638172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-proc\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.638253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.638252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-sys\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.638520 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.638297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-lib-modules\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.638520 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.638360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b5632f2a-80f5-493f-9a5a-7068b339e820-podres\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.647086 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.647063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9kzd\" (UniqueName: \"kubernetes.io/projected/b5632f2a-80f5-493f-9a5a-7068b339e820-kube-api-access-j9kzd\") pod \"perf-node-gather-daemonset-tsh2w\" (UID: \"b5632f2a-80f5-493f-9a5a-7068b339e820\") " pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.726033 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.725937    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:11.995854 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:11.995777    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"]
Sep 20 02:36:11.998590 ip-10-0-135-222 kubenswrapper[2565]: W0920 02:36:11.998563    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb5632f2a_80f5_493f_9a5a_7068b339e820.slice/crio-3dab965d84b4a6e34b1776989a625bf7491ade459e055b4f72aaf39b4c21d2aa WatchSource:0}: Error finding container 3dab965d84b4a6e34b1776989a625bf7491ade459e055b4f72aaf39b4c21d2aa: Status 404 returned error can't find the container with id 3dab965d84b4a6e34b1776989a625bf7491ade459e055b4f72aaf39b4c21d2aa
Sep 20 02:36:12.360567 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:12.360466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w" event={"ID":"b5632f2a-80f5-493f-9a5a-7068b339e820","Type":"ContainerStarted","Data":"3fda42ec809b111149a1e41ee637139566221a0d533fc237b132270f5276cd38"}
Sep 20 02:36:12.360567 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:12.360524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w" event={"ID":"b5632f2a-80f5-493f-9a5a-7068b339e820","Type":"ContainerStarted","Data":"3dab965d84b4a6e34b1776989a625bf7491ade459e055b4f72aaf39b4c21d2aa"}
Sep 20 02:36:12.360567 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:12.360550    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:12.377675 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:12.377624    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w" podStartSLOduration=1.377609714 podStartE2EDuration="1.377609714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 02:36:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 02:36:12.375971579 +0000 UTC m=+2617.660983515" watchObservedRunningTime="2026-09-20 02:36:12.377609714 +0000 UTC m=+2617.662621648"
Sep 20 02:36:13.514635 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:13.514606    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7cqs_1af618f0-822c-4eb8-b157-be63a25a19ff/dns/0.log"
Sep 20 02:36:13.535068 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:13.535040    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7cqs_1af618f0-822c-4eb8-b157-be63a25a19ff/kube-rbac-proxy/0.log"
Sep 20 02:36:13.599219 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:13.599189    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6r5rb_989cd413-4280-4b83-856d-44f52d0535ad/dns-node-resolver/0.log"
Sep 20 02:36:14.251129 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:14.251095    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c9b7f6b9b-nkh9v_bed87565-e264-4348-a8c4-acf47fe8dbf8/registry/0.log"
Sep 20 02:36:14.272221 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:14.272194    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2mlf2_b6755fbb-4ed1-4026-ae2d-551e789b2e15/node-ca/0.log"
Sep 20 02:36:15.253826 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:15.253780    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs_84cbc648-0538-45fb-99f2-d7596e112005/istio-proxy/0.log"
Sep 20 02:36:16.091398 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:16.091362    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l7zjx_323c9baf-f1aa-4fac-a993-85d0ed4fce36/discovery/0.log"
Sep 20 02:36:16.168253 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:16.168220    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7ncht_d9a422bb-fdbb-4f7a-a837-a69d24e76069/istio-proxy/0.log"
Sep 20 02:36:16.173249 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:16.173221    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7ncht_d9a422bb-fdbb-4f7a-a837-a69d24e76069/istio-proxy/1.log"
Sep 20 02:36:16.260827 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:16.260776    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5vxjh_7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04/payload-processing/0.log"
Sep 20 02:36:17.248394 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:17.248369    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-skzjn_bfc8781d-3232-4203-985a-d82bbdb4bad8/serve-healthcheck-canary/0.log"
Sep 20 02:36:17.898798 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:17.898727    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d4kzj_5f32c860-059e-47dc-8c5c-b64289378a07/kube-rbac-proxy/0.log"
Sep 20 02:36:17.919201 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:17.919170    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d4kzj_5f32c860-059e-47dc-8c5c-b64289378a07/exporter/0.log"
Sep 20 02:36:17.940168 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:17.940139    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d4kzj_5f32c860-059e-47dc-8c5c-b64289378a07/extractor/0.log"
Sep 20 02:36:18.374354 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:18.374329    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gqx6h/perf-node-gather-daemonset-tsh2w"
Sep 20 02:36:20.752064 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:20.752037    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wz2f7_26417512-ed68-41e2-9486-2e2d4ee07afa/server/0.log"
Sep 20 02:36:20.887550 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:20.887510    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mkhdd_db2d4122-2147-4e94-8bad-1e8821760679/manager/0.log"
Sep 20 02:36:21.051703 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:21.051600    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw_3ae84d85-67eb-4cc5-bc27-94a40b6bac5d/manager/0.log"
Sep 20 02:36:21.072077 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:21.072051    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59d4cf4f4c-sm9sw_3ae84d85-67eb-4cc5-bc27-94a40b6bac5d/copy-manifests/0.log"
Sep 20 02:36:22.175116 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:22.175083    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs_84cbc648-0538-45fb-99f2-d7596e112005/istio-proxy/0.log"
Sep 20 02:36:22.611949 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:22.611869    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bdfb9dff9-vqv95_fd817840-74d1-4d75-9bb3-43c8490ba917/manager/0.log"
Sep 20 02:36:23.012401 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:23.012347    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l7zjx_323c9baf-f1aa-4fac-a993-85d0ed4fce36/discovery/0.log"
Sep 20 02:36:23.063249 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:23.063208    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7ncht_d9a422bb-fdbb-4f7a-a837-a69d24e76069/istio-proxy/0.log"
Sep 20 02:36:23.068697 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:23.068677    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7ncht_d9a422bb-fdbb-4f7a-a837-a69d24e76069/istio-proxy/1.log"
Sep 20 02:36:23.134209 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:23.134181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5vxjh_7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04/payload-processing/0.log"
Sep 20 02:36:24.727493 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:24.727403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs_84cbc648-0538-45fb-99f2-d7596e112005/istio-proxy/0.log"
Sep 20 02:36:25.573113 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:25.573065    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l7zjx_323c9baf-f1aa-4fac-a993-85d0ed4fce36/discovery/0.log"
Sep 20 02:36:25.654404 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:25.654362    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7ncht_d9a422bb-fdbb-4f7a-a837-a69d24e76069/istio-proxy/0.log"
Sep 20 02:36:25.659663 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:25.659622    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7ncht_d9a422bb-fdbb-4f7a-a837-a69d24e76069/istio-proxy/1.log"
Sep 20 02:36:25.745601 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:25.745561    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-5vxjh_7f1fd2e0-d54b-4234-b8cf-5e54b4d8bf04/payload-processing/0.log"
Sep 20 02:36:27.928309 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:27.928272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k4jmf_db74a0a6-a5b2-410b-b229-822ab975d7bd/migrator/0.log"
Sep 20 02:36:27.947101 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:27.947074    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k4jmf_db74a0a6-a5b2-410b-b229-822ab975d7bd/graceful-termination/0.log"
Sep 20 02:36:29.642761 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:29.642732    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8wp8_bb65d72f-e202-45f8-a70c-7e2eae3f7ba3/kube-multus-additional-cni-plugins/0.log"
Sep 20 02:36:29.664843 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:29.664813    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8wp8_bb65d72f-e202-45f8-a70c-7e2eae3f7ba3/egress-router-binary-copy/0.log"
Sep 20 02:36:29.685949 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:29.685923    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8wp8_bb65d72f-e202-45f8-a70c-7e2eae3f7ba3/cni-plugins/0.log"
Sep 20 02:36:29.706773 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:29.706747    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8wp8_bb65d72f-e202-45f8-a70c-7e2eae3f7ba3/bond-cni-plugin/0.log"
Sep 20 02:36:29.727708 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:29.727684    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8wp8_bb65d72f-e202-45f8-a70c-7e2eae3f7ba3/routeoverride-cni/0.log"
Sep 20 02:36:29.748398 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:29.748378    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8wp8_bb65d72f-e202-45f8-a70c-7e2eae3f7ba3/whereabouts-cni-bincopy/0.log"
Sep 20 02:36:29.768830 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:29.768777    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8wp8_bb65d72f-e202-45f8-a70c-7e2eae3f7ba3/whereabouts-cni/0.log"
Sep 20 02:36:29.910684 ip-10-0-135-222 kubenswrapper[2565]: I0920 02:36:29.910595    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rcwvl_a5c4b8d0-5e19-42e0-96ce-48f9a766c897/kube-multus/0.log"