Sep 11 21:17:22.173145 ip-10-0-141-71 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 21:17:22.560220 ip-10-0-141-71 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:17:22.560220 ip-10-0-141-71 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 21:17:22.560220 ip-10-0-141-71 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:17:22.560220 ip-10-0-141-71 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 21:17:22.560220 ip-10-0-141-71 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:17:22.561560 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.561476    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 21:17:22.572019 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.571985    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:22.572019 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572007    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:22.572019 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572013    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:22.572019 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572020    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:22.572019 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572023    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:22.572019 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572027    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572031    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572035    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572039    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572044    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572048    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572052    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572056    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572060    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572063    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572067    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572072    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572075    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572079    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572083    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572086    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572090    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572093    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572098    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572102    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:22.572372 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572105    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572111    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572115    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572119    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572123    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572127    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572131    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572135    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572138    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572143    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572147    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572151    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572155    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572161    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572166    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572171    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572175    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572180    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572184    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:22.573221 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572189    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572193    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572197    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572202    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572206    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572211    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572215    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572220    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572224    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572228    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572233    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572237    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572241    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572245    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572251    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572260    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572267    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572273    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572277    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572281    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:22.574074 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572285    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572289    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572294    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572298    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572302    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572306    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572310    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572315    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572320    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572324    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572328    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572332    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572336    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572340    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572345    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572349    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572353    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572360    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572366    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:22.575007 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572372    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572377    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572382    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572386    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572390    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572394    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572398    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572403    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572407    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572411    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572415    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572420    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572424    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572428    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572432    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.572439    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573611    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573622    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573627    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:22.575856 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573633    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573639    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573643    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573648    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573652    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573657    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573661    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573666    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573670    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573675    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573679    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573684    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573690    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573696    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573702    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573707    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573711    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573716    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573720    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:22.576685 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573724    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573728    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573733    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573737    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573741    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573746    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573750    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573754    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573759    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573763    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573767    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573771    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573776    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573780    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573784    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573788    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573793    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573797    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573801    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573806    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:22.577308 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573810    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573815    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573842    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573850    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573855    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573861    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573865    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573870    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573875    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573880    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573884    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573888    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573893    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573897    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573901    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573906    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573911    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573916    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573920    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:22.577925 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573925    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573931    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573938    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573943    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573947    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573952    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573956    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573961    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573968    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573972    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573977    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573982    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573986    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573990    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573994    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.573998    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574002    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574006    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574011    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:22.578439 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574015    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574019    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574024    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574029    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574034    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574038    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574042    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574046    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574051    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574055    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574059    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574064    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574068    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574072    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574076    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574080    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574084    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574089    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574094    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574753    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574764    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:22.579018 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574770    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574774    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574779    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574784    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574788    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574793    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574797    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574801    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574805    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574810    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574814    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574837    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574842    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574847    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574859    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574864    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574868    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574873    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574877    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574881    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:22.579682 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574885    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574890    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574895    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574899    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574904    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574908    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574912    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574916    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574920    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574924    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574928    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574933    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574938    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574942    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574947    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574951    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574955    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574959    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574963    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:22.580200 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574981    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574987    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574993    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.574997    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575002    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575007    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575011    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575015    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575020    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575025    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575030    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575034    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575039    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575043    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575048    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575052    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575057    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575061    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575066    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575070    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:22.580773 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575074    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575078    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575082    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575086    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575091    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575095    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575100    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575104    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575109    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575117    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575123    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575128    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575132    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575137    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575141    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575145    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575150    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575154    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575158    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575163    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:22.581344 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575166    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575172    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575180    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575186    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575190    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575195    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575200    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575204    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575208    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575212    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575217    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575221    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575225    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575229    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575234    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575238    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575242    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.575247    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575349    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575398    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 21:17:22.581866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575407    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575415    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575422    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575428    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575435    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575442    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575447    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575452    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575458    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575463    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575469    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575474    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575479    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575484    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575491    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575499    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575507    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575512    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575518    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575542    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575549    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575556    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575561    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 21:17:22.582376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575567    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575572    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575577    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575582    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575587    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575594    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575599    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575606    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575612    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575616    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575621    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575626    2560 flags.go:64] FLAG: --enable-server="true"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575630    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575637    2560 flags.go:64] FLAG: --event-burst="100"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575642    2560 flags.go:64] FLAG: --event-qps="50"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575647    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575652    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575657    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575663    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575668    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575673    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575678    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575683    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575688    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575696    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 21:17:22.582950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575701    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575706    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575711    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575715    2560 flags.go:64] FLAG: --feature-gates=""
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575722    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575727    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575732    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575737    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575742    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575747    2560 flags.go:64] FLAG: --help="false"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575752    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-141-71.ec2.internal"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575757    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575762    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575767    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575772    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575778    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575783    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575787    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575791    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575796    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575801    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575806    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575811    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575816    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 21:17:22.583642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575842    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575847    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575852    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575856    2560 flags.go:64] FLAG: --lock-file=""
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575861    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575865    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575870    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575879    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575885    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575890    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575895    2560 flags.go:64] FLAG: --logging-format="text"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575900    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575905    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575910    2560 flags.go:64] FLAG: --manifest-url=""
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575915    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575922    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575927    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575934    2560 flags.go:64] FLAG: --max-pods="110"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575939    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575944    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575949    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575955    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575960    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575965    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575969    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 21:17:22.584276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575982    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575987    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575992    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.575997    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576001    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576011    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576016    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576021    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576026    2560 flags.go:64] FLAG: --port="10250"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576031    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576036    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d9f040302fdbf5f1"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576041    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576047    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576052    2560 flags.go:64] FLAG: --register-node="true"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576057    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576063    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576069    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576074    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576079    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576086    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576091    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576096    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576101    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576105    2560 flags.go:64] FLAG: --runonce="false"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576110    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 21:17:22.584942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576115    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576120    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576125    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576130    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576135    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576140    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576145    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576151    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576156    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576161    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576165    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576171    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576176    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576181    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576190    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576195    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576200    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576208    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576213    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576218    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576223    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576228    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576233    2560 flags.go:64] FLAG: --v="2"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576239    2560 flags.go:64] FLAG: --version="false"
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576247    2560 flags.go:64] FLAG: --vmodule=""
Sep 11 21:17:22.585561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576255    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.576260    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576450    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576458    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576463    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576470    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576476    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576480    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576485    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576489    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576496    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576500    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576504    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576508    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576512    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576516    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576521    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576527    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576533    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:22.586213 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576539    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576543    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576548    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576553    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576557    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576562    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576566    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576571    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576576    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576581    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576585    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576590    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576594    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576599    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576604    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576609    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576613    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576618    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576622    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576626    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:22.586688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576631    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576636    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576639    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576645    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576650    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576654    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576659    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576663    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576668    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576672    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576677    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576681    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576686    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576690    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576694    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576699    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576703    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576707    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576711    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:22.587209 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576715    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576720    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576726    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576730    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576735    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576739    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576744    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576749    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576755    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576762    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576767    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576771    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576776    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576780    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576784    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576788    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576796    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576800    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576805    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576809    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:22.587688 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576813    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576838    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576843    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576847    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576851    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576856    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576860    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576864    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576869    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576873    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576878    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576882    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576886    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576890    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576896    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576901    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576905    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576909    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576914    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576918    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:22.588245 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576927    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576932    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.576936    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.577560    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.585477    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.585493    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.585514    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.585519    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585572    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585578    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585582    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585584    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585587    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585590    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:22.588751 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585592    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585597    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585600    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585603    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585607    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585609    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585612    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585615    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585619    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585621    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585624    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585627    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585630    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585632    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585635    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585637    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585640    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585643    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585646    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:22.589129 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585649    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585651    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585654    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585656    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585659    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585662    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585665    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585667    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585670    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585672    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585675    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585677    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585680    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585682    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585684    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585687    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585689    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585692    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585694    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585697    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:22.589603 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585700    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585703    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585706    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585709    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585711    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585714    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585716    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585719    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585721    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585724    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585726    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585729    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585732    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585735    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585738    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585740    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585745    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585749    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585751    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585754    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:22.590251 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585756    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585759    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585761    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585764    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585767    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585769    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585772    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585774    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585777    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585779    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585781    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585784    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585786    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585789    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585792    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585794    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585797    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585799    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585801    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585804    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:22.590870 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585806    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585809    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585811    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585813    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585816    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585836    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585840    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585842    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585845    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585848    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585851    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585854    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585856    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585858    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.585864    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:17:22.591381 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585976    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585981    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585985    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585987    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585990    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585993    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585996    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.585999    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586002    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586004    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586007    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586010    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586012    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586014    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586017    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586019    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586022    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586025    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586027    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:22.591757 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586029    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586032    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586034    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586037    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586040    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586042    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586045    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586047    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586050    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586052    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586055    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586057    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586059    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586062    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586064    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586067    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586069    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586072    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586074    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586076    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:22.592241 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586079    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586081    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586084    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586086    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586089    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586091    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586094    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586096    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586099    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586102    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586104    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586106    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586109    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586111    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586114    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586116    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586119    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586122    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586124    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586127    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:22.592740 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586130    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586132    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586135    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586137    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586140    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586142    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586144    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586148    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586152    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586155    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586157    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586160    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586163    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586165    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586168    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586170    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586173    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586175    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586178    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:22.593246 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586180    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586183    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586187    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586190    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586193    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586196    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586198    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586201    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586204    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586208    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586211    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586215    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586218    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586221    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586224    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586226    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586229    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586231    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586234    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:22.593709 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586236    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:22.594299 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:22.586247    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:22.594299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.586252    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:17:22.594299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.586361    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 21:17:22.594299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.588436    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 21:17:22.594299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.589583    2560 server.go:1019] "Starting client certificate rotation"
Sep 11 21:17:22.594299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.589716    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:17:22.594299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.589750    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:17:22.594299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.592204    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:17:22.594299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.593992    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:17:22.601454 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.601432    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 11 21:17:22.604373 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.604357    2560 log.go:25] "Validated CRI v1 image API"
Sep 11 21:17:22.605301 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.605283    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 21:17:22.612093 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.612071    2560 fs.go:135] Filesystem UUIDs: map[2d350354-bb8b-4b92-b5c4-0124bf210b04:/dev/nvme0n1p4 6c1c5f99-eea7-49ad-8522-acdfc0d45cc7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 11 21:17:22.612182 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.612090    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 21:17:22.618135 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.618026    2560 manager.go:216] Machine: {Timestamp:2026-09-11 21:17:22.616812134 +0000 UTC m=+0.329472174 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100004 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25a1b5e9ebbf27c5189cd24048a749 SystemUUID:ec25a1b5-e9eb-bf27-c518-9cd24048a749 BootID:9eb917e9-8b4f-4b04-9fe9-460c73bbdce1 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:f6:ff:dc:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:f6:ff:dc:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:c3:fe:a2:63:59 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 21:17:22.618135 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.618130    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 21:17:22.618254 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.618212    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 21:17:22.621262 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.621239    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 21:17:22.621404 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.621264    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-71.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 21:17:22.622508 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.622496    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 21:17:22.622550 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.622511    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 21:17:22.622550 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.622518    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:17:22.623255 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.623244    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:17:22.624189 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.624179    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 21:17:22.624301 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.624283    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:17:22.628013 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.628001    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:17:22.628130 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.628121    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 21:17:22.628165 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.628150    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 21:17:22.628165 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.628160    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 21:17:22.628225 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.628171    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 21:17:22.628225 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.628181    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 11 21:17:22.628225 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.628190    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 21:17:22.628640 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.628620    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:17:22.628640 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.628645    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:17:22.632005 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.631987    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 21:17:22.634374 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.634357    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 21:17:22.634446 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.634388    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 21:17:22.635975 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.635963    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 21:17:22.636022 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.635981    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 21:17:22.636022 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.635994    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 21:17:22.636022 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.636000    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 21:17:22.636022 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.636009    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 21:17:22.636022 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.636015    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 21:17:22.636153 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.636028    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 21:17:22.636153 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.636033    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 21:17:22.636153 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.636040    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 21:17:22.636153 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.636052    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 21:17:22.636153 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.636066    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 21:17:22.636153 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.636071    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 21:17:22.637523 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.637512    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 21:17:22.637523 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.637523    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 21:17:22.639796 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.639776    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 21:17:22.640216 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.640192    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 21:17:22.641736 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.641724    2560 server.go:1268] "Started kubelet"
Sep 11 21:17:22.641887 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.641862    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 21:17:22.642064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.642011    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 21:17:22.642100 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.642090    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 21:17:22.642849 ip-10-0-141-71 systemd[1]: Started Kubernetes Kubelet.
Sep 11 21:17:22.643886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.643691    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 21:17:22.648147 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.648120    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-71.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 21:17:22.648243 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.648193    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 21:17:22.648521 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.648492    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 21:17:22.653285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.653259    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 21:17:22.653867 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.653817    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 21:17:22.654039 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.654015    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:22.654499 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654481    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 21:17:22.654641 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654485    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 21:17:22.654641 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654630    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 21:17:22.654641 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654636    2560 factory.go:55] Registering systemd factory
Sep 11 21:17:22.654808 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654650    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 11 21:17:22.654808 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654759    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 21:17:22.654808 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654771    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 21:17:22.654970 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654887    2560 factory.go:153] Registering CRI-O factory
Sep 11 21:17:22.654970 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654901    2560 factory.go:223] Registration of the crio container factory successfully
Sep 11 21:17:22.654970 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654960    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 21:17:22.655100 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654979    2560 factory.go:103] Registering Raw factory
Sep 11 21:17:22.655100 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.654994    2560 manager.go:1196] Started watching for new ooms in manager
Sep 11 21:17:22.655840 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.655802    2560 manager.go:349] Starting recovery of all containers
Sep 11 21:17:22.656748 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.655561    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18d460da4a7bd689  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-09-11 21:17:22.641696393 +0000 UTC m=+0.354356433,LastTimestamp:2026-09-11 21:17:22.641696393 +0000 UTC m=+0.354356433,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Sep 11 21:17:22.666065 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.666050    2560 manager.go:354] Recovery completed
Sep 11 21:17:22.666982 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.666959    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 21:17:22.667318 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.667293    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 21:17:22.670255 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.670234    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:22.672136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.672118    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:22.672204 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.672147    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:22.672204 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.672157    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:22.672737 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.672723    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 21:17:22.672737 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.672734    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:22.672855 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.672737    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 21:17:22.672855 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.672797    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:17:22.673455 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.673439    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:22.673514 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.673467    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:22.673514 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.673479    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:22.674811 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.674752    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18d460da4c4c49f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-71.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-09-11 21:17:22.672134643 +0000 UTC m=+0.384794683,LastTimestamp:2026-09-11 21:17:22.672134643 +0000 UTC m=+0.384794683,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Sep 11 21:17:22.674976 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.674963    2560 policy_none.go:49] "None policy: Start"
Sep 11 21:17:22.675039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.674982    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 21:17:22.675039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.674996    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 21:17:22.677013 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.677000    2560 policy_none.go:47] "Start"
Sep 11 21:17:22.688645 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.688579    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18d460da4c4c8df7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-71.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-09-11 21:17:22.672152055 +0000 UTC m=+0.384812095,LastTimestamp:2026-09-11 21:17:22.672152055 +0000 UTC m=+0.384812095,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Sep 11 21:17:22.704740 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.704673    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18d460da4c4cafa5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-71.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-09-11 21:17:22.672160677 +0000 UTC m=+0.384820717,LastTimestamp:2026-09-11 21:17:22.672160677 +0000 UTC m=+0.384820717,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Sep 11 21:17:22.715358 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.715345    2560 manager.go:337] "Starting Device Plugin manager"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.715379    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.715390    2560 server.go:87] "Starting device plugin registration server"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.715678    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.715688    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.715770    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.715857    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.715864    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.716953    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.717029    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.717269    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-71.ec2.internal.18d460da4c4c49f3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18d460da4c4c49f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-71.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-09-11 21:17:22.672134643 +0000 UTC m=+0.384794683,LastTimestamp:2026-09-11 21:17:22.673454826 +0000 UTC m=+0.386114866,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Sep 11 21:17:22.734317 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.727017    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-71.ec2.internal.18d460da4c4c8df7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18d460da4c4c8df7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-71.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-09-11 21:17:22.672152055 +0000 UTC m=+0.384812095,LastTimestamp:2026-09-11 21:17:22.673472582 +0000 UTC m=+0.386132622,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Sep 11 21:17:22.736588 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.736572    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gf5bn"
Sep 11 21:17:22.739231 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.739165    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-71.ec2.internal.18d460da4c4cafa5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18d460da4c4cafa5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-71.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-09-11 21:17:22.672160677 +0000 UTC m=+0.384820717,LastTimestamp:2026-09-11 21:17:22.673482617 +0000 UTC m=+0.386142661,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Sep 11 21:17:22.744462 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.744446    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gf5bn"
Sep 11 21:17:22.793035 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.792999    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 21:17:22.794416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.794389    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 21:17:22.794522 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.794451    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 21:17:22.794522 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.794480    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 21:17:22.794613 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.794526    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 21:17:22.797047 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.797030    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:22.816269 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.816253    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:22.817107 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.817092    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:22.817192 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.817120    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:22.817192 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.817130    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:22.817192 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.817152    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-71.ec2.internal"
Sep 11 21:17:22.827259 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.827244    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-71.ec2.internal"
Sep 11 21:17:22.827302 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.827270    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-71.ec2.internal\": node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:22.839619 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.839597    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:22.894750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.894727    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"]
Sep 11 21:17:22.894859 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.894788    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:22.896197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.896181    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:22.896276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.896210    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:22.896276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.896220    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:22.898450 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.898437    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:22.898587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.898574    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:22.898627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.898604    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:22.899194 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.899179    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:22.899268 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.899208    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:22.899268 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.899219    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:22.899268 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.899223    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:22.899268 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.899241    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:22.899268 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.899252    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:22.901290 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.901275    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:22.901343 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.901298    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:22.902027 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.902013    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:22.902100 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.902042    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:22.902100 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.902056    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:22.918403 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.918384    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-71.ec2.internal\" not found" node="ip-10-0-141-71.ec2.internal"
Sep 11 21:17:22.922332 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.922318    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-71.ec2.internal\" not found" node="ip-10-0-141-71.ec2.internal"
Sep 11 21:17:22.940178 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:22.940161    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:22.955865 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.955846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ed1bbad54a404e12fdf4825da01afdc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"5ed1bbad54a404e12fdf4825da01afdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:22.955915 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.955876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ed1bbad54a404e12fdf4825da01afdc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"5ed1bbad54a404e12fdf4825da01afdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:22.955915 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:22.955893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b773acae9b26ce935d4f41dd9b33839a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-71.ec2.internal\" (UID: \"b773acae9b26ce935d4f41dd9b33839a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:23.041135 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.041109    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.056465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.056438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ed1bbad54a404e12fdf4825da01afdc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"5ed1bbad54a404e12fdf4825da01afdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:23.056527 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.056471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ed1bbad54a404e12fdf4825da01afdc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"5ed1bbad54a404e12fdf4825da01afdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:23.056527 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.056488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b773acae9b26ce935d4f41dd9b33839a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-71.ec2.internal\" (UID: \"b773acae9b26ce935d4f41dd9b33839a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:23.056587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.056536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b773acae9b26ce935d4f41dd9b33839a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-71.ec2.internal\" (UID: \"b773acae9b26ce935d4f41dd9b33839a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:23.056587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.056541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ed1bbad54a404e12fdf4825da01afdc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"5ed1bbad54a404e12fdf4825da01afdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:23.056587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.056556    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ed1bbad54a404e12fdf4825da01afdc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"5ed1bbad54a404e12fdf4825da01afdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:23.141912 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.141849    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.221358 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.221326    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:23.225059 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.225039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:23.242813 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.242789    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.343343 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.343310    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.443923 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.443854    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.544469 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.544432    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.589906 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.589875    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 21:17:23.590340 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.590027    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 21:17:23.645344 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.645313    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.746190 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.746113    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.748283 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.748251    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 21:12:23 +0000 UTC" deadline="2028-06-26 10:10:58.125042234 +0000 UTC"
Sep 11 21:17:23.748351 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.748284    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15684h53m34.376761526s"
Sep 11 21:17:23.779774 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.779753    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:23.780855 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.780835    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:23.780905 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.780875    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:23.780905 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.780887    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:23.801204 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.801176    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:23.824089 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:23.824018    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed1bbad54a404e12fdf4825da01afdc.slice/crio-dc1d2f39e6f763c11f3ee8d47dd705150ae7ef0f211be5bafb93ae9d198a3d24 WatchSource:0}: Error finding container dc1d2f39e6f763c11f3ee8d47dd705150ae7ef0f211be5bafb93ae9d198a3d24: Status 404 returned error can't find the container with id dc1d2f39e6f763c11f3ee8d47dd705150ae7ef0f211be5bafb93ae9d198a3d24
Sep 11 21:17:23.824854 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:23.824815    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb773acae9b26ce935d4f41dd9b33839a.slice/crio-4ab7634546c002a93b03057bf79f9dd5c64a229d1e443fb3ca1c41b8703c1728 WatchSource:0}: Error finding container 4ab7634546c002a93b03057bf79f9dd5c64a229d1e443fb3ca1c41b8703c1728: Status 404 returned error can't find the container with id 4ab7634546c002a93b03057bf79f9dd5c64a229d1e443fb3ca1c41b8703c1728
Sep 11 21:17:23.829803 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.829785    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:17:23.846811 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.846791    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.947517 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:23.947480    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Sep 11 21:17:23.989048 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:23.989019    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:24.054785 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.054712    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:24.066483 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.066460    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:17:24.067513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.067500    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Sep 11 21:17:24.077012 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.076956    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:17:24.143625 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.143598    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:24.630144 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.630112    2560 apiserver.go:52] "Watching apiserver"
Sep 11 21:17:24.637140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.637105    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 21:17:24.638292 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.638265    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-glzgj","kube-system/global-pull-secret-syncer-whrjq","kube-system/konnectivity-agent-gcfz6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk","openshift-dns/node-resolver-qkfqp","openshift-image-registry/node-ca-lr2nj","openshift-multus/multus-hq5zs","openshift-multus/network-metrics-daemon-mldrg","openshift-network-operator/iptables-alerter-4zhgf","kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2vqks","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal","openshift-multus/multus-additional-cni-plugins-225cz","openshift-network-diagnostics/network-check-target-dtqb6"]
Sep 11 21:17:24.641079 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.641056    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.644206 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.643860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.644940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.644918    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 21:17:24.645374 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.645348    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-67vfc\""
Sep 11 21:17:24.645615 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.645599    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 21:17:24.645850 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.645835    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 21:17:24.646521 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.646088    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 21:17:24.646521 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.646170    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:24.646652 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.646553    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 21:17:24.647269 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.646878    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rjkck\""
Sep 11 21:17:24.647269 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.646894    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 21:17:24.648638 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.648612    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 21:17:24.649175 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.648845    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.649267 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.649187    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r4szf\""
Sep 11 21:17:24.649439 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.649418    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 21:17:24.650899 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.650875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.651566 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.651374    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 21:17:24.651566 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.651396    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-58xs2\""
Sep 11 21:17:24.651566 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.651461    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 21:17:24.651566 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.651472    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 21:17:24.653616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.653434    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 21:17:24.653616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.653459    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 21:17:24.653616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.653574    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.654148 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.653954    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z4rl8\""
Sep 11 21:17:24.655925 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.655334    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 21:17:24.656695 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.656674    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 21:17:24.656958 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.656938    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 21:17:24.657112 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.657097    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 21:17:24.657171 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.657134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.657225 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.657190    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hzt2q\""
Sep 11 21:17:24.658830 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.658807    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.660245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.660226    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:17:24.660949 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.660922    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wzts6\""
Sep 11 21:17:24.667680 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.667652    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 21:17:24.667776 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.667695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-var-lib-cni-multus\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.667776 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.667738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-multus-conf-dir\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.667933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.667777    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-hostroot\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.667933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.667805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m8c8\" (UniqueName: \"kubernetes.io/projected/499f9938-d0b5-4119-b7fb-543980707fe5-kube-api-access-6m8c8\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.667933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.667854    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 21:17:24.667933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.667840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5070b1d6-abf9-462c-b660-e9782f95bc35-konnectivity-ca\") pod \"konnectivity-agent-gcfz6\" (UID: \"5070b1d6-abf9-462c-b660-e9782f95bc35\") " pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:24.667933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.667906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-device-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.668180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.667940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkgxq\" (UniqueName: \"kubernetes.io/projected/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-kube-api-access-rkgxq\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.668180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-run-netns\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.668180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-var-lib-kubelet\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.668180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/499f9938-d0b5-4119-b7fb-543980707fe5-multus-daemon-config\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.668180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668159    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 21:17:24.668416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.668416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668219    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p7bdp\""
Sep 11 21:17:24.668416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/507f3ca7-2dc6-4c08-861f-95658fe612b7-host-slash\") pod \"iptables-alerter-4zhgf\" (UID: \"507f3ca7-2dc6-4c08-861f-95658fe612b7\") " pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.668416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.668416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.668416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72g77\" (UniqueName: \"kubernetes.io/projected/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-kube-api-access-72g77\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.668714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/507f3ca7-2dc6-4c08-861f-95658fe612b7-iptables-alerter-script\") pod \"iptables-alerter-4zhgf\" (UID: \"507f3ca7-2dc6-4c08-861f-95658fe612b7\") " pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.668714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b57fr\" (UniqueName: \"kubernetes.io/projected/507f3ca7-2dc6-4c08-861f-95658fe612b7-kube-api-access-b57fr\") pod \"iptables-alerter-4zhgf\" (UID: \"507f3ca7-2dc6-4c08-861f-95658fe612b7\") " pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.668714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5070b1d6-abf9-462c-b660-e9782f95bc35-agent-certs\") pod \"konnectivity-agent-gcfz6\" (UID: \"5070b1d6-abf9-462c-b660-e9782f95bc35\") " pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:24.668714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-kubelet-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.668714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-socket-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.668714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-etc-selinux\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.668714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-sys-fs\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-multus-cni-dir\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8bcbacb0-e371-4960-b618-9b05daf4fdcf-hosts-file\") pod \"node-resolver-qkfqp\" (UID: \"8bcbacb0-e371-4960-b618-9b05daf4fdcf\") " pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jnd9\" (UniqueName: \"kubernetes.io/projected/8bcbacb0-e371-4960-b618-9b05daf4fdcf-kube-api-access-8jnd9\") pod \"node-resolver-qkfqp\" (UID: \"8bcbacb0-e371-4960-b618-9b05daf4fdcf\") " pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668228    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668830    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e7d3f47-930d-4f95-9876-9d672acd1f17-host\") pod \"node-ca-lr2nj\" (UID: \"3e7d3f47-930d-4f95-9876-9d672acd1f17\") " pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppt5w\" (UniqueName: \"kubernetes.io/projected/3e7d3f47-930d-4f95-9876-9d672acd1f17-kube-api-access-ppt5w\") pod \"node-ca-lr2nj\" (UID: \"3e7d3f47-930d-4f95-9876-9d672acd1f17\") " pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-multus-socket-dir-parent\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.668998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-etc-kubernetes\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bcbacb0-e371-4960-b618-9b05daf4fdcf-tmp-dir\") pod \"node-resolver-qkfqp\" (UID: \"8bcbacb0-e371-4960-b618-9b05daf4fdcf\") " pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e7d3f47-930d-4f95-9876-9d672acd1f17-serviceca\") pod \"node-ca-lr2nj\" (UID: \"3e7d3f47-930d-4f95-9876-9d672acd1f17\") " pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.669146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669133    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669137    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-run-multus-certs\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-run-k8s-cni-cncf-io\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669283    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669285    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-registration-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-cnibin\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-system-cni-dir\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-system-cni-dir\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-cnibin\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/499f9938-d0b5-4119-b7fb-543980707fe5-cni-binary-copy\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.669719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.669550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-var-lib-cni-bin\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.672095 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.670376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:24.672095 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.670459    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:24.673456 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.673237    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:24.673456 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.673314    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:24.674575 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.674549    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:17:24.676641 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.676267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.678660 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.678637    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 21:17:24.679141 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.678831    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:17:24.679141 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.678921    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:24.679141 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.678972    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:24.679141 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.679051    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pgzd8\""
Sep 11 21:17:24.696702 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.696678    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-59xk5"
Sep 11 21:17:24.703014 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.702982    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-59xk5"
Sep 11 21:17:24.756063 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.756032    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 21:17:24.770574 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770540    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-system-cni-dir\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.770723 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-cnibin\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.770723 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-multus-conf-dir\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.770723 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m8c8\" (UniqueName: \"kubernetes.io/projected/499f9938-d0b5-4119-b7fb-543980707fe5-kube-api-access-6m8c8\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.770723 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5070b1d6-abf9-462c-b660-e9782f95bc35-konnectivity-ca\") pod \"konnectivity-agent-gcfz6\" (UID: \"5070b1d6-abf9-462c-b660-e9782f95bc35\") " pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:24.770723 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgxq\" (UniqueName: \"kubernetes.io/projected/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-kube-api-access-rkgxq\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/459a4133-e123-4a72-af54-1f7205936578-ovnkube-script-lib\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-kubernetes\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-hostroot\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-device-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-run-systemd\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-cni-netd\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-sysconfig\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.770998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-host\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.771031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-tuned\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-run-netns\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-var-lib-kubelet\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-sys-fs\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bcbacb0-e371-4960-b618-9b05daf4fdcf-tmp-dir\") pod \"node-resolver-qkfqp\" (UID: \"8bcbacb0-e371-4960-b618-9b05daf4fdcf\") " pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-kubelet\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-node-log\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72g77\" (UniqueName: \"kubernetes.io/projected/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-kube-api-access-72g77\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/507f3ca7-2dc6-4c08-861f-95658fe612b7-iptables-alerter-script\") pod \"iptables-alerter-4zhgf\" (UID: \"507f3ca7-2dc6-4c08-861f-95658fe612b7\") " pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-kubelet-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-socket-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e7d3f47-930d-4f95-9876-9d672acd1f17-host\") pod \"node-ca-lr2nj\" (UID: \"3e7d3f47-930d-4f95-9876-9d672acd1f17\") " pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppt5w\" (UniqueName: \"kubernetes.io/projected/3e7d3f47-930d-4f95-9876-9d672acd1f17-kube-api-access-ppt5w\") pod \"node-ca-lr2nj\" (UID: \"3e7d3f47-930d-4f95-9876-9d672acd1f17\") " pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-systemd-units\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-run-netns\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771479    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-system-cni-dir\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.771587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-multus-conf-dir\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.772472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-multus-cni-dir\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.772472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-hostroot\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.772472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-device-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.772472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-run-netns\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.772472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-var-lib-kubelet\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.772472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5070b1d6-abf9-462c-b660-e9782f95bc35-konnectivity-ca\") pod \"konnectivity-agent-gcfz6\" (UID: \"5070b1d6-abf9-462c-b660-e9782f95bc35\") " pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:24.772472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.771485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-multus-cni-dir\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.772472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/459a4133-e123-4a72-af54-1f7205936578-env-overrides\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.772472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-modprobe-d\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-etc-kubernetes\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-sysctl-d\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cxxf\" (UniqueName: \"kubernetes.io/projected/9d7777e2-d273-45bf-9271-65051bab4142-kube-api-access-9cxxf\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-run-ovn-kubernetes\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkrb5\" (UniqueName: \"kubernetes.io/projected/459a4133-e123-4a72-af54-1f7205936578-kube-api-access-dkrb5\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-cnibin\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-run\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4fz7\" (UniqueName: \"kubernetes.io/projected/875c3113-55a8-4b3b-8cac-3fafbdae35be-kube-api-access-f4fz7\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-sys-fs\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-dbus\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-system-cni-dir\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.772952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/499f9938-d0b5-4119-b7fb-543980707fe5-cni-binary-copy\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-var-lib-cni-bin\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-var-lib-cni-multus\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-etc-openvswitch\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.772991    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-run-ovn\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-log-socket\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/459a4133-e123-4a72-af54-1f7205936578-ovnkube-config\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-lib-modules\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bcbacb0-e371-4960-b618-9b05daf4fdcf-tmp-dir\") pod \"node-resolver-qkfqp\" (UID: \"8bcbacb0-e371-4960-b618-9b05daf4fdcf\") " pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-var-lib-kubelet\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/875c3113-55a8-4b3b-8cac-3fafbdae35be-tmp\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/499f9938-d0b5-4119-b7fb-543980707fe5-multus-daemon-config\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773338    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-cnibin\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-system-cni-dir\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/507f3ca7-2dc6-4c08-861f-95658fe612b7-host-slash\") pod \"iptables-alerter-4zhgf\" (UID: \"507f3ca7-2dc6-4c08-861f-95658fe612b7\") " pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.773813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-var-lib-openvswitch\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b57fr\" (UniqueName: \"kubernetes.io/projected/507f3ca7-2dc6-4c08-861f-95658fe612b7-kube-api-access-b57fr\") pod \"iptables-alerter-4zhgf\" (UID: \"507f3ca7-2dc6-4c08-861f-95658fe612b7\") " pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5070b1d6-abf9-462c-b660-e9782f95bc35-agent-certs\") pod \"konnectivity-agent-gcfz6\" (UID: \"5070b1d6-abf9-462c-b660-e9782f95bc35\") " pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-etc-selinux\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8bcbacb0-e371-4960-b618-9b05daf4fdcf-hosts-file\") pod \"node-resolver-qkfqp\" (UID: \"8bcbacb0-e371-4960-b618-9b05daf4fdcf\") " pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-sysctl-conf\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-sys\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jnd9\" (UniqueName: \"kubernetes.io/projected/8bcbacb0-e371-4960-b618-9b05daf4fdcf-kube-api-access-8jnd9\") pod \"node-resolver-qkfqp\" (UID: \"8bcbacb0-e371-4960-b618-9b05daf4fdcf\") " pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-slash\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/499f9938-d0b5-4119-b7fb-543980707fe5-cni-binary-copy\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.773978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-multus-socket-dir-parent\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-var-lib-cni-bin\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e7d3f47-930d-4f95-9876-9d672acd1f17-serviceca\") pod \"node-ca-lr2nj\" (UID: \"3e7d3f47-930d-4f95-9876-9d672acd1f17\") " pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774046    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-var-lib-cni-multus\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-run-openvswitch\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-cni-bin\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.774714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-systemd\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-run-multus-certs\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-run-k8s-cni-cncf-io\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-registration-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-kubelet-config\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/459a4133-e123-4a72-af54-1f7205936578-ovn-node-metrics-cert\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.774779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775194    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775241    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/507f3ca7-2dc6-4c08-861f-95658fe612b7-iptables-alerter-script\") pod \"iptables-alerter-4zhgf\" (UID: \"507f3ca7-2dc6-4c08-861f-95658fe612b7\") " pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-cnibin\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-kubelet-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/507f3ca7-2dc6-4c08-861f-95658fe612b7-host-slash\") pod \"iptables-alerter-4zhgf\" (UID: \"507f3ca7-2dc6-4c08-861f-95658fe612b7\") " pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-socket-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775415    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-run-multus-certs\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-host-run-k8s-cni-cncf-io\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-registration-dir\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.775578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-etc-kubernetes\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.776339 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.775549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e7d3f47-930d-4f95-9876-9d672acd1f17-host\") pod \"node-ca-lr2nj\" (UID: \"3e7d3f47-930d-4f95-9876-9d672acd1f17\") " pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.776339 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.776034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e7d3f47-930d-4f95-9876-9d672acd1f17-serviceca\") pod \"node-ca-lr2nj\" (UID: \"3e7d3f47-930d-4f95-9876-9d672acd1f17\") " pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.776339 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.776104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8bcbacb0-e371-4960-b618-9b05daf4fdcf-hosts-file\") pod \"node-resolver-qkfqp\" (UID: \"8bcbacb0-e371-4960-b618-9b05daf4fdcf\") " pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.776339 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.776126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/499f9938-d0b5-4119-b7fb-543980707fe5-multus-daemon-config\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.776339 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.776186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/499f9938-d0b5-4119-b7fb-543980707fe5-multus-socket-dir-parent\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.776339 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.776200    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-etc-selinux\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.776605 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.776532    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 21:17:24.782048 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.781848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5070b1d6-abf9-462c-b660-e9782f95bc35-agent-certs\") pod \"konnectivity-agent-gcfz6\" (UID: \"5070b1d6-abf9-462c-b660-e9782f95bc35\") " pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:24.788702 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.788669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m8c8\" (UniqueName: \"kubernetes.io/projected/499f9938-d0b5-4119-b7fb-543980707fe5-kube-api-access-6m8c8\") pod \"multus-hq5zs\" (UID: \"499f9938-d0b5-4119-b7fb-543980707fe5\") " pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.789000 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.788947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppt5w\" (UniqueName: \"kubernetes.io/projected/3e7d3f47-930d-4f95-9876-9d672acd1f17-kube-api-access-ppt5w\") pod \"node-ca-lr2nj\" (UID: \"3e7d3f47-930d-4f95-9876-9d672acd1f17\") " pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:24.789623 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.789594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72g77\" (UniqueName: \"kubernetes.io/projected/17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf-kube-api-access-72g77\") pod \"multus-additional-cni-plugins-225cz\" (UID: \"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf\") " pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.790622 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.790599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkgxq\" (UniqueName: \"kubernetes.io/projected/fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24-kube-api-access-rkgxq\") pod \"aws-ebs-csi-driver-node-564nk\" (UID: \"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.790786 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.790732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jnd9\" (UniqueName: \"kubernetes.io/projected/8bcbacb0-e371-4960-b618-9b05daf4fdcf-kube-api-access-8jnd9\") pod \"node-resolver-qkfqp\" (UID: \"8bcbacb0-e371-4960-b618-9b05daf4fdcf\") " pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:24.791394 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.791374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b57fr\" (UniqueName: \"kubernetes.io/projected/507f3ca7-2dc6-4c08-861f-95658fe612b7-kube-api-access-b57fr\") pod \"iptables-alerter-4zhgf\" (UID: \"507f3ca7-2dc6-4c08-861f-95658fe612b7\") " pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:24.799950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.799878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal" event={"ID":"b773acae9b26ce935d4f41dd9b33839a","Type":"ContainerStarted","Data":"4ab7634546c002a93b03057bf79f9dd5c64a229d1e443fb3ca1c41b8703c1728"}
Sep 11 21:17:24.801171 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.801147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal" event={"ID":"5ed1bbad54a404e12fdf4825da01afdc","Type":"ContainerStarted","Data":"dc1d2f39e6f763c11f3ee8d47dd705150ae7ef0f211be5bafb93ae9d198a3d24"}
Sep 11 21:17:24.874792 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.874754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:24.874792 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.874797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-slash\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.874822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-run-openvswitch\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.874863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-cni-bin\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.874884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-systemd\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.874907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-kubelet-config\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.874931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/459a4133-e123-4a72-af54-1f7205936578-ovn-node-metrics-cert\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.874960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/459a4133-e123-4a72-af54-1f7205936578-ovnkube-script-lib\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.874980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-kubernetes\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-run-systemd\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-cni-netd\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-sysconfig\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-host\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-tuned\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-kubelet\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-node-log\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-systemd-units\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-run-netns\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/459a4133-e123-4a72-af54-1f7205936578-env-overrides\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-modprobe-d\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875329    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-sysctl-d\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875413    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cxxf\" (UniqueName: \"kubernetes.io/projected/9d7777e2-d273-45bf-9271-65051bab4142-kube-api-access-9cxxf\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-run-ovn-kubernetes\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkrb5\" (UniqueName: \"kubernetes.io/projected/459a4133-e123-4a72-af54-1f7205936578-kube-api-access-dkrb5\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-run\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.875624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4fz7\" (UniqueName: \"kubernetes.io/projected/875c3113-55a8-4b3b-8cac-3fafbdae35be-kube-api-access-f4fz7\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875540    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-dbus\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-etc-openvswitch\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-run-ovn\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-log-socket\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/459a4133-e123-4a72-af54-1f7205936578-ovnkube-config\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-lib-modules\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-var-lib-kubelet\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/875c3113-55a8-4b3b-8cac-3fafbdae35be-tmp\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-var-lib-openvswitch\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-sysctl-conf\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-sys\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.875883    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-sys\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.875984    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs podName:9d7777e2-d273-45bf-9271-65051bab4142 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:25.375943258 +0000 UTC m=+3.088603313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs") pod "network-metrics-daemon-mldrg" (UID: "9d7777e2-d273-45bf-9271-65051bab4142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.876027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-run-openvswitch\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.876045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-systemd-units\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.876471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.876062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-cni-bin\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.876098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-slash\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.876124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-run-netns\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.876182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-systemd\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.876229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-kubelet-config\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.876560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/459a4133-e123-4a72-af54-1f7205936578-env-overrides\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.876705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-modprobe-d\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.876790    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.876838    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret podName:dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:25.376822031 +0000 UTC m=+3.089482063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret") pod "global-pull-secret-syncer-whrjq" (UID: "dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.877193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-sysctl-d\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.877323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.877199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.877815 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.877436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-run-ovn-kubernetes\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.877815 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.877668    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/459a4133-e123-4a72-af54-1f7205936578-ovnkube-script-lib\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.877815 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.877724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-kubernetes\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.877815 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.877731    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-run\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.877815 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.877767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-run-systemd\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.877815 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.877797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-cni-netd\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.878164 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.878018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-dbus\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:24.878164 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.878072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-etc-openvswitch\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.878164 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.878121    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-run-ovn\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.878317 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.878165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-log-socket\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.878886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.878430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-host-kubelet\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.878886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.878672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/459a4133-e123-4a72-af54-1f7205936578-ovnkube-config\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.878886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.878734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-var-lib-openvswitch\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.878886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.875760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/459a4133-e123-4a72-af54-1f7205936578-node-log\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.879166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.878916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-sysctl-conf\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.879166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.878937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-sysconfig\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.879166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.879004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-host\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.879166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.879013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-lib-modules\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.879166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.879054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/875c3113-55a8-4b3b-8cac-3fafbdae35be-var-lib-kubelet\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.879354 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.879323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/459a4133-e123-4a72-af54-1f7205936578-ovn-node-metrics-cert\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.881274 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.881228    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/875c3113-55a8-4b3b-8cac-3fafbdae35be-etc-tuned\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.881705 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.881684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/875c3113-55a8-4b3b-8cac-3fafbdae35be-tmp\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.883322 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.883303    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:24.883421 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.883327    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:24.883421 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.883341    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mgmth for pod openshift-network-diagnostics/network-check-target-dtqb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:24.883421 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:24.883403    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth podName:9dc4d446-45ad-4b42-953c-b5a7cdeda14a nodeName:}" failed. No retries permitted until 2026-09-11 21:17:25.383386846 +0000 UTC m=+3.096046875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mgmth" (UniqueName: "kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth") pod "network-check-target-dtqb6" (UID: "9dc4d446-45ad-4b42-953c-b5a7cdeda14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:24.887321 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.887291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cxxf\" (UniqueName: \"kubernetes.io/projected/9d7777e2-d273-45bf-9271-65051bab4142-kube-api-access-9cxxf\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:24.888384 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.888085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkrb5\" (UniqueName: \"kubernetes.io/projected/459a4133-e123-4a72-af54-1f7205936578-kube-api-access-dkrb5\") pod \"ovnkube-node-glzgj\" (UID: \"459a4133-e123-4a72-af54-1f7205936578\") " pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:24.888384 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.888310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4fz7\" (UniqueName: \"kubernetes.io/projected/875c3113-55a8-4b3b-8cac-3fafbdae35be-kube-api-access-f4fz7\") pod \"tuned-2vqks\" (UID: \"875c3113-55a8-4b3b-8cac-3fafbdae35be\") " pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:24.955173 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.955140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hq5zs"
Sep 11 21:17:24.974837 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.974808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-225cz"
Sep 11 21:17:24.984191 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.984161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:24.990072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.990053    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk"
Sep 11 21:17:24.999342 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:24.999321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qkfqp"
Sep 11 21:17:25.006180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.006158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lr2nj"
Sep 11 21:17:25.016178 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.016160    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4zhgf"
Sep 11 21:17:25.023089 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.023073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:25.029053 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.028908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2vqks"
Sep 11 21:17:25.138880 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.138805    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:25.381086 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.381042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:25.381288 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.381127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:25.381288 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:25.381186    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:25.381288 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:25.381239    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:25.381288 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:25.381264    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret podName:dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:26.381247114 +0000 UTC m=+4.093907147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret") pod "global-pull-secret-syncer-whrjq" (UID: "dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:25.381470 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:25.381300    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs podName:9d7777e2-d273-45bf-9271-65051bab4142 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:26.381282198 +0000 UTC m=+4.093942233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs") pod "network-metrics-daemon-mldrg" (UID: "9d7777e2-d273-45bf-9271-65051bab4142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:25.481968 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.481872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:25.482113 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:25.482022    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:25.482113 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:25.482038    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:25.482113 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:25.482047    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mgmth for pod openshift-network-diagnostics/network-check-target-dtqb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:25.482113 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:25.482100    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth podName:9dc4d446-45ad-4b42-953c-b5a7cdeda14a nodeName:}" failed. No retries permitted until 2026-09-11 21:17:26.482086731 +0000 UTC m=+4.194746759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mgmth" (UniqueName: "kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth") pod "network-check-target-dtqb6" (UID: "9dc4d446-45ad-4b42-953c-b5a7cdeda14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:25.706016 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.705974    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:12:25 +0000 UTC" deadline="2028-03-14 13:42:29.345806244 +0000 UTC"
Sep 11 21:17:25.706016 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:25.706011    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13192h25m3.639800141s"
Sep 11 21:17:25.885480 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:25.885447    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7d3f47_930d_4f95_9876_9d672acd1f17.slice/crio-836bd43951ffff7efd560e51b01a3b81e2f86189d2ceda62c01f275e2c71abf2 WatchSource:0}: Error finding container 836bd43951ffff7efd560e51b01a3b81e2f86189d2ceda62c01f275e2c71abf2: Status 404 returned error can't find the container with id 836bd43951ffff7efd560e51b01a3b81e2f86189d2ceda62c01f275e2c71abf2
Sep 11 21:17:25.887429 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:25.887402    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875c3113_55a8_4b3b_8cac_3fafbdae35be.slice/crio-92a2ee352a8dbc5cf0aa8923fe49869bd1fe439b495f03632d9dd3018634fd26 WatchSource:0}: Error finding container 92a2ee352a8dbc5cf0aa8923fe49869bd1fe439b495f03632d9dd3018634fd26: Status 404 returned error can't find the container with id 92a2ee352a8dbc5cf0aa8923fe49869bd1fe439b495f03632d9dd3018634fd26
Sep 11 21:17:25.888409 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:25.888089    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5070b1d6_abf9_462c_b660_e9782f95bc35.slice/crio-25c99038d414dc275aabe9868e029966eb4f4777aef3e974473a5020bf145b68 WatchSource:0}: Error finding container 25c99038d414dc275aabe9868e029966eb4f4777aef3e974473a5020bf145b68: Status 404 returned error can't find the container with id 25c99038d414dc275aabe9868e029966eb4f4777aef3e974473a5020bf145b68
Sep 11 21:17:25.892907 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:25.892881    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499f9938_d0b5_4119_b7fb_543980707fe5.slice/crio-6a495daadb6d26f3bc32651c31ed8828e53d07645a43df10cbb4d468b98a6039 WatchSource:0}: Error finding container 6a495daadb6d26f3bc32651c31ed8828e53d07645a43df10cbb4d468b98a6039: Status 404 returned error can't find the container with id 6a495daadb6d26f3bc32651c31ed8828e53d07645a43df10cbb4d468b98a6039
Sep 11 21:17:25.910978 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:25.895003    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8cb38b_3b0c_48a8_ae62_dfb4bc44ef24.slice/crio-43ca21b28e8d6e29681a554f921d349ea1ba9b79b6b07e6dbf55f31ebe89f7eb WatchSource:0}: Error finding container 43ca21b28e8d6e29681a554f921d349ea1ba9b79b6b07e6dbf55f31ebe89f7eb: Status 404 returned error can't find the container with id 43ca21b28e8d6e29681a554f921d349ea1ba9b79b6b07e6dbf55f31ebe89f7eb
Sep 11 21:17:25.910978 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:25.897230    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bcbacb0_e371_4960_b618_9b05daf4fdcf.slice/crio-3c6a5cea73d13ede9599e8c3d12c75b61b06720422a30817c3866cc1504bd636 WatchSource:0}: Error finding container 3c6a5cea73d13ede9599e8c3d12c75b61b06720422a30817c3866cc1504bd636: Status 404 returned error can't find the container with id 3c6a5cea73d13ede9599e8c3d12c75b61b06720422a30817c3866cc1504bd636
Sep 11 21:17:26.389474 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.389376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:26.389474 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.389463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:26.389697 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.389625    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:26.389697 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.389694    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret podName:dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:28.389674439 +0000 UTC m=+6.102334483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret") pod "global-pull-secret-syncer-whrjq" (UID: "dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:26.390145 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.390124    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:26.390243 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.390186    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs podName:9d7777e2-d273-45bf-9271-65051bab4142 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:28.390168014 +0000 UTC m=+6.102828048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs") pod "network-metrics-daemon-mldrg" (UID: "9d7777e2-d273-45bf-9271-65051bab4142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:26.490451 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.490379    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:26.490644 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.490552    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:26.490644 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.490573    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:26.490644 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.490586    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mgmth for pod openshift-network-diagnostics/network-check-target-dtqb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:26.490804 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.490649    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth podName:9dc4d446-45ad-4b42-953c-b5a7cdeda14a nodeName:}" failed. No retries permitted until 2026-09-11 21:17:28.49062952 +0000 UTC m=+6.203289566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mgmth" (UniqueName: "kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth") pod "network-check-target-dtqb6" (UID: "9dc4d446-45ad-4b42-953c-b5a7cdeda14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:26.706510 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.706364    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:12:25 +0000 UTC" deadline="2028-06-12 09:54:56.382509354 +0000 UTC"
Sep 11 21:17:26.706510 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.706427    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15348h37m29.676087054s"
Sep 11 21:17:26.796725 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.796026    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:26.796725 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.796162    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:26.796725 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.796573    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:26.796725 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.796670    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:26.797351 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.797202    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:26.797351 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:26.797316    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:26.812487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.811800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal" event={"ID":"b773acae9b26ce935d4f41dd9b33839a","Type":"ContainerStarted","Data":"bd6454052affa39033a7f594b357888f339afb6b645c482a532cf9893ee8a15e"}
Sep 11 21:17:26.839830 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.839792    2560 generic.go:356] "Generic (PLEG): container finished" podID="5ed1bbad54a404e12fdf4825da01afdc" containerID="102f59b55dafcd16e8507ecbc13aa6e0b7b6c7f55c0fb73545d88eca93d25eaf" exitCode=0
Sep 11 21:17:26.840001 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.839915    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal" event={"ID":"5ed1bbad54a404e12fdf4825da01afdc","Type":"ContainerDied","Data":"102f59b55dafcd16e8507ecbc13aa6e0b7b6c7f55c0fb73545d88eca93d25eaf"}
Sep 11 21:17:26.856366 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.856334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk" event={"ID":"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24","Type":"ContainerStarted","Data":"43ca21b28e8d6e29681a554f921d349ea1ba9b79b6b07e6dbf55f31ebe89f7eb"}
Sep 11 21:17:26.863201 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.860529    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal" podStartSLOduration=2.860509413 podStartE2EDuration="2.860509413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:26.82967558 +0000 UTC m=+4.542335633" watchObservedRunningTime="2026-09-11 21:17:26.860509413 +0000 UTC m=+4.573169490"
Sep 11 21:17:26.889542 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.889384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" event={"ID":"459a4133-e123-4a72-af54-1f7205936578","Type":"ContainerStarted","Data":"5194fa39bb48e8bb3bb6852667a74bb430050164308f6e3c7a87e176bb386c13"}
Sep 11 21:17:26.900327 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.900280    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4zhgf" event={"ID":"507f3ca7-2dc6-4c08-861f-95658fe612b7","Type":"ContainerStarted","Data":"41d10316888a1fbde8a2cef53ef4df78ecc6bb80ce0e98959ad632617488c57d"}
Sep 11 21:17:26.915034 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.912344    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qkfqp" event={"ID":"8bcbacb0-e371-4960-b618-9b05daf4fdcf","Type":"ContainerStarted","Data":"3c6a5cea73d13ede9599e8c3d12c75b61b06720422a30817c3866cc1504bd636"}
Sep 11 21:17:26.922591 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.922556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-225cz" event={"ID":"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf","Type":"ContainerStarted","Data":"4fe4116d43fbf617779609efef7767517205891c49c5f1b992ebe6f792e6283c"}
Sep 11 21:17:26.937945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.937858    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hq5zs" event={"ID":"499f9938-d0b5-4119-b7fb-543980707fe5","Type":"ContainerStarted","Data":"6a495daadb6d26f3bc32651c31ed8828e53d07645a43df10cbb4d468b98a6039"}
Sep 11 21:17:26.957350 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.956959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gcfz6" event={"ID":"5070b1d6-abf9-462c-b660-e9782f95bc35","Type":"ContainerStarted","Data":"25c99038d414dc275aabe9868e029966eb4f4777aef3e974473a5020bf145b68"}
Sep 11 21:17:26.969612 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.969573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2vqks" event={"ID":"875c3113-55a8-4b3b-8cac-3fafbdae35be","Type":"ContainerStarted","Data":"92a2ee352a8dbc5cf0aa8923fe49869bd1fe439b495f03632d9dd3018634fd26"}
Sep 11 21:17:26.977327 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:26.977273    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lr2nj" event={"ID":"3e7d3f47-930d-4f95-9876-9d672acd1f17","Type":"ContainerStarted","Data":"836bd43951ffff7efd560e51b01a3b81e2f86189d2ceda62c01f275e2c71abf2"}
Sep 11 21:17:27.993840 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:27.993768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal" event={"ID":"5ed1bbad54a404e12fdf4825da01afdc","Type":"ContainerStarted","Data":"f42087fa5338a78d7d823f76cc0b076e1acb0dcae1266e6b303a3c29044ae9ab"}
Sep 11 21:17:28.409169 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:28.408240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:28.409169 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:28.408391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:28.409169 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.408537    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:28.409169 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.408612    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs podName:9d7777e2-d273-45bf-9271-65051bab4142 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:32.408590469 +0000 UTC m=+10.121250511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs") pod "network-metrics-daemon-mldrg" (UID: "9d7777e2-d273-45bf-9271-65051bab4142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:28.409169 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.409063    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:28.409169 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.409123    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret podName:dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:32.409104828 +0000 UTC m=+10.121764860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret") pod "global-pull-secret-syncer-whrjq" (UID: "dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:28.510319 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:28.509605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:28.510319 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.509795    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:28.510319 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.509816    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:28.510319 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.509844    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mgmth for pod openshift-network-diagnostics/network-check-target-dtqb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:28.510319 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.509931    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth podName:9dc4d446-45ad-4b42-953c-b5a7cdeda14a nodeName:}" failed. No retries permitted until 2026-09-11 21:17:32.509907748 +0000 UTC m=+10.222567798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mgmth" (UniqueName: "kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth") pod "network-check-target-dtqb6" (UID: "9dc4d446-45ad-4b42-953c-b5a7cdeda14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:28.804379 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:28.800417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:28.804379 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:28.800473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:28.804379 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:28.800430    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:28.804379 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.800608    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:28.804379 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.800717    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:28.804379 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:28.800911    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:30.797770 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:30.797728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:30.798328 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:30.797883    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:30.798328 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:30.798309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:30.798455 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:30.798401    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:30.798455 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:30.798453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:30.798566 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:30.798535    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:32.442252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:32.441982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:32.442736 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:32.442317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:32.442736 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.442161    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:32.442736 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.442417    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:32.442736 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.442423    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret podName:dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:40.44240175 +0000 UTC m=+18.155061782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret") pod "global-pull-secret-syncer-whrjq" (UID: "dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:32.442736 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.442482    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs podName:9d7777e2-d273-45bf-9271-65051bab4142 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:40.442468267 +0000 UTC m=+18.155128310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs") pod "network-metrics-daemon-mldrg" (UID: "9d7777e2-d273-45bf-9271-65051bab4142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:32.543127 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:32.543084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:32.543362 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.543340    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:32.543453 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.543370    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:32.543453 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.543383    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mgmth for pod openshift-network-diagnostics/network-check-target-dtqb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:32.543453 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.543448    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth podName:9dc4d446-45ad-4b42-953c-b5a7cdeda14a nodeName:}" failed. No retries permitted until 2026-09-11 21:17:40.543426893 +0000 UTC m=+18.256086945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mgmth" (UniqueName: "kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth") pod "network-check-target-dtqb6" (UID: "9dc4d446-45ad-4b42-953c-b5a7cdeda14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:32.799129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:32.798281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:32.799129 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.798399    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:32.799129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:32.798772    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:32.799129 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.798859    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:32.799129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:32.798916    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:32.799129 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:32.799005    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:34.795664 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:34.795624    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:34.795664 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:34.795648    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:34.796188 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:34.795767    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:34.796188 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:34.795842    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:34.796188 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:34.795904    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:34.796188 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:34.795988    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:36.795185 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:36.795149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:36.795185 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:36.795191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:36.795729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:36.795269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:36.795729 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:36.795285    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:36.795729 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:36.795372    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:36.795729 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:36.795454    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:38.795342 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:38.795298    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:38.795754 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:38.795359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:38.795754 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:38.795298    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:38.795754 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:38.795453    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:38.795754 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:38.795550    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:38.795754 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:38.795639    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:40.502254 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:40.502220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:40.502756 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:40.502282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:40.502756 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.502399    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:40.502756 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.502401    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:40.502756 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.502456    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret podName:dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:56.502440116 +0000 UTC m=+34.215100142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret") pod "global-pull-secret-syncer-whrjq" (UID: "dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:40.502756 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.502472    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs podName:9d7777e2-d273-45bf-9271-65051bab4142 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:56.502465839 +0000 UTC m=+34.215125867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs") pod "network-metrics-daemon-mldrg" (UID: "9d7777e2-d273-45bf-9271-65051bab4142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:40.602616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:40.602581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:40.602793 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.602751    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:40.602793 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.602772    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:40.602793 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.602784    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mgmth for pod openshift-network-diagnostics/network-check-target-dtqb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:40.602960 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.602859    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth podName:9dc4d446-45ad-4b42-953c-b5a7cdeda14a nodeName:}" failed. No retries permitted until 2026-09-11 21:17:56.602842995 +0000 UTC m=+34.315503027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mgmth" (UniqueName: "kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth") pod "network-check-target-dtqb6" (UID: "9dc4d446-45ad-4b42-953c-b5a7cdeda14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:40.795509 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:40.795426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:40.795509 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:40.795464    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:40.795735 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.795549    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:40.795735 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:40.795426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:40.795735 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.795659    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:40.795925 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:40.795758    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:42.795569 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:42.795530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:42.796014 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:42.795646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:42.796014 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:42.795650    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:42.796014 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:42.795778    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:42.796014 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:42.795815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:42.796014 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:42.795899    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:44.798606 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:44.798111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:44.798606 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:44.798216    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:44.798606 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:44.798122    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:44.798606 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:44.798253    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:44.798606 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:44.798308    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:44.798606 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:44.798575    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:45.027672 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.027411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk" event={"ID":"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24","Type":"ContainerStarted","Data":"1c9af74fc0461ff832ebf2a76f0249015297776dc51448515d063c396d54a4cf"}
Sep 11 21:17:45.031895 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.031864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" event={"ID":"459a4133-e123-4a72-af54-1f7205936578","Type":"ContainerStarted","Data":"67937991b9227887515cd6931fe5e2925046e43e686fbca8c9281ae33e38843f"}
Sep 11 21:17:45.032011 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.031964    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" event={"ID":"459a4133-e123-4a72-af54-1f7205936578","Type":"ContainerStarted","Data":"5761b63023f54eafc4522c95a08027207c8cd3cbe6788c414eedc15613063a5b"}
Sep 11 21:17:45.032072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.032010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" event={"ID":"459a4133-e123-4a72-af54-1f7205936578","Type":"ContainerStarted","Data":"e00d72a05788d3e32cce709b45273062ae7bb26d8af6ef50bacd8579cd01f6ef"}
Sep 11 21:17:45.033885 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.033853    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qkfqp" event={"ID":"8bcbacb0-e371-4960-b618-9b05daf4fdcf","Type":"ContainerStarted","Data":"09159965d296a492217c5fd6356ca68f2a8f92f922afedcaa6c4c8634ded2fc4"}
Sep 11 21:17:45.035691 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.035655    2560 generic.go:356] "Generic (PLEG): container finished" podID="17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf" containerID="c35e4812df6fdb589286926d65bfc3125a37709ebcfafbd7b1e99baf68f2fe1c" exitCode=0
Sep 11 21:17:45.035796 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.035759    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-225cz" event={"ID":"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf","Type":"ContainerDied","Data":"c35e4812df6fdb589286926d65bfc3125a37709ebcfafbd7b1e99baf68f2fe1c"}
Sep 11 21:17:45.038090 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.037918    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hq5zs" event={"ID":"499f9938-d0b5-4119-b7fb-543980707fe5","Type":"ContainerStarted","Data":"5922c5ca742ad209ec23f3cf8e2bbd5ab0994a7f4366c8edc21402b87ee179be"}
Sep 11 21:17:45.039579 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.039553    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gcfz6" event={"ID":"5070b1d6-abf9-462c-b660-e9782f95bc35","Type":"ContainerStarted","Data":"947ce8d8078c579ffbcc18345cabe4f8e534dc65edd45e3db2e0b83da97fbc0b"}
Sep 11 21:17:45.041140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.041123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2vqks" event={"ID":"875c3113-55a8-4b3b-8cac-3fafbdae35be","Type":"ContainerStarted","Data":"f0aa1239c1ca1c9738c01969d0fdf5e813210d7832cd3a4ca712a968c5c405d4"}
Sep 11 21:17:45.042622 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.042603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lr2nj" event={"ID":"3e7d3f47-930d-4f95-9876-9d672acd1f17","Type":"ContainerStarted","Data":"009e280a89cf191d8293203bf0e78d830f8f294ed9746cf8ed926be34e9a6d74"}
Sep 11 21:17:45.049052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.048986    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal" podStartSLOduration=21.048969974 podStartE2EDuration="21.048969974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:28.012776891 +0000 UTC m=+5.725436944" watchObservedRunningTime="2026-09-11 21:17:45.048969974 +0000 UTC m=+22.761630025"
Sep 11 21:17:45.049676 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.049624    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qkfqp" podStartSLOduration=3.305871431 podStartE2EDuration="22.04961309s" totalImagesPullingTime="18.743741659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:45.048739093 +0000 UTC m=+22.761399142" watchObservedRunningTime="2026-09-11 21:17:45.04961309 +0000 UTC m=+22.762273140"
Sep 11 21:17:45.065295 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.065257    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gcfz6" podStartSLOduration=7.004439116 podStartE2EDuration="22.065243218s" totalImagesPullingTime="15.060804102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:45.065040708 +0000 UTC m=+22.777700756" watchObservedRunningTime="2026-09-11 21:17:45.065243218 +0000 UTC m=+22.777903268"
Sep 11 21:17:45.082882 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.082158    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lr2nj" podStartSLOduration=3.314121435 podStartE2EDuration="22.082140249s" totalImagesPullingTime="18.768018814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:45.081351033 +0000 UTC m=+22.794011085" watchObservedRunningTime="2026-09-11 21:17:45.082140249 +0000 UTC m=+22.794800299"
Sep 11 21:17:45.084720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.083612    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:45.102732 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.102685    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2vqks" podStartSLOduration=3.310239011 podStartE2EDuration="22.102671107s" totalImagesPullingTime="18.792432096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:45.102448752 +0000 UTC m=+22.815108801" watchObservedRunningTime="2026-09-11 21:17:45.102671107 +0000 UTC m=+22.815331153"
Sep 11 21:17:45.121138 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:45.121094    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hq5zs" podStartSLOduration=3.307627004 podStartE2EDuration="22.12107689s" totalImagesPullingTime="18.813449886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:45.120591268 +0000 UTC m=+22.833251316" watchObservedRunningTime="2026-09-11 21:17:45.12107689 +0000 UTC m=+22.833736940"
Sep 11 21:17:46.048092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.048048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" event={"ID":"459a4133-e123-4a72-af54-1f7205936578","Type":"ContainerStarted","Data":"1fa79f9009cc5ada3cd4dbe53bebab1436e63f7278e72fd44c29ecd76f4b13c3"}
Sep 11 21:17:46.048886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.048149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" event={"ID":"459a4133-e123-4a72-af54-1f7205936578","Type":"ContainerStarted","Data":"3f576e07b8564c65b54df5057ceea09d05c66b4031f831fd131d1f9baff63a6b"}
Sep 11 21:17:46.048886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.048194    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" event={"ID":"459a4133-e123-4a72-af54-1f7205936578","Type":"ContainerStarted","Data":"4177749ba2f371e4605a83781187627ea4bc5509c2f93afb8c4e5dc968762a79"}
Sep 11 21:17:46.170920 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.170705    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 21:17:46.725840 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.725707    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T21:17:46.170915914Z","UUID":"239fd3f4-dc7f-4712-b36f-0bb32af7c961","Handler":null,"Name":"","Endpoint":""}
Sep 11 21:17:46.727472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.727452    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 21:17:46.727590 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.727483    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 21:17:46.794914 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.794887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:46.795100 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.794887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:46.795100 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:46.795040    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:46.795221 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:46.795148    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:46.795221 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:46.795204    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:46.795321 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:46.795256    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:47.053592 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:47.053506    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk" event={"ID":"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24","Type":"ContainerStarted","Data":"7153e0464c9062f9975bd7758a5c3d55e31573b213a11f1be27ec0665dd1e0b2"}
Sep 11 21:17:47.055228 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:47.055198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4zhgf" event={"ID":"507f3ca7-2dc6-4c08-861f-95658fe612b7","Type":"ContainerStarted","Data":"552b6ab6fdd06736ae434643d929d1ec6478948d874f0271e9b38dab302c85b9"}
Sep 11 21:17:48.060475 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:48.060442    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk" event={"ID":"fc8cb38b-3b0c-48a8-ae62-dfb4bc44ef24","Type":"ContainerStarted","Data":"ef124361a833f29f3faeda85e8420a5f68c6b04b26ce299ffc78a2c41f11949b"}
Sep 11 21:17:48.064507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:48.064441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" event={"ID":"459a4133-e123-4a72-af54-1f7205936578","Type":"ContainerStarted","Data":"a152ef9bb33ea733bad426b88c085087352d1bfd5eaf458d24a3f1e764ead7d4"}
Sep 11 21:17:48.106009 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:48.105945    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-564nk" podStartSLOduration=4.238025169 podStartE2EDuration="25.105921952s" totalImagesPullingTime="20.867896783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:48.105244936 +0000 UTC m=+25.817904986" watchObservedRunningTime="2026-09-11 21:17:48.105921952 +0000 UTC m=+25.818582003"
Sep 11 21:17:48.106353 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:48.106326    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4zhgf" podStartSLOduration=6.363155997 podStartE2EDuration="25.10631671s" totalImagesPullingTime="18.743160713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:47.074477774 +0000 UTC m=+24.787137823" watchObservedRunningTime="2026-09-11 21:17:48.10631671 +0000 UTC m=+25.818976764"
Sep 11 21:17:48.643690 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:48.643653    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:48.644373 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:48.644350    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:48.795778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:48.795745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:48.795955 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:48.795745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:48.795955 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:48.795886    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:48.795955 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:48.795906    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:48.796104 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:48.796031    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:48.796143 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:48.796121    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:49.067674 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:49.067642    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gcfz6"
Sep 11 21:17:50.073091 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.072915    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" event={"ID":"459a4133-e123-4a72-af54-1f7205936578","Type":"ContainerStarted","Data":"54ba903299376a44f348461da05519f89274a260c9b0a2d34e75e235f1b8758c"}
Sep 11 21:17:50.073405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.073170    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:50.073405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.073225    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:50.075439 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.075411    2560 generic.go:356] "Generic (PLEG): container finished" podID="17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf" containerID="18fd3f4788ee1aab74286ccae0357035db57948bcdec1f2531f5e8ff1dbed03a" exitCode=0
Sep 11 21:17:50.075533 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.075489    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-225cz" event={"ID":"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf","Type":"ContainerDied","Data":"18fd3f4788ee1aab74286ccae0357035db57948bcdec1f2531f5e8ff1dbed03a"}
Sep 11 21:17:50.088982 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.088961    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:50.089111 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.089097    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:50.104588 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.104543    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" podStartSLOduration=8.307558033 podStartE2EDuration="27.104530257s" totalImagesPullingTime="18.796972224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:50.104009875 +0000 UTC m=+27.816669924" watchObservedRunningTime="2026-09-11 21:17:50.104530257 +0000 UTC m=+27.817190305"
Sep 11 21:17:50.795113 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.795085    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:50.795309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.795085    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:50.795309 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:50.795181    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:50.795309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:50.795219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:50.795427 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:50.795326    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:50.795463 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:50.795439    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:51.078090 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:51.078065    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 21:17:51.537599 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:51.537391    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whrjq"]
Sep 11 21:17:51.537770 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:51.537677    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:51.537838 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:51.537765    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:51.541285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:51.541260    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dtqb6"]
Sep 11 21:17:51.541443 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:51.541344    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:51.541443 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:51.541426    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:51.541799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:51.541776    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mldrg"]
Sep 11 21:17:51.541919 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:51.541886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:51.541996 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:51.541971    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:52.082586 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:52.082549    2560 generic.go:356] "Generic (PLEG): container finished" podID="17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf" containerID="d8f33356c03d4f0f803a7ee4c4ec40507d3aa236a31d9c9892e2bd2db41939b0" exitCode=0
Sep 11 21:17:52.083106 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:52.082605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-225cz" event={"ID":"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf","Type":"ContainerDied","Data":"d8f33356c03d4f0f803a7ee4c4ec40507d3aa236a31d9c9892e2bd2db41939b0"}
Sep 11 21:17:52.083106 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:52.082731    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 21:17:52.796210 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:52.796174    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:52.796385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:52.796272    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:52.796385 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:52.796269    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:52.796385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:52.796335    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:52.796553 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:52.796447    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:52.796553 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:52.796512    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:54.090026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:54.089998    2560 generic.go:356] "Generic (PLEG): container finished" podID="17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf" containerID="149d9d5a8528ba1d02182dc73fe497d46eac496156b6ab76297a46b730deb608" exitCode=0
Sep 11 21:17:54.090350 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:54.090046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-225cz" event={"ID":"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf","Type":"ContainerDied","Data":"149d9d5a8528ba1d02182dc73fe497d46eac496156b6ab76297a46b730deb608"}
Sep 11 21:17:54.621465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:54.621420    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:17:54.621700 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:54.621682    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 21:17:54.634327 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:54.634283    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" podUID="459a4133-e123-4a72-af54-1f7205936578" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 11 21:17:54.644817 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:54.644789    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj" podUID="459a4133-e123-4a72-af54-1f7205936578" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 11 21:17:54.794961 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:54.794927    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:54.795122 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:54.794929    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:54.795122 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:54.795061    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:54.795225 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:54.795137    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:54.795225 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:54.794942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:54.795311 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:54.795238    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:56.516905 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:56.516864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:56.517388 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:56.516942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:56.517388 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.517008    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:56.517388 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.517063    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:56.517388 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.517085    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret podName:dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:28.517065017 +0000 UTC m=+66.229725056 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret") pod "global-pull-secret-syncer-whrjq" (UID: "dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:56.517388 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.517112    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs podName:9d7777e2-d273-45bf-9271-65051bab4142 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:28.517096228 +0000 UTC m=+66.229756270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs") pod "network-metrics-daemon-mldrg" (UID: "9d7777e2-d273-45bf-9271-65051bab4142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:56.618318 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:56.618274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:56.618517 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.618442    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:56.618517 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.618464    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:56.618517 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.618477    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mgmth for pod openshift-network-diagnostics/network-check-target-dtqb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:56.618668 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.618543    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth podName:9dc4d446-45ad-4b42-953c-b5a7cdeda14a nodeName:}" failed. No retries permitted until 2026-09-11 21:18:28.618524667 +0000 UTC m=+66.331184709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mgmth" (UniqueName: "kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth") pod "network-check-target-dtqb6" (UID: "9dc4d446-45ad-4b42-953c-b5a7cdeda14a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:56.795127 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:56.795048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:56.795127 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:56.795072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:56.795447 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:56.795048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:56.795447 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.795188    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whrjq" podUID="dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8"
Sep 11 21:17:56.795447 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.795255    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dtqb6" podUID="9dc4d446-45ad-4b42-953c-b5a7cdeda14a"
Sep 11 21:17:56.795447 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:56.795330    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mldrg" podUID="9d7777e2-d273-45bf-9271-65051bab4142"
Sep 11 21:17:57.583464 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.583433    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeReady"
Sep 11 21:17:57.584005 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.583590    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 21:17:57.627563 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.627532    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9dfl7"]
Sep 11 21:17:57.632670 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.632635    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hv7xh"]
Sep 11 21:17:57.632800 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.632757    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.635294 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.635258    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hdgmr\""
Sep 11 21:17:57.635448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.635428    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 21:17:57.635596 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.635580    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 21:17:57.637028 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.636706    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hv7xh"
Sep 11 21:17:57.638866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.638845    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 21:17:57.638982 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.638857    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 21:17:57.639175 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.639146    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 21:17:57.639512 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.639493    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ld6cs\""
Sep 11 21:17:57.641930 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.641905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9dfl7"]
Sep 11 21:17:57.644086 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.644033    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hv7xh"]
Sep 11 21:17:57.727476 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.727446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.727476 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.727479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f36bed74-6b22-4866-92d5-8fd4bda70bfd-cert\") pod \"ingress-canary-hv7xh\" (UID: \"f36bed74-6b22-4866-92d5-8fd4bda70bfd\") " pod="openshift-ingress-canary/ingress-canary-hv7xh"
Sep 11 21:17:57.727697 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.727504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-config-volume\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.727697 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.727548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krbmq\" (UniqueName: \"kubernetes.io/projected/f36bed74-6b22-4866-92d5-8fd4bda70bfd-kube-api-access-krbmq\") pod \"ingress-canary-hv7xh\" (UID: \"f36bed74-6b22-4866-92d5-8fd4bda70bfd\") " pod="openshift-ingress-canary/ingress-canary-hv7xh"
Sep 11 21:17:57.727697 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.727675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zjs9\" (UniqueName: \"kubernetes.io/projected/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-kube-api-access-8zjs9\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.727867 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.727775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-tmp-dir\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.828775 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.828746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-tmp-dir\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.828983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.828778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.828983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.828865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f36bed74-6b22-4866-92d5-8fd4bda70bfd-cert\") pod \"ingress-canary-hv7xh\" (UID: \"f36bed74-6b22-4866-92d5-8fd4bda70bfd\") " pod="openshift-ingress-canary/ingress-canary-hv7xh"
Sep 11 21:17:57.828983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.828888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-config-volume\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.828983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.828942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krbmq\" (UniqueName: \"kubernetes.io/projected/f36bed74-6b22-4866-92d5-8fd4bda70bfd-kube-api-access-krbmq\") pod \"ingress-canary-hv7xh\" (UID: \"f36bed74-6b22-4866-92d5-8fd4bda70bfd\") " pod="openshift-ingress-canary/ingress-canary-hv7xh"
Sep 11 21:17:57.829181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.828983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zjs9\" (UniqueName: \"kubernetes.io/projected/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-kube-api-access-8zjs9\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.829181 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:57.828987    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:17:57.829181 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:57.829096    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls podName:0e67c3c0-b167-4c88-add1-1a8fbe2d2845 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:58.329076396 +0000 UTC m=+36.041736443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls") pod "dns-default-9dfl7" (UID: "0e67c3c0-b167-4c88-add1-1a8fbe2d2845") : secret "dns-default-metrics-tls" not found
Sep 11 21:17:57.829325 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.829176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-tmp-dir\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.829564 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.829545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-config-volume\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.833610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.833561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f36bed74-6b22-4866-92d5-8fd4bda70bfd-cert\") pod \"ingress-canary-hv7xh\" (UID: \"f36bed74-6b22-4866-92d5-8fd4bda70bfd\") " pod="openshift-ingress-canary/ingress-canary-hv7xh"
Sep 11 21:17:57.840074 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.840055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zjs9\" (UniqueName: \"kubernetes.io/projected/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-kube-api-access-8zjs9\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:57.840279 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.840261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krbmq\" (UniqueName: \"kubernetes.io/projected/f36bed74-6b22-4866-92d5-8fd4bda70bfd-kube-api-access-krbmq\") pod \"ingress-canary-hv7xh\" (UID: \"f36bed74-6b22-4866-92d5-8fd4bda70bfd\") " pod="openshift-ingress-canary/ingress-canary-hv7xh"
Sep 11 21:17:57.957683 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:57.957646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hv7xh"
Sep 11 21:17:58.333622 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.333582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:58.333814 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:58.333734    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:17:58.333906 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:58.333813    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls podName:0e67c3c0-b167-4c88-add1-1a8fbe2d2845 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:59.333796538 +0000 UTC m=+37.046456569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls") pod "dns-default-9dfl7" (UID: "0e67c3c0-b167-4c88-add1-1a8fbe2d2845") : secret "dns-default-metrics-tls" not found
Sep 11 21:17:58.700148 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.700121    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hv7xh"]
Sep 11 21:17:58.717639 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:17:58.717605    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36bed74_6b22_4866_92d5_8fd4bda70bfd.slice/crio-503ecdcc8ee52b6a5180272c1ecf189e63f34e8782ecc29769221c1e0fbaa4d4 WatchSource:0}: Error finding container 503ecdcc8ee52b6a5180272c1ecf189e63f34e8782ecc29769221c1e0fbaa4d4: Status 404 returned error can't find the container with id 503ecdcc8ee52b6a5180272c1ecf189e63f34e8782ecc29769221c1e0fbaa4d4
Sep 11 21:17:58.797863 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.797838    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:17:58.797863 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.797854    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:17:58.798012 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.797838    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:17:58.801244 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.801227    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:17:58.801348 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.801270    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vqqz8\""
Sep 11 21:17:58.801348 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.801328    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:17:58.801477 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.801462    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 21:17:58.801477 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.801474    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vp72k\""
Sep 11 21:17:58.801559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:58.801515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 21:17:59.105246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.105217    2560 generic.go:356] "Generic (PLEG): container finished" podID="17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf" containerID="0a348be9f3667d0b88d7bbdf26b45997e85b762a78332b65c2a863bfd220354f" exitCode=0
Sep 11 21:17:59.105432 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.105290    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-225cz" event={"ID":"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf","Type":"ContainerDied","Data":"0a348be9f3667d0b88d7bbdf26b45997e85b762a78332b65c2a863bfd220354f"}
Sep 11 21:17:59.106589 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.106567    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hv7xh" event={"ID":"f36bed74-6b22-4866-92d5-8fd4bda70bfd","Type":"ContainerStarted","Data":"503ecdcc8ee52b6a5180272c1ecf189e63f34e8782ecc29769221c1e0fbaa4d4"}
Sep 11 21:17:59.342976 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.342946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:17:59.343134 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:59.343064    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:17:59.343185 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:17:59.343141    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls podName:0e67c3c0-b167-4c88-add1-1a8fbe2d2845 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:01.34312256 +0000 UTC m=+39.055782592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls") pod "dns-default-9dfl7" (UID: "0e67c3c0-b167-4c88-add1-1a8fbe2d2845") : secret "dns-default-metrics-tls" not found
Sep 11 21:17:59.607642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.607611    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"]
Sep 11 21:17:59.610637 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.610614    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.613403 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.613372    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:17:59.613667 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.613648    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 21:17:59.613817 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.613801    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 21:17:59.613988 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.613842    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7wbmz\""
Sep 11 21:17:59.614080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.614066    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 21:17:59.618618 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.618351    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"]
Sep 11 21:17:59.706315 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.706286    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"]
Sep 11 21:17:59.709489 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.709463    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.712062 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.712039    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 21:17:59.712227 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.712178    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 21:17:59.712320 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.712229    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kkrgk\""
Sep 11 21:17:59.712524 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.712504    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:17:59.712618 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.712555    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 21:17:59.718508 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.718486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"]
Sep 11 21:17:59.725507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.725333    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-tzww9"]
Sep 11 21:17:59.728698 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.728678    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.731189 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.731168    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dxlmr\""
Sep 11 21:17:59.731279 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.731255    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 21:17:59.731393 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.731377    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 21:17:59.731452 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.731391    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 21:17:59.733190 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.733170    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 21:17:59.737392 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.737367    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 21:17:59.741048 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.741030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-tzww9"]
Sep 11 21:17:59.746099 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.746078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb9db64c-af22-4710-8074-5af2ac0687d3-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-gd94x\" (UID: \"eb9db64c-af22-4710-8074-5af2ac0687d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.746187 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.746107    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwmbh\" (UniqueName: \"kubernetes.io/projected/eb9db64c-af22-4710-8074-5af2ac0687d3-kube-api-access-mwmbh\") pod \"kube-storage-version-migrator-operator-6c8f84f897-gd94x\" (UID: \"eb9db64c-af22-4710-8074-5af2ac0687d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.746187 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.746141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb9db64c-af22-4710-8074-5af2ac0687d3-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-gd94x\" (UID: \"eb9db64c-af22-4710-8074-5af2ac0687d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.815761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.815727    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c84486586-ftqpb"]
Sep 11 21:17:59.820760 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.820733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:17:59.823285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.823255    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 21:17:59.823437 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.823283    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 21:17:59.823437 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.823312    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h6nq6\""
Sep 11 21:17:59.823594 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.823566    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 21:17:59.823768 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.823747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 21:17:59.824141 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.824123    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 21:17:59.824244 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.824175    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 21:17:59.835294 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.835269    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c84486586-ftqpb"]
Sep 11 21:17:59.846489 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846467    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/029205bf-1e5e-4119-8a62-bb2640d621fb-serving-cert\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.846593 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl5k8\" (UniqueName: \"kubernetes.io/projected/0f29fd09-7f3a-434f-965e-71d5dabfdcf6-kube-api-access-pl5k8\") pod \"service-ca-operator-cf7c776b7-bwxsl\" (UID: \"0f29fd09-7f3a-434f-965e-71d5dabfdcf6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.846593 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/029205bf-1e5e-4119-8a62-bb2640d621fb-snapshots\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.846693 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/029205bf-1e5e-4119-8a62-bb2640d621fb-tmp\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.846731 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb9db64c-af22-4710-8074-5af2ac0687d3-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-gd94x\" (UID: \"eb9db64c-af22-4710-8074-5af2ac0687d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.846731 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwmbh\" (UniqueName: \"kubernetes.io/projected/eb9db64c-af22-4710-8074-5af2ac0687d3-kube-api-access-mwmbh\") pod \"kube-storage-version-migrator-operator-6c8f84f897-gd94x\" (UID: \"eb9db64c-af22-4710-8074-5af2ac0687d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.846842 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846752    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb9db64c-af22-4710-8074-5af2ac0687d3-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-gd94x\" (UID: \"eb9db64c-af22-4710-8074-5af2ac0687d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.846842 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/029205bf-1e5e-4119-8a62-bb2640d621fb-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.846842 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtp84\" (UniqueName: \"kubernetes.io/projected/029205bf-1e5e-4119-8a62-bb2640d621fb-kube-api-access-vtp84\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.846985 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f29fd09-7f3a-434f-965e-71d5dabfdcf6-serving-cert\") pod \"service-ca-operator-cf7c776b7-bwxsl\" (UID: \"0f29fd09-7f3a-434f-965e-71d5dabfdcf6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.846985 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f29fd09-7f3a-434f-965e-71d5dabfdcf6-config\") pod \"service-ca-operator-cf7c776b7-bwxsl\" (UID: \"0f29fd09-7f3a-434f-965e-71d5dabfdcf6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.846985 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.846903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/029205bf-1e5e-4119-8a62-bb2640d621fb-service-ca-bundle\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.847423 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.847402    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb9db64c-af22-4710-8074-5af2ac0687d3-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-gd94x\" (UID: \"eb9db64c-af22-4710-8074-5af2ac0687d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.849717 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.849694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb9db64c-af22-4710-8074-5af2ac0687d3-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-gd94x\" (UID: \"eb9db64c-af22-4710-8074-5af2ac0687d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.858412 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.858367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwmbh\" (UniqueName: \"kubernetes.io/projected/eb9db64c-af22-4710-8074-5af2ac0687d3-kube-api-access-mwmbh\") pod \"kube-storage-version-migrator-operator-6c8f84f897-gd94x\" (UID: \"eb9db64c-af22-4710-8074-5af2ac0687d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.924885 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.924862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"
Sep 11 21:17:59.947980 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.947955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:17:59.948102 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.947990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:17:59.948102 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl5k8\" (UniqueName: \"kubernetes.io/projected/0f29fd09-7f3a-434f-965e-71d5dabfdcf6-kube-api-access-pl5k8\") pod \"service-ca-operator-cf7c776b7-bwxsl\" (UID: \"0f29fd09-7f3a-434f-965e-71d5dabfdcf6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.948102 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/029205bf-1e5e-4119-8a62-bb2640d621fb-snapshots\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.948102 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/029205bf-1e5e-4119-8a62-bb2640d621fb-tmp\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.948276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/029205bf-1e5e-4119-8a62-bb2640d621fb-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.948276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtp84\" (UniqueName: \"kubernetes.io/projected/029205bf-1e5e-4119-8a62-bb2640d621fb-kube-api-access-vtp84\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.948276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f29fd09-7f3a-434f-965e-71d5dabfdcf6-serving-cert\") pod \"service-ca-operator-cf7c776b7-bwxsl\" (UID: \"0f29fd09-7f3a-434f-965e-71d5dabfdcf6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.948276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f29fd09-7f3a-434f-965e-71d5dabfdcf6-config\") pod \"service-ca-operator-cf7c776b7-bwxsl\" (UID: \"0f29fd09-7f3a-434f-965e-71d5dabfdcf6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.948276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/029205bf-1e5e-4119-8a62-bb2640d621fb-service-ca-bundle\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.948276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-stats-auth\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:17:59.948276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7sxl\" (UniqueName: \"kubernetes.io/projected/f9438a19-93f7-48fd-9df3-c66553af78c5-kube-api-access-d7sxl\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:17:59.948276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/029205bf-1e5e-4119-8a62-bb2640d621fb-serving-cert\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.948276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.948254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-default-certificate\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:17:59.949113 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.949094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/029205bf-1e5e-4119-8a62-bb2640d621fb-snapshots\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.949318 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.949299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/029205bf-1e5e-4119-8a62-bb2640d621fb-tmp\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.950323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.950302    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/029205bf-1e5e-4119-8a62-bb2640d621fb-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.950850 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.950811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f29fd09-7f3a-434f-965e-71d5dabfdcf6-config\") pod \"service-ca-operator-cf7c776b7-bwxsl\" (UID: \"0f29fd09-7f3a-434f-965e-71d5dabfdcf6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.951389 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.951369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/029205bf-1e5e-4119-8a62-bb2640d621fb-service-ca-bundle\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.952776 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.952727    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f29fd09-7f3a-434f-965e-71d5dabfdcf6-serving-cert\") pod \"service-ca-operator-cf7c776b7-bwxsl\" (UID: \"0f29fd09-7f3a-434f-965e-71d5dabfdcf6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.954641 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.954594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/029205bf-1e5e-4119-8a62-bb2640d621fb-serving-cert\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:17:59.959794 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.959750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl5k8\" (UniqueName: \"kubernetes.io/projected/0f29fd09-7f3a-434f-965e-71d5dabfdcf6-kube-api-access-pl5k8\") pod \"service-ca-operator-cf7c776b7-bwxsl\" (UID: \"0f29fd09-7f3a-434f-965e-71d5dabfdcf6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:17:59.962364 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:17:59.962327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtp84\" (UniqueName: \"kubernetes.io/projected/029205bf-1e5e-4119-8a62-bb2640d621fb-kube-api-access-vtp84\") pod \"insights-operator-5844b856db-tzww9\" (UID: \"029205bf-1e5e-4119-8a62-bb2640d621fb\") " pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:18:00.019444 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.019412    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"
Sep 11 21:18:00.038638 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.038611    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-tzww9"
Sep 11 21:18:00.048956 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.048930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.049080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.048967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.049080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.049066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-stats-auth\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.049189 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.049094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7sxl\" (UniqueName: \"kubernetes.io/projected/f9438a19-93f7-48fd-9df3-c66553af78c5-kube-api-access-d7sxl\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.049189 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:00.049110    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:00.549089803 +0000 UTC m=+38.261749850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : configmap references non-existent config key: service-ca.crt
Sep 11 21:18:00.049189 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.049151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-default-certificate\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.049189 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:00.049172    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:18:00.049367 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:00.049231    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:00.549213484 +0000 UTC m=+38.261873531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : secret "router-metrics-certs-default" not found
Sep 11 21:18:00.051754 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.051735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-stats-auth\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.051754 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.051749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-default-certificate\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.059409 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.059388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7sxl\" (UniqueName: \"kubernetes.io/projected/f9438a19-93f7-48fd-9df3-c66553af78c5-kube-api-access-d7sxl\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.119026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.118047    2560 generic.go:356] "Generic (PLEG): container finished" podID="17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf" containerID="399200720a894251cf4b9a103b6c179e4a1f05b682e808aa4e4e72fbe7a39323" exitCode=0
Sep 11 21:18:00.119026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.118104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-225cz" event={"ID":"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf","Type":"ContainerDied","Data":"399200720a894251cf4b9a103b6c179e4a1f05b682e808aa4e4e72fbe7a39323"}
Sep 11 21:18:00.208071 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.208034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x"]
Sep 11 21:18:00.214949 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:00.214921    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9db64c_af22_4710_8074_5af2ac0687d3.slice/crio-55caceeef1919563bab600e9176c2dbf5544b805103ebf0e6239873d8c4d5022 WatchSource:0}: Error finding container 55caceeef1919563bab600e9176c2dbf5544b805103ebf0e6239873d8c4d5022: Status 404 returned error can't find the container with id 55caceeef1919563bab600e9176c2dbf5544b805103ebf0e6239873d8c4d5022
Sep 11 21:18:00.332158 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.332094    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl"]
Sep 11 21:18:00.376929 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.376816    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-tzww9"]
Sep 11 21:18:00.560742 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.560710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.560926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:00.560756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:00.560926 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:00.560907    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:18:00.561033 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:00.560932    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:01.560906584 +0000 UTC m=+39.273566616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : configmap references non-existent config key: service-ca.crt
Sep 11 21:18:00.561033 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:00.560968    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:01.560951527 +0000 UTC m=+39.273611577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : secret "router-metrics-certs-default" not found
Sep 11 21:18:01.101081 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:01.101037    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f29fd09_7f3a_434f_965e_71d5dabfdcf6.slice/crio-aaa6ccb16457db42bde02bb6546a35439a8a3dc0f6744ee23881dd958daed8cf WatchSource:0}: Error finding container aaa6ccb16457db42bde02bb6546a35439a8a3dc0f6744ee23881dd958daed8cf: Status 404 returned error can't find the container with id aaa6ccb16457db42bde02bb6546a35439a8a3dc0f6744ee23881dd958daed8cf
Sep 11 21:18:01.101626 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:01.101468    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029205bf_1e5e_4119_8a62_bb2640d621fb.slice/crio-c1e4910a406fc6811d485c2c3bc1839b7d347fb179e511ee1e493279914b35ad WatchSource:0}: Error finding container c1e4910a406fc6811d485c2c3bc1839b7d347fb179e511ee1e493279914b35ad: Status 404 returned error can't find the container with id c1e4910a406fc6811d485c2c3bc1839b7d347fb179e511ee1e493279914b35ad
Sep 11 21:18:01.123999 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:01.123960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-225cz" event={"ID":"17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf","Type":"ContainerStarted","Data":"0cdb69fbcae447ae868e46d0adaf97a9a9e770d467a8f778ceeae788396ef0ee"}
Sep 11 21:18:01.125218 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:01.125192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tzww9" event={"ID":"029205bf-1e5e-4119-8a62-bb2640d621fb","Type":"ContainerStarted","Data":"c1e4910a406fc6811d485c2c3bc1839b7d347fb179e511ee1e493279914b35ad"}
Sep 11 21:18:01.126359 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:01.126338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl" event={"ID":"0f29fd09-7f3a-434f-965e-71d5dabfdcf6","Type":"ContainerStarted","Data":"aaa6ccb16457db42bde02bb6546a35439a8a3dc0f6744ee23881dd958daed8cf"}
Sep 11 21:18:01.127430 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:01.127408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x" event={"ID":"eb9db64c-af22-4710-8074-5af2ac0687d3","Type":"ContainerStarted","Data":"55caceeef1919563bab600e9176c2dbf5544b805103ebf0e6239873d8c4d5022"}
Sep 11 21:18:01.148890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:01.148839    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-225cz" podStartSLOduration=8.111576913 podStartE2EDuration="38.14880357s" totalImagesPullingTime="30.037226657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:01.147964806 +0000 UTC m=+38.860624855" watchObservedRunningTime="2026-09-11 21:18:01.14880357 +0000 UTC m=+38.861463619"
Sep 11 21:18:01.367926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:01.367885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:18:01.368097 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:01.368024    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:18:01.368157 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:01.368101    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls podName:0e67c3c0-b167-4c88-add1-1a8fbe2d2845 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:05.368079079 +0000 UTC m=+43.080739108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls") pod "dns-default-9dfl7" (UID: "0e67c3c0-b167-4c88-add1-1a8fbe2d2845") : secret "dns-default-metrics-tls" not found
Sep 11 21:18:01.569364 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:01.569324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:01.569540 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:01.569384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:01.569540 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:01.569504    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:03.569477763 +0000 UTC m=+41.282137803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : configmap references non-existent config key: service-ca.crt
Sep 11 21:18:01.569540 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:01.569511    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:18:01.569705 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:01.569571    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:03.569554409 +0000 UTC m=+41.282214453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : secret "router-metrics-certs-default" not found
Sep 11 21:18:02.132952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:02.132913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hv7xh" event={"ID":"f36bed74-6b22-4866-92d5-8fd4bda70bfd","Type":"ContainerStarted","Data":"db465fc1117ee8b04a329d8efd9d3a50f212168676357bd76d1034890e334137"}
Sep 11 21:18:02.151033 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:02.150974    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hv7xh" podStartSLOduration=2.640744273 podStartE2EDuration="5.150952384s" totalImagesPullingTime="2.510208111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:02.149977125 +0000 UTC m=+39.862637175" watchObservedRunningTime="2026-09-11 21:18:02.150952384 +0000 UTC m=+39.863612434"
Sep 11 21:18:03.589026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.588990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:03.589481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.589035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:03.589481 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:03.589153    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:18:03.589481 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:03.589216    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.589197875 +0000 UTC m=+45.301857915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : secret "router-metrics-certs-default" not found
Sep 11 21:18:03.589481 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:03.589350    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.589331199 +0000 UTC m=+45.301991240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : configmap references non-existent config key: service-ca.crt
Sep 11 21:18:03.589940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.589919    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc"]
Sep 11 21:18:03.608009 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.607985    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc"]
Sep 11 21:18:03.608145 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.608083    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc"
Sep 11 21:18:03.610396 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.610365    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h5pdn\""
Sep 11 21:18:03.610396 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.610372    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:18:03.610396 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.610393    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 21:18:03.790383 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.790351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p89nd\" (UniqueName: \"kubernetes.io/projected/d73935be-b82e-4e10-a9c1-167e9a48a2a4-kube-api-access-p89nd\") pod \"volume-data-source-validator-86695b7cc7-mw7lc\" (UID: \"d73935be-b82e-4e10-a9c1-167e9a48a2a4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc"
Sep 11 21:18:03.890868 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.890769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p89nd\" (UniqueName: \"kubernetes.io/projected/d73935be-b82e-4e10-a9c1-167e9a48a2a4-kube-api-access-p89nd\") pod \"volume-data-source-validator-86695b7cc7-mw7lc\" (UID: \"d73935be-b82e-4e10-a9c1-167e9a48a2a4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc"
Sep 11 21:18:03.901008 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.900972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p89nd\" (UniqueName: \"kubernetes.io/projected/d73935be-b82e-4e10-a9c1-167e9a48a2a4-kube-api-access-p89nd\") pod \"volume-data-source-validator-86695b7cc7-mw7lc\" (UID: \"d73935be-b82e-4e10-a9c1-167e9a48a2a4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc"
Sep 11 21:18:03.917875 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:03.917852    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc"
Sep 11 21:18:04.997408 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:04.997376    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc"]
Sep 11 21:18:05.000790 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:05.000758    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73935be_b82e_4e10_a9c1_167e9a48a2a4.slice/crio-a4da6f11f9650e298246b818b08f02611dd8cbcb78648e64d3f556731d39a284 WatchSource:0}: Error finding container a4da6f11f9650e298246b818b08f02611dd8cbcb78648e64d3f556731d39a284: Status 404 returned error can't find the container with id a4da6f11f9650e298246b818b08f02611dd8cbcb78648e64d3f556731d39a284
Sep 11 21:18:05.142638 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.142602    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl" event={"ID":"0f29fd09-7f3a-434f-965e-71d5dabfdcf6","Type":"ContainerStarted","Data":"c91b59ebfd87e9ec0d007a9b727f94ef44a414c20d36564054d9439c805b2936"}
Sep 11 21:18:05.144424 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.144393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x" event={"ID":"eb9db64c-af22-4710-8074-5af2ac0687d3","Type":"ContainerStarted","Data":"0cfbc7cc7beedc192ecdb68b76aaae81a34afe27604546140e8cd815cffcf718"}
Sep 11 21:18:05.145737 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.145706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc" event={"ID":"d73935be-b82e-4e10-a9c1-167e9a48a2a4","Type":"ContainerStarted","Data":"a4da6f11f9650e298246b818b08f02611dd8cbcb78648e64d3f556731d39a284"}
Sep 11 21:18:05.147493 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.147469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tzww9" event={"ID":"029205bf-1e5e-4119-8a62-bb2640d621fb","Type":"ContainerStarted","Data":"e84624627452f6f93bf613cde0fa69cde1b310655ecd49b884be728f580b4b72"}
Sep 11 21:18:05.158935 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.158882    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl" podStartSLOduration=2.524089611 podStartE2EDuration="6.158863919s" totalImagesPullingTime="3.634774308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:05.158695226 +0000 UTC m=+42.871355280" watchObservedRunningTime="2026-09-11 21:18:05.158863919 +0000 UTC m=+42.871523964"
Sep 11 21:18:05.176799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.176753    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x" podStartSLOduration=1.660315152 podStartE2EDuration="6.176736954s" totalImagesPullingTime="4.516421802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:05.176084378 +0000 UTC m=+42.888744429" watchObservedRunningTime="2026-09-11 21:18:05.176736954 +0000 UTC m=+42.889397000"
Sep 11 21:18:05.194748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.194156    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-tzww9" podStartSLOduration=2.563352662 podStartE2EDuration="6.194137007s" totalImagesPullingTime="3.630784345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:05.193855907 +0000 UTC m=+42.906515961" watchObservedRunningTime="2026-09-11 21:18:05.194137007 +0000 UTC m=+42.906797057"
Sep 11 21:18:05.407160 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.407076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:18:05.407322 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:05.407253    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:18:05.407363 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:05.407328    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls podName:0e67c3c0-b167-4c88-add1-1a8fbe2d2845 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:13.407309135 +0000 UTC m=+51.119969166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls") pod "dns-default-9dfl7" (UID: "0e67c3c0-b167-4c88-add1-1a8fbe2d2845") : secret "dns-default-metrics-tls" not found
Sep 11 21:18:05.963436 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.963399    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dcth4"]
Sep 11 21:18:05.987378 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.987345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dcth4"]
Sep 11 21:18:05.987555 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.987467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:05.992858 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.990259    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qrmzx\""
Sep 11 21:18:05.992858 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.990137    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 21:18:05.992858 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:05.990265    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 21:18:06.112945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.112898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.112945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.112943    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-data-volume\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.113440 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.112966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.113440 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.113039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-crio-socket\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.113440 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.113055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw87d\" (UniqueName: \"kubernetes.io/projected/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-api-access-xw87d\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.214136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.214049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.214136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.214094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-data-volume\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.214136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.214119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.214429 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.214154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-crio-socket\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.214429 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.214179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw87d\" (UniqueName: \"kubernetes.io/projected/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-api-access-xw87d\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.214429 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:06.214208    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:06.214429 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:06.214268    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:18:06.214429 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:06.214275    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls podName:23aa2db7-4415-413d-9e4e-e9fe5556ba2f nodeName:}" failed. No retries permitted until 2026-09-11 21:18:06.714255955 +0000 UTC m=+44.426915985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcth4" (UID: "23aa2db7-4415-413d-9e4e-e9fe5556ba2f") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:06.214429 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:06.214340    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm podName:23aa2db7-4415-413d-9e4e-e9fe5556ba2f nodeName:}" failed. No retries permitted until 2026-09-11 21:18:06.714323864 +0000 UTC m=+44.426983891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dcth4" (UID: "23aa2db7-4415-413d-9e4e-e9fe5556ba2f") : configmap "kube-rbac-proxy" not found
Sep 11 21:18:06.214719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.214438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-crio-socket\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.214719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.214480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-data-volume\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.225066 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.225042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw87d\" (UniqueName: \"kubernetes.io/projected/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-api-access-xw87d\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.718689 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.718663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.718812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:06.718696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:06.718812 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:06.718780    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:18:06.718812 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:06.718800    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:06.718930 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:06.718856    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm podName:23aa2db7-4415-413d-9e4e-e9fe5556ba2f nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.718817429 +0000 UTC m=+45.431477476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dcth4" (UID: "23aa2db7-4415-413d-9e4e-e9fe5556ba2f") : configmap "kube-rbac-proxy" not found
Sep 11 21:18:06.718968 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:06.718938    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls podName:23aa2db7-4415-413d-9e4e-e9fe5556ba2f nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.718930814 +0000 UTC m=+45.431590841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcth4" (UID: "23aa2db7-4415-413d-9e4e-e9fe5556ba2f") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:07.154215 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:07.154179    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc" event={"ID":"d73935be-b82e-4e10-a9c1-167e9a48a2a4","Type":"ContainerStarted","Data":"4d19262b8711ef078cf34f6a8a25571f4b7e78cdaffd077f3a5f1aabbbee3583"}
Sep 11 21:18:07.537750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:07.537677    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qkfqp_8bcbacb0-e371-4960-b618-9b05daf4fdcf/dns-node-resolver/0.log"
Sep 11 21:18:07.627465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:07.627436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:07.627465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:07.627469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:07.627655 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:07.627617    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:15.627597275 +0000 UTC m=+53.340257302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : configmap references non-existent config key: service-ca.crt
Sep 11 21:18:07.627655 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:07.627625    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:18:07.627732 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:07.627668    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:15.627656029 +0000 UTC m=+53.340316070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : secret "router-metrics-certs-default" not found
Sep 11 21:18:07.728307 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:07.728279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:07.728307 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:07.728312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:07.728510 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:07.728394    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:18:07.728510 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:07.728438    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm podName:23aa2db7-4415-413d-9e4e-e9fe5556ba2f nodeName:}" failed. No retries permitted until 2026-09-11 21:18:09.728426282 +0000 UTC m=+47.441086322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dcth4" (UID: "23aa2db7-4415-413d-9e4e-e9fe5556ba2f") : configmap "kube-rbac-proxy" not found
Sep 11 21:18:07.728510 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:07.728437    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:07.728510 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:07.728495    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls podName:23aa2db7-4415-413d-9e4e-e9fe5556ba2f nodeName:}" failed. No retries permitted until 2026-09-11 21:18:09.728478591 +0000 UTC m=+47.441138618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcth4" (UID: "23aa2db7-4415-413d-9e4e-e9fe5556ba2f") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:08.536950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:08.536924    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lr2nj_3e7d3f47-930d-4f95-9876-9d672acd1f17/node-ca/0.log"
Sep 11 21:18:08.938273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:08.938240    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hv7xh_f36bed74-6b22-4866-92d5-8fd4bda70bfd/serve-healthcheck-canary/0.log"
Sep 11 21:18:09.745039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:09.745004    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:09.745039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:09.745043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:09.745432 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:09.745161    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:09.745432 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:09.745228    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls podName:23aa2db7-4415-413d-9e4e-e9fe5556ba2f nodeName:}" failed. No retries permitted until 2026-09-11 21:18:13.745211125 +0000 UTC m=+51.457871158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcth4" (UID: "23aa2db7-4415-413d-9e4e-e9fe5556ba2f") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:09.745544 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:09.745526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:13.475689 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:13.475650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:18:13.476198 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:13.475854    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:18:13.476198 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:13.475940    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls podName:0e67c3c0-b167-4c88-add1-1a8fbe2d2845 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:29.475918666 +0000 UTC m=+67.188578717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls") pod "dns-default-9dfl7" (UID: "0e67c3c0-b167-4c88-add1-1a8fbe2d2845") : secret "dns-default-metrics-tls" not found
Sep 11 21:18:13.778878 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:13.778787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:13.779030 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:13.778910    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:13.779030 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:13.778968    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls podName:23aa2db7-4415-413d-9e4e-e9fe5556ba2f nodeName:}" failed. No retries permitted until 2026-09-11 21:18:21.778953642 +0000 UTC m=+59.491613669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcth4" (UID: "23aa2db7-4415-413d-9e4e-e9fe5556ba2f") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:15.692136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:15.692099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:15.692136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:15.692136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:15.692611 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:15.692260    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:18:15.692611 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:15.692274    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:31.692257158 +0000 UTC m=+69.404917189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : configmap references non-existent config key: service-ca.crt
Sep 11 21:18:15.692611 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:15.692302    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs podName:f9438a19-93f7-48fd-9df3-c66553af78c5 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:31.692291203 +0000 UTC m=+69.404951230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs") pod "router-default-5c84486586-ftqpb" (UID: "f9438a19-93f7-48fd-9df3-c66553af78c5") : secret "router-metrics-certs-default" not found
Sep 11 21:18:21.839817 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:21.839771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:21.842185 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:21.842161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23aa2db7-4415-413d-9e4e-e9fe5556ba2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcth4\" (UID: \"23aa2db7-4415-413d-9e4e-e9fe5556ba2f\") " pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:21.901202 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:21.901174    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dcth4"
Sep 11 21:18:22.210050 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:22.209881    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mw7lc" podStartSLOduration=17.508027137 podStartE2EDuration="19.20980488s" totalImagesPullingTime="1.701777743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:07.174889501 +0000 UTC m=+44.887549551" watchObservedRunningTime="2026-09-11 21:18:22.20980488 +0000 UTC m=+59.922464930"
Sep 11 21:18:22.210961 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:22.210896    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dcth4"]
Sep 11 21:18:22.213533 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:22.213503    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23aa2db7_4415_413d_9e4e_e9fe5556ba2f.slice/crio-77ca28a0173458a5aac0932f00b55942cff03dfa5ffb187ed4ee2dbc8408a1f4 WatchSource:0}: Error finding container 77ca28a0173458a5aac0932f00b55942cff03dfa5ffb187ed4ee2dbc8408a1f4: Status 404 returned error can't find the container with id 77ca28a0173458a5aac0932f00b55942cff03dfa5ffb187ed4ee2dbc8408a1f4
Sep 11 21:18:23.199507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:23.199464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcth4" event={"ID":"23aa2db7-4415-413d-9e4e-e9fe5556ba2f","Type":"ContainerStarted","Data":"74c0f7be0354ff62dbf8e75278ae61e8269f71faacf83cc7e272d2ed08b95801"}
Sep 11 21:18:23.199909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:23.199567    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcth4" event={"ID":"23aa2db7-4415-413d-9e4e-e9fe5556ba2f","Type":"ContainerStarted","Data":"dd769cb72f029c954467c8ba6c8467f71704578fe38b402eec6c8a289bbf954e"}
Sep 11 21:18:23.199909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:23.199598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcth4" event={"ID":"23aa2db7-4415-413d-9e4e-e9fe5556ba2f","Type":"ContainerStarted","Data":"77ca28a0173458a5aac0932f00b55942cff03dfa5ffb187ed4ee2dbc8408a1f4"}
Sep 11 21:18:24.644127 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:24.644098    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-glzgj"
Sep 11 21:18:25.208734 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:25.208701    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcth4" event={"ID":"23aa2db7-4415-413d-9e4e-e9fe5556ba2f","Type":"ContainerStarted","Data":"274b1054a8c087670b23c75dc0871f96ae8dea7604659c8e984d0537d75e646a"}
Sep 11 21:18:25.229523 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:25.229475    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dcth4" podStartSLOduration=18.070368649 podStartE2EDuration="20.229459041s" totalImagesPullingTime="2.159090392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:18:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:25.228545103 +0000 UTC m=+62.941205154" watchObservedRunningTime="2026-09-11 21:18:25.229459041 +0000 UTC m=+62.942119125"
Sep 11 21:18:28.592194 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.592148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:18:28.592628 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.592276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:18:28.595130 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.595111    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:18:28.595191 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.595160    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:18:28.605347 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.605324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8-original-pull-secret\") pod \"global-pull-secret-syncer-whrjq\" (UID: \"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8\") " pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:18:28.605475 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.605456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d7777e2-d273-45bf-9271-65051bab4142-metrics-certs\") pod \"network-metrics-daemon-mldrg\" (UID: \"9d7777e2-d273-45bf-9271-65051bab4142\") " pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:18:28.692816 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.692781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:18:28.695519 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.695500    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 21:18:28.705285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.705259    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 21:18:28.715701 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.715672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgmth\" (UniqueName: \"kubernetes.io/projected/9dc4d446-45ad-4b42-953c-b5a7cdeda14a-kube-api-access-mgmth\") pod \"network-check-target-dtqb6\" (UID: \"9dc4d446-45ad-4b42-953c-b5a7cdeda14a\") " pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:18:28.809931 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.809905    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vp72k\""
Sep 11 21:18:28.815264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.815248    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vqqz8\""
Sep 11 21:18:28.817374 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.817359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whrjq"
Sep 11 21:18:28.817972 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.817957    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:18:28.823162 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:28.823149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mldrg"
Sep 11 21:18:29.122452 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.122389    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whrjq"]
Sep 11 21:18:29.125134 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:29.125106    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfaf9e9b_b15a_4b42_a4f5_f3668577ebb8.slice/crio-a6d0f1a964b72abb1d13336baec9e193f0b19fcb5a28b3c22b61e2ea8e520543 WatchSource:0}: Error finding container a6d0f1a964b72abb1d13336baec9e193f0b19fcb5a28b3c22b61e2ea8e520543: Status 404 returned error can't find the container with id a6d0f1a964b72abb1d13336baec9e193f0b19fcb5a28b3c22b61e2ea8e520543
Sep 11 21:18:29.150522 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.150495    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dtqb6"]
Sep 11 21:18:29.153289 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:29.153257    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc4d446_45ad_4b42_953c_b5a7cdeda14a.slice/crio-c4830b754cb9dc9d6e7a36c7fabb5baf402a9673455a4b829d05b4850eca24e3 WatchSource:0}: Error finding container c4830b754cb9dc9d6e7a36c7fabb5baf402a9673455a4b829d05b4850eca24e3: Status 404 returned error can't find the container with id c4830b754cb9dc9d6e7a36c7fabb5baf402a9673455a4b829d05b4850eca24e3
Sep 11 21:18:29.175918 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.175892    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mldrg"]
Sep 11 21:18:29.186121 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:29.186099    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7777e2_d273_45bf_9271_65051bab4142.slice/crio-83c1c4cfeaa4f73f53794e9f03f0b447220db4aa554edfb571ed187dbc52e5c2 WatchSource:0}: Error finding container 83c1c4cfeaa4f73f53794e9f03f0b447220db4aa554edfb571ed187dbc52e5c2: Status 404 returned error can't find the container with id 83c1c4cfeaa4f73f53794e9f03f0b447220db4aa554edfb571ed187dbc52e5c2
Sep 11 21:18:29.222949 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.222916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mldrg" event={"ID":"9d7777e2-d273-45bf-9271-65051bab4142","Type":"ContainerStarted","Data":"83c1c4cfeaa4f73f53794e9f03f0b447220db4aa554edfb571ed187dbc52e5c2"}
Sep 11 21:18:29.224080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.224049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whrjq" event={"ID":"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8","Type":"ContainerStarted","Data":"a6d0f1a964b72abb1d13336baec9e193f0b19fcb5a28b3c22b61e2ea8e520543"}
Sep 11 21:18:29.225140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.225118    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dtqb6" event={"ID":"9dc4d446-45ad-4b42-953c-b5a7cdeda14a","Type":"ContainerStarted","Data":"c4830b754cb9dc9d6e7a36c7fabb5baf402a9673455a4b829d05b4850eca24e3"}
Sep 11 21:18:29.499470 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.499388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:18:29.501944 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.501919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e67c3c0-b167-4c88-add1-1a8fbe2d2845-metrics-tls\") pod \"dns-default-9dfl7\" (UID: \"0e67c3c0-b167-4c88-add1-1a8fbe2d2845\") " pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:18:29.753164 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.753088    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hdgmr\""
Sep 11 21:18:29.761184 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:29.761158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:18:30.054222 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:30.054090    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9dfl7"]
Sep 11 21:18:30.231285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:30.231245    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9dfl7" event={"ID":"0e67c3c0-b167-4c88-add1-1a8fbe2d2845","Type":"ContainerStarted","Data":"9a5f4afc5d7c92cbe1be3ac015bb6bff372e69f9cd22c6f5b5489f2109b18e5a"}
Sep 11 21:18:31.127466 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.127125    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"]
Sep 11 21:18:31.133100 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.129978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.137640 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.137618    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 21:18:31.137972 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.137935    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 21:18:31.138733 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.138301    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 21:18:31.138733 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.138220    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 21:18:31.171688 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.171654    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"]
Sep 11 21:18:31.222908 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.222859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/43182214-b1a7-43f0-870e-009a9ab18244-klusterlet-config\") pod \"klusterlet-addon-workmgr-79bd7f5d45-6whns\" (UID: \"43182214-b1a7-43f0-870e-009a9ab18244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.223082 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.222955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqqr6\" (UniqueName: \"kubernetes.io/projected/43182214-b1a7-43f0-870e-009a9ab18244-kube-api-access-hqqr6\") pod \"klusterlet-addon-workmgr-79bd7f5d45-6whns\" (UID: \"43182214-b1a7-43f0-870e-009a9ab18244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.223082 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.223005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43182214-b1a7-43f0-870e-009a9ab18244-tmp\") pod \"klusterlet-addon-workmgr-79bd7f5d45-6whns\" (UID: \"43182214-b1a7-43f0-870e-009a9ab18244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.223082 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.223061    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54b678db7d-tw27v"]
Sep 11 21:18:31.225474 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.225449    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.229053 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.229030    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xvbfg\""
Sep 11 21:18:31.229212 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.229106    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 21:18:31.229305 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.229290    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 21:18:31.229513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.229491    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 21:18:31.240413 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.240376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mldrg" event={"ID":"9d7777e2-d273-45bf-9271-65051bab4142","Type":"ContainerStarted","Data":"e452a6881bc061f86be96f44efc2dee12edfd0dc972771abaea4770c4b522656"}
Sep 11 21:18:31.240550 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.240433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mldrg" event={"ID":"9d7777e2-d273-45bf-9271-65051bab4142","Type":"ContainerStarted","Data":"09d4f4de286bab37c2cfff7144780fae3501fad31edd256edd7ea30b1cfcad6a"}
Sep 11 21:18:31.240615 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.240557    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 21:18:31.258478 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.258394    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54b678db7d-tw27v"]
Sep 11 21:18:31.309205 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.309167    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54b678db7d-tw27v"]
Sep 11 21:18:31.309610 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:31.309573    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-km4d7 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-54b678db7d-tw27v" podUID="35c69aa0-25d0-41a0-b052-bab3cfb3cb01"
Sep 11 21:18:31.323478 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km4d7\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-kube-api-access-km4d7\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.323632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqqr6\" (UniqueName: \"kubernetes.io/projected/43182214-b1a7-43f0-870e-009a9ab18244-kube-api-access-hqqr6\") pod \"klusterlet-addon-workmgr-79bd7f5d45-6whns\" (UID: \"43182214-b1a7-43f0-870e-009a9ab18244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.323632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-certificates\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.323632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-trusted-ca\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.323859 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43182214-b1a7-43f0-870e-009a9ab18244-tmp\") pod \"klusterlet-addon-workmgr-79bd7f5d45-6whns\" (UID: \"43182214-b1a7-43f0-870e-009a9ab18244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.323859 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-image-registry-private-configuration\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.323859 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-installation-pull-secrets\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.324028 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-tls\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.324028 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-bound-sa-token\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.324028 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-ca-trust-extracted\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.324028 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.323978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/43182214-b1a7-43f0-870e-009a9ab18244-klusterlet-config\") pod \"klusterlet-addon-workmgr-79bd7f5d45-6whns\" (UID: \"43182214-b1a7-43f0-870e-009a9ab18244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.325128 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.325066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43182214-b1a7-43f0-870e-009a9ab18244-tmp\") pod \"klusterlet-addon-workmgr-79bd7f5d45-6whns\" (UID: \"43182214-b1a7-43f0-870e-009a9ab18244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.328556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.328534    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/43182214-b1a7-43f0-870e-009a9ab18244-klusterlet-config\") pod \"klusterlet-addon-workmgr-79bd7f5d45-6whns\" (UID: \"43182214-b1a7-43f0-870e-009a9ab18244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.334309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.333783    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mldrg" podStartSLOduration=67.080723122 podStartE2EDuration="1m8.333766382s" totalImagesPullingTime="1.25304326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:31.331851424 +0000 UTC m=+69.044511473" watchObservedRunningTime="2026-09-11 21:18:31.333766382 +0000 UTC m=+69.046426433"
Sep 11 21:18:31.339132 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.339102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqqr6\" (UniqueName: \"kubernetes.io/projected/43182214-b1a7-43f0-870e-009a9ab18244-kube-api-access-hqqr6\") pod \"klusterlet-addon-workmgr-79bd7f5d45-6whns\" (UID: \"43182214-b1a7-43f0-870e-009a9ab18244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.425157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.425066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-trusted-ca\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.425157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.425112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-image-registry-private-configuration\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.425157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.425134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-installation-pull-secrets\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.425157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.425159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-tls\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.425499 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.425174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-bound-sa-token\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.425499 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.425199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-ca-trust-extracted\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.425499 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.425247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4d7\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-kube-api-access-km4d7\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.425499 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.425263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-certificates\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.426245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.425934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-certificates\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.426245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.426111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-ca-trust-extracted\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.427208 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.427163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-trusted-ca\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.429405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.429363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-installation-pull-secrets\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.430579 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.430459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-tls\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.430579 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.430535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-image-registry-private-configuration\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.440533 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.440504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km4d7\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-kube-api-access-km4d7\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.444836 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.444797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:31.445477 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.445420    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-bound-sa-token\") pod \"image-registry-54b678db7d-tw27v\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") " pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:31.728186 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.728098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:31.728186 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.728153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:31.729327 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.729299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9438a19-93f7-48fd-9df3-c66553af78c5-service-ca-bundle\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:31.731333 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.731305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9438a19-93f7-48fd-9df3-c66553af78c5-metrics-certs\") pod \"router-default-5c84486586-ftqpb\" (UID: \"f9438a19-93f7-48fd-9df3-c66553af78c5\") " pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:31.934623 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.934586    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h6nq6\""
Sep 11 21:18:31.942192 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:31.942162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:32.244514 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.244477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:32.251482 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.251459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:32.332929 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.332899    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-ca-trust-extracted\") pod \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") "
Sep 11 21:18:32.333105 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.332942    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-installation-pull-secrets\") pod \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") "
Sep 11 21:18:32.333105 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.332987    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-certificates\") pod \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") "
Sep 11 21:18:32.333105 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.333018    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-bound-sa-token\") pod \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") "
Sep 11 21:18:32.333105 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.333045    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-image-registry-private-configuration\") pod \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") "
Sep 11 21:18:32.333105 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.333073    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-trusted-ca\") pod \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") "
Sep 11 21:18:32.333105 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.333096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-tls\") pod \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") "
Sep 11 21:18:32.333396 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.333156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km4d7\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-kube-api-access-km4d7\") pod \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\" (UID: \"35c69aa0-25d0-41a0-b052-bab3cfb3cb01\") "
Sep 11 21:18:32.333396 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.333206    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "35c69aa0-25d0-41a0-b052-bab3cfb3cb01" (UID: "35c69aa0-25d0-41a0-b052-bab3cfb3cb01"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:18:32.333396 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.333391    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-ca-trust-extracted\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:18:32.334215 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.334182    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "35c69aa0-25d0-41a0-b052-bab3cfb3cb01" (UID: "35c69aa0-25d0-41a0-b052-bab3cfb3cb01"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:18:32.334215 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.334188    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "35c69aa0-25d0-41a0-b052-bab3cfb3cb01" (UID: "35c69aa0-25d0-41a0-b052-bab3cfb3cb01"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:18:32.336144 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.336113    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "35c69aa0-25d0-41a0-b052-bab3cfb3cb01" (UID: "35c69aa0-25d0-41a0-b052-bab3cfb3cb01"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:18:32.336416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.336389    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "35c69aa0-25d0-41a0-b052-bab3cfb3cb01" (UID: "35c69aa0-25d0-41a0-b052-bab3cfb3cb01"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:18:32.336686 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.336656    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "35c69aa0-25d0-41a0-b052-bab3cfb3cb01" (UID: "35c69aa0-25d0-41a0-b052-bab3cfb3cb01"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:18:32.337633 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.337599    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "35c69aa0-25d0-41a0-b052-bab3cfb3cb01" (UID: "35c69aa0-25d0-41a0-b052-bab3cfb3cb01"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:18:32.339288 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.339259    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-kube-api-access-km4d7" (OuterVolumeSpecName: "kube-api-access-km4d7") pod "35c69aa0-25d0-41a0-b052-bab3cfb3cb01" (UID: "35c69aa0-25d0-41a0-b052-bab3cfb3cb01"). InnerVolumeSpecName "kube-api-access-km4d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:18:32.434179 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.434141    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km4d7\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-kube-api-access-km4d7\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:18:32.434179 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.434178    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-installation-pull-secrets\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:18:32.434400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.434191    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-certificates\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:18:32.434400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.434207    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-bound-sa-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:18:32.434400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.434220    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-image-registry-private-configuration\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:18:32.434400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.434233    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-trusted-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:18:32.434400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:32.434244    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35c69aa0-25d0-41a0-b052-bab3cfb3cb01-registry-tls\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:18:33.249070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:33.249036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b678db7d-tw27v"
Sep 11 21:18:33.317142 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:33.317087    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54b678db7d-tw27v"]
Sep 11 21:18:33.329922 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:33.329896    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54b678db7d-tw27v"]
Sep 11 21:18:34.624150 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:34.624075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c84486586-ftqpb"]
Sep 11 21:18:34.627263 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:34.627236    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"]
Sep 11 21:18:34.627967 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:34.627876    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9438a19_93f7_48fd_9df3_c66553af78c5.slice/crio-a026056ca34f7241bb8c67039fa5461bcf0279fb019b193c0d15cc1eb56ea3cf WatchSource:0}: Error finding container a026056ca34f7241bb8c67039fa5461bcf0279fb019b193c0d15cc1eb56ea3cf: Status 404 returned error can't find the container with id a026056ca34f7241bb8c67039fa5461bcf0279fb019b193c0d15cc1eb56ea3cf
Sep 11 21:18:34.630316 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:34.630289    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43182214_b1a7_43f0_870e_009a9ab18244.slice/crio-88408edf12e6a46f20887b9e762e4ab27860a1d8af4575a8e27913e1b988f07f WatchSource:0}: Error finding container 88408edf12e6a46f20887b9e762e4ab27860a1d8af4575a8e27913e1b988f07f: Status 404 returned error can't find the container with id 88408edf12e6a46f20887b9e762e4ab27860a1d8af4575a8e27913e1b988f07f
Sep 11 21:18:34.799369 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:34.799336    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35c69aa0-25d0-41a0-b052-bab3cfb3cb01" path="/var/lib/kubelet/pods/35c69aa0-25d0-41a0-b052-bab3cfb3cb01/volumes"
Sep 11 21:18:35.259802 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.259760    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dtqb6" event={"ID":"9dc4d446-45ad-4b42-953c-b5a7cdeda14a","Type":"ContainerStarted","Data":"c1a93e917fd53dac73360abae6316843020193439db61624402924e4372ce5df"}
Sep 11 21:18:35.260115 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.259874    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:18:35.261410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.261383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whrjq" event={"ID":"dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8","Type":"ContainerStarted","Data":"5eec56e7bc6d26bfdbda2128a76043bb11bd9e13f198f3f47a68b9e47a6d2335"}
Sep 11 21:18:35.263044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.263015    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9dfl7" event={"ID":"0e67c3c0-b167-4c88-add1-1a8fbe2d2845","Type":"ContainerStarted","Data":"0bcbdcd49ec9db3e2def959eea242e6d4d4d3c910111f29113422762a474cbd6"}
Sep 11 21:18:35.263159 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.263062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9dfl7" event={"ID":"0e67c3c0-b167-4c88-add1-1a8fbe2d2845","Type":"ContainerStarted","Data":"50e11f67324520d091416d82fc56f68cb18b337049203e5690fc6d4144f2c819"}
Sep 11 21:18:35.263159 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.263089    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:18:35.264691 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.264668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c84486586-ftqpb" event={"ID":"f9438a19-93f7-48fd-9df3-c66553af78c5","Type":"ContainerStarted","Data":"5d5e21099b839dfca4ad97c179bd3aab12ce872360a1811841d5af24e5d470eb"}
Sep 11 21:18:35.264802 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.264704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c84486586-ftqpb" event={"ID":"f9438a19-93f7-48fd-9df3-c66553af78c5","Type":"ContainerStarted","Data":"a026056ca34f7241bb8c67039fa5461bcf0279fb019b193c0d15cc1eb56ea3cf"}
Sep 11 21:18:35.265907 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.265889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns" event={"ID":"43182214-b1a7-43f0-870e-009a9ab18244","Type":"ContainerStarted","Data":"88408edf12e6a46f20887b9e762e4ab27860a1d8af4575a8e27913e1b988f07f"}
Sep 11 21:18:35.276023 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.275980    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dtqb6" podStartSLOduration=67.084521727 podStartE2EDuration="1m12.275967797s" totalImagesPullingTime="5.19144607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:35.274874924 +0000 UTC m=+72.987534975" watchObservedRunningTime="2026-09-11 21:18:35.275967797 +0000 UTC m=+72.988627847"
Sep 11 21:18:35.305829 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.305778    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9dfl7" podStartSLOduration=34.026633501 podStartE2EDuration="38.305765745s" totalImagesPullingTime="4.279132244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:35.30534428 +0000 UTC m=+73.018004356" watchObservedRunningTime="2026-09-11 21:18:35.305765745 +0000 UTC m=+73.018425794"
Sep 11 21:18:35.306432 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.306405    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-whrjq" podStartSLOduration=67.076885101 podStartE2EDuration="1m12.306396963s" totalImagesPullingTime="5.229511862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:35.288987609 +0000 UTC m=+73.001647659" watchObservedRunningTime="2026-09-11 21:18:35.306396963 +0000 UTC m=+73.019057006"
Sep 11 21:18:35.323406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.323349    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c84486586-ftqpb" podStartSLOduration=36.323330241 podStartE2EDuration="36.323330241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:35.321947128 +0000 UTC m=+73.034607178" watchObservedRunningTime="2026-09-11 21:18:35.323330241 +0000 UTC m=+73.035990291"
Sep 11 21:18:35.942750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.942717    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:35.946320 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:35.946295    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:36.271374 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:36.271150    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:36.272318 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:36.272298    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c84486586-ftqpb"
Sep 11 21:18:38.356422 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.356391    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6666466cd9-pmjk7"]
Sep 11 21:18:38.373537 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.373494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6666466cd9-pmjk7"]
Sep 11 21:18:38.373692 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.373615    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.376457 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.376431    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 21:18:38.376695 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.376672    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 21:18:38.376780 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.376758    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 21:18:38.376880 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.376678    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 21:18:38.376955 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.376942    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 21:18:38.377085 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.377073    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j7bh2\""
Sep 11 21:18:38.377316 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.377300    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 21:18:38.377391 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.377319    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 21:18:38.484004 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.483967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-oauth-config\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.484004 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.484014    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-oauth-serving-cert\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.484250 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.484046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blbx9\" (UniqueName: \"kubernetes.io/projected/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-kube-api-access-blbx9\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.484250 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.484146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-config\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.484250 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.484194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-serving-cert\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.484250 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.484217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-service-ca\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.585441 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.585402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-config\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.585613 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.585454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-serving-cert\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.585613 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.585471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-service-ca\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.585613 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.585491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-oauth-config\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.585613 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.585507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-oauth-serving-cert\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.585613 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.585522    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blbx9\" (UniqueName: \"kubernetes.io/projected/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-kube-api-access-blbx9\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.586183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.586153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-config\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.586183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.586218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-service-ca\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.586543 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.586218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-oauth-serving-cert\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.588123 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.588099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-oauth-config\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.588123 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.588113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-serving-cert\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.598491 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.598466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blbx9\" (UniqueName: \"kubernetes.io/projected/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-kube-api-access-blbx9\") pod \"console-6666466cd9-pmjk7\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") " pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.684386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.684363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:38.959688 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:38.959603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6666466cd9-pmjk7"]
Sep 11 21:18:38.962458 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:38.962435    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb6e5c1_d8ef_48aa_aba7_3dd508be2b77.slice/crio-92e023a15410b107956bb886fe4ddb0682f64fde72169b172de631d5c7204568 WatchSource:0}: Error finding container 92e023a15410b107956bb886fe4ddb0682f64fde72169b172de631d5c7204568: Status 404 returned error can't find the container with id 92e023a15410b107956bb886fe4ddb0682f64fde72169b172de631d5c7204568
Sep 11 21:18:39.283683 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:39.283596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns" event={"ID":"43182214-b1a7-43f0-870e-009a9ab18244","Type":"ContainerStarted","Data":"ea7096bfc3f6a341b57f6c89c60c70ecea17d0b8a9fb7543b9075f5022db8be1"}
Sep 11 21:18:39.283874 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:39.283808    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:39.285197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:39.285163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6666466cd9-pmjk7" event={"ID":"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77","Type":"ContainerStarted","Data":"92e023a15410b107956bb886fe4ddb0682f64fde72169b172de631d5c7204568"}
Sep 11 21:18:39.285595 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:39.285577    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns"
Sep 11 21:18:39.301762 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:39.301720    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79bd7f5d45-6whns" podStartSLOduration=4.249894963 podStartE2EDuration="8.301705928s" totalImagesPullingTime="4.051810965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:39.300871777 +0000 UTC m=+77.013531826" watchObservedRunningTime="2026-09-11 21:18:39.301705928 +0000 UTC m=+77.014365977"
Sep 11 21:18:42.297284 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:42.297247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6666466cd9-pmjk7" event={"ID":"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77","Type":"ContainerStarted","Data":"78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39"}
Sep 11 21:18:42.316201 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:42.316152    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6666466cd9-pmjk7" podStartSLOduration=1.189797689 podStartE2EDuration="4.316135446s" totalImagesPullingTime="3.126337757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:42.315402941 +0000 UTC m=+80.028062989" watchObservedRunningTime="2026-09-11 21:18:42.316135446 +0000 UTC m=+80.028795518"
Sep 11 21:18:43.106763 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.106733    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w9nrz"]
Sep 11 21:18:43.108945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.108924    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.111291 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.111257    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 21:18:43.112070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.112051    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 21:18:43.112221 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.112109    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 21:18:43.112221 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.112051    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 21:18:43.112345 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.112252    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 21:18:43.112408 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.112364    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4fgxn\""
Sep 11 21:18:43.112488 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.112473    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 21:18:43.221526 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.221487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fd48e5d-9f4b-4458-9ad2-7836033df16e-metrics-client-ca\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.221713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.221536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fd48e5d-9f4b-4458-9ad2-7836033df16e-root\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.221713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.221562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-textfile\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.221713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.221639    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-tls\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.221713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.221678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld52d\" (UniqueName: \"kubernetes.io/projected/2fd48e5d-9f4b-4458-9ad2-7836033df16e-kube-api-access-ld52d\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.221983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.221750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-accelerators-collector-config\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.221983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.221780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fd48e5d-9f4b-4458-9ad2-7836033df16e-sys\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.221983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.221803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.221983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.221890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-wtmp\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.322611 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fd48e5d-9f4b-4458-9ad2-7836033df16e-metrics-client-ca\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fd48e5d-9f4b-4458-9ad2-7836033df16e-root\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-textfile\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-tls\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:43.322734    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fd48e5d-9f4b-4458-9ad2-7836033df16e-root\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:18:43.322800    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-tls podName:2fd48e5d-9f4b-4458-9ad2-7836033df16e nodeName:}" failed. No retries permitted until 2026-09-11 21:18:43.822783341 +0000 UTC m=+81.535443367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-tls") pod "node-exporter-w9nrz" (UID: "2fd48e5d-9f4b-4458-9ad2-7836033df16e") : secret "node-exporter-tls" not found
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld52d\" (UniqueName: \"kubernetes.io/projected/2fd48e5d-9f4b-4458-9ad2-7836033df16e-kube-api-access-ld52d\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-accelerators-collector-config\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fd48e5d-9f4b-4458-9ad2-7836033df16e-sys\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.322956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-wtmp\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.323071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-textfile\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.323198    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-wtmp\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.323253    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fd48e5d-9f4b-4458-9ad2-7836033df16e-metrics-client-ca\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.323269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fd48e5d-9f4b-4458-9ad2-7836033df16e-sys\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.323520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.323395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-accelerators-collector-config\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.325350 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.325328    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.343465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.343439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld52d\" (UniqueName: \"kubernetes.io/projected/2fd48e5d-9f4b-4458-9ad2-7836033df16e-kube-api-access-ld52d\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.827532 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.827415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-tls\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:43.829780 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:43.829751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fd48e5d-9f4b-4458-9ad2-7836033df16e-node-exporter-tls\") pod \"node-exporter-w9nrz\" (UID: \"2fd48e5d-9f4b-4458-9ad2-7836033df16e\") " pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:44.017902 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.017871    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w9nrz"
Sep 11 21:18:44.027876 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:44.027847    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd48e5d_9f4b_4458_9ad2_7836033df16e.slice/crio-3c0b682c6df2ca499bb4ad71d4a3431ce8cc4ab6bcb7ac5274c907cca27c7778 WatchSource:0}: Error finding container 3c0b682c6df2ca499bb4ad71d4a3431ce8cc4ab6bcb7ac5274c907cca27c7778: Status 404 returned error can't find the container with id 3c0b682c6df2ca499bb4ad71d4a3431ce8cc4ab6bcb7ac5274c907cca27c7778
Sep 11 21:18:44.305494 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.305404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w9nrz" event={"ID":"2fd48e5d-9f4b-4458-9ad2-7836033df16e","Type":"ContainerStarted","Data":"3c0b682c6df2ca499bb4ad71d4a3431ce8cc4ab6bcb7ac5274c907cca27c7778"}
Sep 11 21:18:44.328860 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.328811    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:18:44.331988 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.331971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.339087 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.339065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 21:18:44.339201 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.339086    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 21:18:44.339944 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.339927    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sq7cw\""
Sep 11 21:18:44.340043 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.339993    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 21:18:44.340866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.340850    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 21:18:44.340953 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.340851    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 21:18:44.340953 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.340851    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 21:18:44.344328 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.344313    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 21:18:44.344752 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.344740    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 21:18:44.346188 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.346175    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 21:18:44.363726 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.363706    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:18:44.431658 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.431658 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.431885 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-out\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.431885 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.431885 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.431885 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.431885 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.431885 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431851    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-web-config\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.432120 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.432120 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.432120 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.432120 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nqjj\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-kube-api-access-8nqjj\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.432120 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.431979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533314 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533314 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533314 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-web-config\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533314 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533314 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533314 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533582 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nqjj\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-kube-api-access-8nqjj\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533582 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533582 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533582 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533582 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-out\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.533812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.533624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.536504 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.534396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.536504 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.535019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.536714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.536691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-web-config\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.537496 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.537438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.537594 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.537564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.537729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.537705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.537987 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.537968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.538062 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.538042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.538160 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.538138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.538557 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.538539    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-out\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.538631 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.538562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.543696 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.543680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nqjj\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-kube-api-access-8nqjj\") pod \"alertmanager-main-0\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.641318 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.641282    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:18:44.665063 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.665033    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68c95d444b-mgdcx"]
Sep 11 21:18:44.667816 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.667765    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.676864 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.676809    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 21:18:44.688737 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.688681    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c95d444b-mgdcx"]
Sep 11 21:18:44.836365 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.836332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-console-config\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.836532 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.836397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-trusted-ca-bundle\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.836532 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.836453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwb9g\" (UniqueName: \"kubernetes.io/projected/27c60e94-a264-48ee-8459-8facb8287df1-kube-api-access-mwb9g\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.836532 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.836491    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-service-ca\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.836532 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.836514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-oauth-serving-cert\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.836726 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.836533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-oauth-config\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.836726 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.836585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-serving-cert\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.937434 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.937361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-service-ca\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.937434 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.937397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-oauth-serving-cert\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.937434 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.937424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-oauth-config\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.937689 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.937464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-serving-cert\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.937689 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.937498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-console-config\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.937689 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.937560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-trusted-ca-bundle\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.937689 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.937590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwb9g\" (UniqueName: \"kubernetes.io/projected/27c60e94-a264-48ee-8459-8facb8287df1-kube-api-access-mwb9g\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.938215 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.938183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-service-ca\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.938390 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.938363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-oauth-serving-cert\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.939154 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.939088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-console-config\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.939314 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.939275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-trusted-ca-bundle\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.940364 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.940340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-oauth-config\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.940457 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.940366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-serving-cert\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.955111 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.955088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwb9g\" (UniqueName: \"kubernetes.io/projected/27c60e94-a264-48ee-8459-8facb8287df1-kube-api-access-mwb9g\") pod \"console-68c95d444b-mgdcx\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") " pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:44.957419 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.957401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:18:44.982129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:44.982102    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:45.074759 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:45.074715    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6e7858_c26e_4c7b_8f6d_18a8374722d9.slice/crio-108fc540c89f3f342cd63ce0dc382aada592ea7f49701b849207d9adac0e544a WatchSource:0}: Error finding container 108fc540c89f3f342cd63ce0dc382aada592ea7f49701b849207d9adac0e544a: Status 404 returned error can't find the container with id 108fc540c89f3f342cd63ce0dc382aada592ea7f49701b849207d9adac0e544a
Sep 11 21:18:45.273432 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:45.273403    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9dfl7"
Sep 11 21:18:45.310864 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:45.310837    2560 generic.go:356] "Generic (PLEG): container finished" podID="2fd48e5d-9f4b-4458-9ad2-7836033df16e" containerID="e0ecefd84d64c94a9091498b87c62b28f3c9bb818e8a787d1b059e56006602b8" exitCode=0
Sep 11 21:18:45.311017 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:45.310927    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w9nrz" event={"ID":"2fd48e5d-9f4b-4458-9ad2-7836033df16e","Type":"ContainerDied","Data":"e0ecefd84d64c94a9091498b87c62b28f3c9bb818e8a787d1b059e56006602b8"}
Sep 11 21:18:45.312162 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:45.312135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerStarted","Data":"108fc540c89f3f342cd63ce0dc382aada592ea7f49701b849207d9adac0e544a"}
Sep 11 21:18:45.420902 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:45.420878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c95d444b-mgdcx"]
Sep 11 21:18:45.437302 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:45.437276    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c60e94_a264_48ee_8459_8facb8287df1.slice/crio-3caca2d53222e07f84457b39f2d28a344e7429802920d0fd9fc7f2a75b84b30a WatchSource:0}: Error finding container 3caca2d53222e07f84457b39f2d28a344e7429802920d0fd9fc7f2a75b84b30a: Status 404 returned error can't find the container with id 3caca2d53222e07f84457b39f2d28a344e7429802920d0fd9fc7f2a75b84b30a
Sep 11 21:18:46.317706 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:46.317672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c95d444b-mgdcx" event={"ID":"27c60e94-a264-48ee-8459-8facb8287df1","Type":"ContainerStarted","Data":"280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047"}
Sep 11 21:18:46.317948 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:46.317725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c95d444b-mgdcx" event={"ID":"27c60e94-a264-48ee-8459-8facb8287df1","Type":"ContainerStarted","Data":"3caca2d53222e07f84457b39f2d28a344e7429802920d0fd9fc7f2a75b84b30a"}
Sep 11 21:18:46.320620 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:46.320580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w9nrz" event={"ID":"2fd48e5d-9f4b-4458-9ad2-7836033df16e","Type":"ContainerStarted","Data":"210cb5bb7c68f617c1dff4d991f2818a32ca3e73160f7b7cf8247b117d7ed40a"}
Sep 11 21:18:46.320732 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:46.320639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w9nrz" event={"ID":"2fd48e5d-9f4b-4458-9ad2-7836033df16e","Type":"ContainerStarted","Data":"a99fb7c7d02023a966ad32603c0a35116462a7955a5ca0cc716eeccaeb1b8c02"}
Sep 11 21:18:46.363301 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:46.363240    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68c95d444b-mgdcx" podStartSLOduration=2.363218941 podStartE2EDuration="2.363218941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:46.363213528 +0000 UTC m=+84.075873579" watchObservedRunningTime="2026-09-11 21:18:46.363218941 +0000 UTC m=+84.075878993"
Sep 11 21:18:46.417981 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:46.417922    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w9nrz" podStartSLOduration=2.2773678569999998 podStartE2EDuration="3.417896632s" totalImagesPullingTime="1.071147691s" totalInitContainerRuntime="69.381084ms" isStatefulPod=true podCreationTimestamp="2026-09-11 21:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:46.416702622 +0000 UTC m=+84.129362671" watchObservedRunningTime="2026-09-11 21:18:46.417896632 +0000 UTC m=+84.130556685"
Sep 11 21:18:47.326304 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:47.326272    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerID="ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a" exitCode=0
Sep 11 21:18:47.326762 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:47.326358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerDied","Data":"ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a"}
Sep 11 21:18:48.684657 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:48.684633    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:48.684964 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:48.684683    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:48.689631 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:48.689611    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:48.924738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:48.924712    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6666466cd9-pmjk7"]
Sep 11 21:18:48.975291 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:48.975266    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-649d6f9969-2jh7t"]
Sep 11 21:18:48.977487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:48.977473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.002791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.002765    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649d6f9969-2jh7t"]
Sep 11 21:18:49.072011 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.071978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-trusted-ca-bundle\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.072173 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.072021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgc98\" (UniqueName: \"kubernetes.io/projected/7d91fbc0-baff-4df1-a581-7bb845067dca-kube-api-access-wgc98\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.072173 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.072052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-serving-cert\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.072276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.072165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-service-ca\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.072276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.072214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-console-config\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.072346 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.072279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-oauth-config\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.072388 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.072344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-oauth-serving-cert\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.173309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.173236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-service-ca\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.173309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.173267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-console-config\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.173309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.173297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-oauth-config\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.173546 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.173446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-oauth-serving-cert\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.173546 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.173515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-trusted-ca-bundle\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.173656 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.173543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgc98\" (UniqueName: \"kubernetes.io/projected/7d91fbc0-baff-4df1-a581-7bb845067dca-kube-api-access-wgc98\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.173656 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.173577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-serving-cert\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.174138 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.174112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-console-config\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.174265 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.174161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-oauth-serving-cert\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.174265 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.174176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-service-ca\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.174386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.174364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-trusted-ca-bundle\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.175745 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.175719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-oauth-config\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.176039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.176020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-serving-cert\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.182673 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.182653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgc98\" (UniqueName: \"kubernetes.io/projected/7d91fbc0-baff-4df1-a581-7bb845067dca-kube-api-access-wgc98\") pod \"console-649d6f9969-2jh7t\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") " pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.286632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.286605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:49.339160 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.339129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerStarted","Data":"eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2"}
Sep 11 21:18:49.339244 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.339218    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerStarted","Data":"6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a"}
Sep 11 21:18:49.339294 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.339259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerStarted","Data":"aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665"}
Sep 11 21:18:49.339327 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.339303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerStarted","Data":"a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb"}
Sep 11 21:18:49.339360 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.339341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerStarted","Data":"7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d"}
Sep 11 21:18:49.343791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.343765    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:18:49.557096 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.557014    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649d6f9969-2jh7t"]
Sep 11 21:18:49.561194 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:49.561168    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d91fbc0_baff_4df1_a581_7bb845067dca.slice/crio-8d0874c82da4a7cd5518ddad80a34e4f1bec662c5807ef4f9dd8e19b18c55be0 WatchSource:0}: Error finding container 8d0874c82da4a7cd5518ddad80a34e4f1bec662c5807ef4f9dd8e19b18c55be0: Status 404 returned error can't find the container with id 8d0874c82da4a7cd5518ddad80a34e4f1bec662c5807ef4f9dd8e19b18c55be0
Sep 11 21:18:49.995176 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.995141    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:18:49.997996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:49.997979    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.002115 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.002097    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 21:18:50.002115 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.002105    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 21:18:50.002546 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.002533    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 21:18:50.003161 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.003142    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 21:18:50.003728 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.003712    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 21:18:50.006264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006204    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 21:18:50.006264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006256    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 21:18:50.006493 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006310    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 21:18:50.006493 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006401    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 21:18:50.006493 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006464    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-75bkjcob5gahd\""
Sep 11 21:18:50.006632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006508    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2bdtt\""
Sep 11 21:18:50.006632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006557    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 21:18:50.006632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006615    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 21:18:50.006775 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006732    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 21:18:50.006956 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.006942    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 21:18:50.008301 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.008285    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 21:18:50.012192 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.012175    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 21:18:50.024394 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.024374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:18:50.081621 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.081621 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.081799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.081799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.081799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.081799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.081977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkxfc\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-kube-api-access-gkxfc\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082186    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-config\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.082302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.082297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183269 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183269 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183269 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183473 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183473 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183473 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183473 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183648 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183648 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183648 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183648 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183648 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183648 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkxfc\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-kube-api-access-gkxfc\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183958 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183958 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183958 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183958 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183958 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183958 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.183958 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-config\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.184286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.183961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.184286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.184088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.184537 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.184494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.184960 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.184940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.185156 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.185132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.186731 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.186647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.186731 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.186658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.187343 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.187038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-config\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.187343 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.187146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.187343 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.187145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.188405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.187955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.188405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.188119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.188405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.188363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.188595 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.188544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.188595 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.188567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.189343 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.189316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.189541 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.189521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.189810 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.189790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.189974 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.189956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.195928 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.195910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkxfc\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-kube-api-access-gkxfc\") pod \"prometheus-k8s-0\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.306713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.306681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:18:50.348685 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.348647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerStarted","Data":"5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab"}
Sep 11 21:18:50.350491 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.350464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649d6f9969-2jh7t" event={"ID":"7d91fbc0-baff-4df1-a581-7bb845067dca","Type":"ContainerStarted","Data":"ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a"}
Sep 11 21:18:50.350600 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.350514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649d6f9969-2jh7t" event={"ID":"7d91fbc0-baff-4df1-a581-7bb845067dca","Type":"ContainerStarted","Data":"8d0874c82da4a7cd5518ddad80a34e4f1bec662c5807ef4f9dd8e19b18c55be0"}
Sep 11 21:18:50.388257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.388207    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.648056482 podStartE2EDuration="6.388188919s" totalImagesPullingTime="3.715406611s" totalInitContainerRuntime="24.725826ms" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:50.380210157 +0000 UTC m=+88.092870220" watchObservedRunningTime="2026-09-11 21:18:50.388188919 +0000 UTC m=+88.100848968"
Sep 11 21:18:50.425653 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.425603    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-649d6f9969-2jh7t" podStartSLOduration=2.425588433 podStartE2EDuration="2.425588433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:50.42439598 +0000 UTC m=+88.137056029" watchObservedRunningTime="2026-09-11 21:18:50.425588433 +0000 UTC m=+88.138248482"
Sep 11 21:18:50.615320 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:50.615296    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:18:50.617203 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:50.617177    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7198b93_d4eb_402b_82cc_baa6b7906589.slice/crio-978ce94b737e82309b83b6a6546f5259c877dab321cb693e577ab69747814d8c WatchSource:0}: Error finding container 978ce94b737e82309b83b6a6546f5259c877dab321cb693e577ab69747814d8c: Status 404 returned error can't find the container with id 978ce94b737e82309b83b6a6546f5259c877dab321cb693e577ab69747814d8c
Sep 11 21:18:51.356159 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:51.356122    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerID="76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7" exitCode=0
Sep 11 21:18:51.356544 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:51.356214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerDied","Data":"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"}
Sep 11 21:18:51.356544 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:51.356298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerStarted","Data":"978ce94b737e82309b83b6a6546f5259c877dab321cb693e577ab69747814d8c"}
Sep 11 21:18:54.375721 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:54.375682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerStarted","Data":"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"}
Sep 11 21:18:54.376192 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:54.375774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerStarted","Data":"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"}
Sep 11 21:18:54.982627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:54.982589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:54.982816 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:54.982660    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:54.988338 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:54.988314    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:55.385658 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:55.385629    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:18:56.388015 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:56.387967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerStarted","Data":"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"}
Sep 11 21:18:56.388423 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:56.388079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerStarted","Data":"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"}
Sep 11 21:18:56.388423 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:56.388110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerStarted","Data":"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"}
Sep 11 21:18:56.388423 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:56.388144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerStarted","Data":"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"}
Sep 11 21:18:56.422135 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:56.422088    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.027363861 podStartE2EDuration="7.422069263s" totalImagesPullingTime="4.375742864s" totalInitContainerRuntime="18.962538ms" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:56.42036294 +0000 UTC m=+94.133022989" watchObservedRunningTime="2026-09-11 21:18:56.422069263 +0000 UTC m=+94.134729314"
Sep 11 21:18:58.790796 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.790756    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649d6f9969-2jh7t"]
Sep 11 21:18:58.822392 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.822357    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dc5cbdbc7-mvl9h"]
Sep 11 21:18:58.825978 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.825960    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.842126 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.840084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc5cbdbc7-mvl9h"]
Sep 11 21:18:58.863664 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.863636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-oauth-config\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.863767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.863678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrbb\" (UniqueName: \"kubernetes.io/projected/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-kube-api-access-zrrbb\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.863767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.863702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-config\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.863767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.863744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-service-ca\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.863916 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.863777    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-oauth-serving-cert\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.863916 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.863805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-serving-cert\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.863916 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.863856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-trusted-ca-bundle\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.965160 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.965114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-oauth-config\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.965160 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.965173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrbb\" (UniqueName: \"kubernetes.io/projected/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-kube-api-access-zrrbb\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.965385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.965195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-config\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.965385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.965212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-service-ca\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.965385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.965234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-oauth-serving-cert\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.965385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.965254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-serving-cert\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.965385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.965276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-trusted-ca-bundle\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.966096 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.966065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-service-ca\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.966096 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.966085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-oauth-serving-cert\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.966295 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.966182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-trusted-ca-bundle\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.966295 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.966239    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-config\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.967959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.967939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-oauth-config\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.968050 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.968027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-serving-cert\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:58.973867 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:58.973846    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrbb\" (UniqueName: \"kubernetes.io/projected/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-kube-api-access-zrrbb\") pod \"console-dc5cbdbc7-mvl9h\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") " pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:59.134789 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:59.134756    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:18:59.287222 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:59.287189    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:18:59.408961 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:18:59.408782    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc5cbdbc7-mvl9h"]
Sep 11 21:18:59.411533 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:18:59.411507    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4b1f55_74bb_4eb6_8f96_aa17c4b7d235.slice/crio-966e2e484b8983eaf6a4a25526d61f3d0e36e6e055291f6d21e41828b343eebe WatchSource:0}: Error finding container 966e2e484b8983eaf6a4a25526d61f3d0e36e6e055291f6d21e41828b343eebe: Status 404 returned error can't find the container with id 966e2e484b8983eaf6a4a25526d61f3d0e36e6e055291f6d21e41828b343eebe
Sep 11 21:19:00.306811 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:00.306782    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:19:00.405727 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:00.405691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc5cbdbc7-mvl9h" event={"ID":"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235","Type":"ContainerStarted","Data":"33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a"}
Sep 11 21:19:00.405903 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:00.405748    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc5cbdbc7-mvl9h" event={"ID":"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235","Type":"ContainerStarted","Data":"966e2e484b8983eaf6a4a25526d61f3d0e36e6e055291f6d21e41828b343eebe"}
Sep 11 21:19:00.426302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:00.426245    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dc5cbdbc7-mvl9h" podStartSLOduration=2.426226153 podStartE2EDuration="2.426226153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:19:00.425656106 +0000 UTC m=+98.138316155" watchObservedRunningTime="2026-09-11 21:19:00.426226153 +0000 UTC m=+98.138886203"
Sep 11 21:19:06.273405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:06.273371    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dtqb6"
Sep 11 21:19:09.135777 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:09.135740    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:19:09.136236 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:09.135798    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:19:09.140912 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:09.140890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:19:09.445806 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:09.445735    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:19:09.489562 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:09.489531    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c95d444b-mgdcx"]
Sep 11 21:19:15.376693 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.376638    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6666466cd9-pmjk7" podUID="bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" containerName="console" containerID="cri-o://78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39" gracePeriod=15
Sep 11 21:19:15.618837 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.618802    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:19:15.707853 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.707750    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-config\") pod \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") "
Sep 11 21:19:15.708002 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.707874    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-oauth-config\") pod \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") "
Sep 11 21:19:15.708002 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.707897    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blbx9\" (UniqueName: \"kubernetes.io/projected/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-kube-api-access-blbx9\") pod \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") "
Sep 11 21:19:15.708002 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.707914    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-serving-cert\") pod \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") "
Sep 11 21:19:15.708002 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.707947    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-service-ca\") pod \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") "
Sep 11 21:19:15.708002 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.707968    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-oauth-serving-cert\") pod \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\" (UID: \"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77\") "
Sep 11 21:19:15.708259 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.708230    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-config" (OuterVolumeSpecName: "console-config") pod "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" (UID: "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:15.708415 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.708380    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-service-ca" (OuterVolumeSpecName: "service-ca") pod "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" (UID: "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:15.708524 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.708419    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" (UID: "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:15.710321 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.710289    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" (UID: "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:15.710418 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.710344    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" (UID: "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:15.710418 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.710351    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-kube-api-access-blbx9" (OuterVolumeSpecName: "kube-api-access-blbx9") pod "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" (UID: "bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77"). InnerVolumeSpecName "kube-api-access-blbx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:19:15.808997 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.808951    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-oauth-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:15.808997 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.808992    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blbx9\" (UniqueName: \"kubernetes.io/projected/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-kube-api-access-blbx9\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:15.808997 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.809002    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:15.809208 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.809013    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:15.809208 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.809022    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-oauth-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:15.809208 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:15.809030    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77-console-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:16.469463 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.469430    2560 generic.go:356] "Generic (PLEG): container finished" podID="bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" containerID="78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39" exitCode=0
Sep 11 21:19:16.469939 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.469478    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6666466cd9-pmjk7"
Sep 11 21:19:16.469939 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.469493    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6666466cd9-pmjk7" event={"ID":"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77","Type":"ContainerDied","Data":"78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39"}
Sep 11 21:19:16.469939 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.469533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6666466cd9-pmjk7" event={"ID":"bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77","Type":"ContainerDied","Data":"92e023a15410b107956bb886fe4ddb0682f64fde72169b172de631d5c7204568"}
Sep 11 21:19:16.469939 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.469551    2560 scope.go:117] "RemoveContainer" containerID="78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39"
Sep 11 21:19:16.478964 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.478948    2560 scope.go:117] "RemoveContainer" containerID="78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39"
Sep 11 21:19:16.479262 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:19:16.479243    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39\": container with ID starting with 78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39 not found: ID does not exist" containerID="78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39"
Sep 11 21:19:16.479309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.479272    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39"} err="failed to get container status \"78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39\": rpc error: code = NotFound desc = could not find container \"78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39\": container with ID starting with 78f48b4b8bdcae8d461f5b18956007738d8b68f4815147fc242fd4dfdd500a39 not found: ID does not exist"
Sep 11 21:19:16.491186 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.491160    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6666466cd9-pmjk7"]
Sep 11 21:19:16.498250 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.498225    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6666466cd9-pmjk7"]
Sep 11 21:19:16.799727 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:16.799645    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" path="/var/lib/kubelet/pods/bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77/volumes"
Sep 11 21:19:23.810241 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:23.810166    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-649d6f9969-2jh7t" podUID="7d91fbc0-baff-4df1-a581-7bb845067dca" containerName="console" containerID="cri-o://ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a" gracePeriod=15
Sep 11 21:19:24.057624 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.057601    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:19:24.183989 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.183955    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-console-config\") pod \"7d91fbc0-baff-4df1-a581-7bb845067dca\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") "
Sep 11 21:19:24.184149 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184002    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-serving-cert\") pod \"7d91fbc0-baff-4df1-a581-7bb845067dca\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") "
Sep 11 21:19:24.184149 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184026    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-oauth-config\") pod \"7d91fbc0-baff-4df1-a581-7bb845067dca\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") "
Sep 11 21:19:24.184240 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184150    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-service-ca\") pod \"7d91fbc0-baff-4df1-a581-7bb845067dca\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") "
Sep 11 21:19:24.184240 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184227    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-trusted-ca-bundle\") pod \"7d91fbc0-baff-4df1-a581-7bb845067dca\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") "
Sep 11 21:19:24.184319 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-oauth-serving-cert\") pod \"7d91fbc0-baff-4df1-a581-7bb845067dca\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") "
Sep 11 21:19:24.184319 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184289    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgc98\" (UniqueName: \"kubernetes.io/projected/7d91fbc0-baff-4df1-a581-7bb845067dca-kube-api-access-wgc98\") pod \"7d91fbc0-baff-4df1-a581-7bb845067dca\" (UID: \"7d91fbc0-baff-4df1-a581-7bb845067dca\") "
Sep 11 21:19:24.184569 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-console-config" (OuterVolumeSpecName: "console-config") pod "7d91fbc0-baff-4df1-a581-7bb845067dca" (UID: "7d91fbc0-baff-4df1-a581-7bb845067dca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:24.184569 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184534    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d91fbc0-baff-4df1-a581-7bb845067dca" (UID: "7d91fbc0-baff-4df1-a581-7bb845067dca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:24.184957 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d91fbc0-baff-4df1-a581-7bb845067dca" (UID: "7d91fbc0-baff-4df1-a581-7bb845067dca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:24.184957 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184615    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d91fbc0-baff-4df1-a581-7bb845067dca" (UID: "7d91fbc0-baff-4df1-a581-7bb845067dca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:24.184957 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184615    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-console-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:24.184957 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.184661    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:24.186373 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.186352    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d91fbc0-baff-4df1-a581-7bb845067dca" (UID: "7d91fbc0-baff-4df1-a581-7bb845067dca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:24.186479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.186447    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d91fbc0-baff-4df1-a581-7bb845067dca" (UID: "7d91fbc0-baff-4df1-a581-7bb845067dca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:24.186544 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.186505    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d91fbc0-baff-4df1-a581-7bb845067dca-kube-api-access-wgc98" (OuterVolumeSpecName: "kube-api-access-wgc98") pod "7d91fbc0-baff-4df1-a581-7bb845067dca" (UID: "7d91fbc0-baff-4df1-a581-7bb845067dca"). InnerVolumeSpecName "kube-api-access-wgc98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:19:24.285523 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.285485    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-trusted-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:24.285523 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.285514    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d91fbc0-baff-4df1-a581-7bb845067dca-oauth-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:24.285523 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.285524    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgc98\" (UniqueName: \"kubernetes.io/projected/7d91fbc0-baff-4df1-a581-7bb845067dca-kube-api-access-wgc98\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:24.285523 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.285532    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:24.285779 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.285542    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d91fbc0-baff-4df1-a581-7bb845067dca-console-oauth-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:24.509643 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.509556    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d91fbc0-baff-4df1-a581-7bb845067dca" containerID="ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a" exitCode=0
Sep 11 21:19:24.509643 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.509598    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649d6f9969-2jh7t"
Sep 11 21:19:24.509888 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.509636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649d6f9969-2jh7t" event={"ID":"7d91fbc0-baff-4df1-a581-7bb845067dca","Type":"ContainerDied","Data":"ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a"}
Sep 11 21:19:24.509888 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.509693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649d6f9969-2jh7t" event={"ID":"7d91fbc0-baff-4df1-a581-7bb845067dca","Type":"ContainerDied","Data":"8d0874c82da4a7cd5518ddad80a34e4f1bec662c5807ef4f9dd8e19b18c55be0"}
Sep 11 21:19:24.509888 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.509720    2560 scope.go:117] "RemoveContainer" containerID="ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a"
Sep 11 21:19:24.518471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.518457    2560 scope.go:117] "RemoveContainer" containerID="ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a"
Sep 11 21:19:24.518719 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:19:24.518702    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a\": container with ID starting with ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a not found: ID does not exist" containerID="ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a"
Sep 11 21:19:24.518756 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.518727    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a"} err="failed to get container status \"ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a\": rpc error: code = NotFound desc = could not find container \"ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a\": container with ID starting with ded857a479db93698a38ffb5f7b7c76fcc19348eb53aa70d7cb478cc30b3079a not found: ID does not exist"
Sep 11 21:19:24.532006 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.531983    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649d6f9969-2jh7t"]
Sep 11 21:19:24.535578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.535557    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-649d6f9969-2jh7t"]
Sep 11 21:19:24.799909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:24.799818    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d91fbc0-baff-4df1-a581-7bb845067dca" path="/var/lib/kubelet/pods/7d91fbc0-baff-4df1-a581-7bb845067dca/volumes"
Sep 11 21:19:25.516027 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:25.516000    2560 generic.go:356] "Generic (PLEG): container finished" podID="029205bf-1e5e-4119-8a62-bb2640d621fb" containerID="e84624627452f6f93bf613cde0fa69cde1b310655ecd49b884be728f580b4b72" exitCode=0
Sep 11 21:19:25.516331 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:25.516040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tzww9" event={"ID":"029205bf-1e5e-4119-8a62-bb2640d621fb","Type":"ContainerDied","Data":"e84624627452f6f93bf613cde0fa69cde1b310655ecd49b884be728f580b4b72"}
Sep 11 21:19:25.516371 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:25.516339    2560 scope.go:117] "RemoveContainer" containerID="e84624627452f6f93bf613cde0fa69cde1b310655ecd49b884be728f580b4b72"
Sep 11 21:19:26.522208 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:26.522172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tzww9" event={"ID":"029205bf-1e5e-4119-8a62-bb2640d621fb","Type":"ContainerStarted","Data":"ec401856b3c32c55a778ae3269be43af6a14ee4c3bc892d29aa0cdac3ee1ed42"}
Sep 11 21:19:26.523639 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:26.523616    2560 generic.go:356] "Generic (PLEG): container finished" podID="0f29fd09-7f3a-434f-965e-71d5dabfdcf6" containerID="c91b59ebfd87e9ec0d007a9b727f94ef44a414c20d36564054d9439c805b2936" exitCode=0
Sep 11 21:19:26.523727 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:26.523669    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl" event={"ID":"0f29fd09-7f3a-434f-965e-71d5dabfdcf6","Type":"ContainerDied","Data":"c91b59ebfd87e9ec0d007a9b727f94ef44a414c20d36564054d9439c805b2936"}
Sep 11 21:19:26.523953 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:26.523940    2560 scope.go:117] "RemoveContainer" containerID="c91b59ebfd87e9ec0d007a9b727f94ef44a414c20d36564054d9439c805b2936"
Sep 11 21:19:27.529524 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:27.529492    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bwxsl" event={"ID":"0f29fd09-7f3a-434f-965e-71d5dabfdcf6","Type":"ContainerStarted","Data":"b68c2322752c2d2bbc04fff18eadb2e499eb02e0f2f375068aae609bf1d15e56"}
Sep 11 21:19:30.541899 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:30.541865    2560 generic.go:356] "Generic (PLEG): container finished" podID="eb9db64c-af22-4710-8074-5af2ac0687d3" containerID="0cfbc7cc7beedc192ecdb68b76aaae81a34afe27604546140e8cd815cffcf718" exitCode=0
Sep 11 21:19:30.542310 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:30.541952    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x" event={"ID":"eb9db64c-af22-4710-8074-5af2ac0687d3","Type":"ContainerDied","Data":"0cfbc7cc7beedc192ecdb68b76aaae81a34afe27604546140e8cd815cffcf718"}
Sep 11 21:19:30.542310 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:30.542292    2560 scope.go:117] "RemoveContainer" containerID="0cfbc7cc7beedc192ecdb68b76aaae81a34afe27604546140e8cd815cffcf718"
Sep 11 21:19:31.548061 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:31.548029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-gd94x" event={"ID":"eb9db64c-af22-4710-8074-5af2ac0687d3","Type":"ContainerStarted","Data":"62fbcd4cd980f3386be904204807c173656ab68d8444989cf18a0ee24272dee8"}
Sep 11 21:19:34.513137 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.513091    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68c95d444b-mgdcx" podUID="27c60e94-a264-48ee-8459-8facb8287df1" containerName="console" containerID="cri-o://280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047" gracePeriod=15
Sep 11 21:19:34.745182 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.745160    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:19:34.873750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.873725    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-console-config\") pod \"27c60e94-a264-48ee-8459-8facb8287df1\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") "
Sep 11 21:19:34.873750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.873753    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-service-ca\") pod \"27c60e94-a264-48ee-8459-8facb8287df1\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") "
Sep 11 21:19:34.874025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.873802    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-trusted-ca-bundle\") pod \"27c60e94-a264-48ee-8459-8facb8287df1\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") "
Sep 11 21:19:34.874025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.873994    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwb9g\" (UniqueName: \"kubernetes.io/projected/27c60e94-a264-48ee-8459-8facb8287df1-kube-api-access-mwb9g\") pod \"27c60e94-a264-48ee-8459-8facb8287df1\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") "
Sep 11 21:19:34.874144 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.874038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-serving-cert\") pod \"27c60e94-a264-48ee-8459-8facb8287df1\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") "
Sep 11 21:19:34.874144 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.874077    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-oauth-serving-cert\") pod \"27c60e94-a264-48ee-8459-8facb8287df1\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") "
Sep 11 21:19:34.874144 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.874103    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-oauth-config\") pod \"27c60e94-a264-48ee-8459-8facb8287df1\" (UID: \"27c60e94-a264-48ee-8459-8facb8287df1\") "
Sep 11 21:19:34.874273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.874181    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-console-config" (OuterVolumeSpecName: "console-config") pod "27c60e94-a264-48ee-8459-8facb8287df1" (UID: "27c60e94-a264-48ee-8459-8facb8287df1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:34.874273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.874192    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27c60e94-a264-48ee-8459-8facb8287df1" (UID: "27c60e94-a264-48ee-8459-8facb8287df1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:34.874590 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.874555    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-service-ca" (OuterVolumeSpecName: "service-ca") pod "27c60e94-a264-48ee-8459-8facb8287df1" (UID: "27c60e94-a264-48ee-8459-8facb8287df1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:34.874913 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.874885    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-console-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.875024 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.874914    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-trusted-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.877942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.876326    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27c60e94-a264-48ee-8459-8facb8287df1" (UID: "27c60e94-a264-48ee-8459-8facb8287df1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:34.879870 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.878138    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c60e94-a264-48ee-8459-8facb8287df1-kube-api-access-mwb9g" (OuterVolumeSpecName: "kube-api-access-mwb9g") pod "27c60e94-a264-48ee-8459-8facb8287df1" (UID: "27c60e94-a264-48ee-8459-8facb8287df1"). InnerVolumeSpecName "kube-api-access-mwb9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:19:34.880493 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.880461    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27c60e94-a264-48ee-8459-8facb8287df1" (UID: "27c60e94-a264-48ee-8459-8facb8287df1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:34.881634 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.881611    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27c60e94-a264-48ee-8459-8facb8287df1" (UID: "27c60e94-a264-48ee-8459-8facb8287df1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:34.975951 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.975929    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.975951 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.975949    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwb9g\" (UniqueName: \"kubernetes.io/projected/27c60e94-a264-48ee-8459-8facb8287df1-kube-api-access-mwb9g\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.976079 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.975959    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.976079 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.975968    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c60e94-a264-48ee-8459-8facb8287df1-oauth-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.976079 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:34.975975    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c60e94-a264-48ee-8459-8facb8287df1-console-oauth-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:19:35.564778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:35.564747    2560 generic.go:356] "Generic (PLEG): container finished" podID="27c60e94-a264-48ee-8459-8facb8287df1" containerID="280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047" exitCode=0
Sep 11 21:19:35.565184 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:35.564810    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c95d444b-mgdcx"
Sep 11 21:19:35.565184 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:35.564839    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c95d444b-mgdcx" event={"ID":"27c60e94-a264-48ee-8459-8facb8287df1","Type":"ContainerDied","Data":"280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047"}
Sep 11 21:19:35.565184 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:35.564903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c95d444b-mgdcx" event={"ID":"27c60e94-a264-48ee-8459-8facb8287df1","Type":"ContainerDied","Data":"3caca2d53222e07f84457b39f2d28a344e7429802920d0fd9fc7f2a75b84b30a"}
Sep 11 21:19:35.565184 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:35.564924    2560 scope.go:117] "RemoveContainer" containerID="280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047"
Sep 11 21:19:35.573570 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:35.573553    2560 scope.go:117] "RemoveContainer" containerID="280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047"
Sep 11 21:19:35.573874 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:19:35.573848    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047\": container with ID starting with 280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047 not found: ID does not exist" containerID="280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047"
Sep 11 21:19:35.573979 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:35.573880    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047"} err="failed to get container status \"280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047\": rpc error: code = NotFound desc = could not find container \"280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047\": container with ID starting with 280f1160c2c4eaddd78b5e8aa87999c15dbbd69a040f93846e9a56a30ef7e047 not found: ID does not exist"
Sep 11 21:19:35.586101 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:35.586078    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c95d444b-mgdcx"]
Sep 11 21:19:35.591235 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:35.591214    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68c95d444b-mgdcx"]
Sep 11 21:19:36.799861 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:36.799808    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27c60e94-a264-48ee-8459-8facb8287df1" path="/var/lib/kubelet/pods/27c60e94-a264-48ee-8459-8facb8287df1/volumes"
Sep 11 21:19:50.307312 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:50.307272    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:19:50.323316 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:50.323290    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:19:50.656636 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:19:50.656607    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:03.997625 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:03.997586    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:20:03.998140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:03.997891    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="alertmanager" containerID="cri-o://7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d" gracePeriod=120
Sep 11 21:20:03.998140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:03.997960    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy-metric" containerID="cri-o://eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2" gracePeriod=120
Sep 11 21:20:03.998140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:03.998049    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy" containerID="cri-o://6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a" gracePeriod=120
Sep 11 21:20:03.998140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:03.998063    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="config-reloader" containerID="cri-o://a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb" gracePeriod=120
Sep 11 21:20:03.998140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:03.998085    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy-web" containerID="cri-o://aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665" gracePeriod=120
Sep 11 21:20:03.998417 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:03.998136    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="prom-label-proxy" containerID="cri-o://5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab" gracePeriod=120
Sep 11 21:20:04.697337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:04.697305    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerID="5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab" exitCode=0
Sep 11 21:20:04.697337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:04.697330    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerID="6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a" exitCode=0
Sep 11 21:20:04.697337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:04.697337    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerID="a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb" exitCode=0
Sep 11 21:20:04.697337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:04.697342    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerID="7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d" exitCode=0
Sep 11 21:20:04.697596 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:04.697362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerDied","Data":"5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab"}
Sep 11 21:20:04.697596 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:04.697409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerDied","Data":"6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a"}
Sep 11 21:20:04.697596 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:04.697436    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerDied","Data":"a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb"}
Sep 11 21:20:04.697596 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:04.697460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerDied","Data":"7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d"}
Sep 11 21:20:05.239634 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.239609    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.334109 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334083    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-tls-assets\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334129    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334158    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-out\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334195    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-trusted-ca-bundle\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334221    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-metrics-client-ca\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-cluster-tls-config\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334261    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nqjj\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-kube-api-access-8nqjj\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334308    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-main-db\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334335    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-main-tls\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-web-config\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334408    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-volume\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334430    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy\") pod \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\" (UID: \"fa6e7858-c26e-4c7b-8f6d-18a8374722d9\") "
Sep 11 21:20:05.334926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334618    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:05.334926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334630    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:05.334926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334774    2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.334926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.334793    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-metrics-client-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.335484 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.335164    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:05.337263 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.337229    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-out" (OuterVolumeSpecName: "config-out") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:05.337594 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.337558    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:05.337799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.337774    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:05.338108 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.338082    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-volume" (OuterVolumeSpecName: "config-volume") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:05.338251 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.338224    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-kube-api-access-8nqjj" (OuterVolumeSpecName: "kube-api-access-8nqjj") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "kube-api-access-8nqjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:05.338525 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.338506    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:05.338961 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.338942    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:05.339430 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.339408    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:05.342251 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.342144    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:05.348533 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.348515    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-web-config" (OuterVolumeSpecName: "web-config") pod "fa6e7858-c26e-4c7b-8f6d-18a8374722d9" (UID: "fa6e7858-c26e-4c7b-8f6d-18a8374722d9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:05.435778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435730    2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-cluster-tls-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.435778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435774    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nqjj\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-kube-api-access-8nqjj\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.435778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435787    2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-alertmanager-main-db\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.436045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435800    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-main-tls\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.436045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435813    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-web-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.436045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435850    2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.436045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435863    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.436045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435876    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.436045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435888    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-tls-assets\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.436045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435899    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.436045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.435911    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa6e7858-c26e-4c7b-8f6d-18a8374722d9-config-out\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:05.704211 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.704128    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerID="eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2" exitCode=0
Sep 11 21:20:05.704211 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.704152    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerID="aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665" exitCode=0
Sep 11 21:20:05.704435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.704209    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerDied","Data":"eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2"}
Sep 11 21:20:05.704435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.704239    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.704435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.704303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerDied","Data":"aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665"}
Sep 11 21:20:05.704435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.704329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa6e7858-c26e-4c7b-8f6d-18a8374722d9","Type":"ContainerDied","Data":"108fc540c89f3f342cd63ce0dc382aada592ea7f49701b849207d9adac0e544a"}
Sep 11 21:20:05.704435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.704359    2560 scope.go:117] "RemoveContainer" containerID="5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab"
Sep 11 21:20:05.712874 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.712855    2560 scope.go:117] "RemoveContainer" containerID="eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2"
Sep 11 21:20:05.720044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.720029    2560 scope.go:117] "RemoveContainer" containerID="6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a"
Sep 11 21:20:05.727721 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.727699    2560 scope.go:117] "RemoveContainer" containerID="aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665"
Sep 11 21:20:05.727881 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.727845    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:20:05.731665 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.731640    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:20:05.735632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.735614    2560 scope.go:117] "RemoveContainer" containerID="a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb"
Sep 11 21:20:05.742468 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.742452    2560 scope.go:117] "RemoveContainer" containerID="7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d"
Sep 11 21:20:05.749373 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.749356    2560 scope.go:117] "RemoveContainer" containerID="ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a"
Sep 11 21:20:05.756761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.756736    2560 scope.go:117] "RemoveContainer" containerID="5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab"
Sep 11 21:20:05.757073 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:05.757053    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab\": container with ID starting with 5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab not found: ID does not exist" containerID="5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab"
Sep 11 21:20:05.757136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.757082    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab"} err="failed to get container status \"5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab\": rpc error: code = NotFound desc = could not find container \"5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab\": container with ID starting with 5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab not found: ID does not exist"
Sep 11 21:20:05.757136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.757100    2560 scope.go:117] "RemoveContainer" containerID="eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2"
Sep 11 21:20:05.757360 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:05.757342    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2\": container with ID starting with eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2 not found: ID does not exist" containerID="eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2"
Sep 11 21:20:05.757477 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.757370    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2"} err="failed to get container status \"eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2\": rpc error: code = NotFound desc = could not find container \"eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2\": container with ID starting with eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2 not found: ID does not exist"
Sep 11 21:20:05.757477 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.757394    2560 scope.go:117] "RemoveContainer" containerID="6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a"
Sep 11 21:20:05.757683 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:05.757666    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a\": container with ID starting with 6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a not found: ID does not exist" containerID="6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a"
Sep 11 21:20:05.757720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.757690    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a"} err="failed to get container status \"6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a\": rpc error: code = NotFound desc = could not find container \"6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a\": container with ID starting with 6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a not found: ID does not exist"
Sep 11 21:20:05.757720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.757706    2560 scope.go:117] "RemoveContainer" containerID="aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665"
Sep 11 21:20:05.757994 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:05.757974    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665\": container with ID starting with aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665 not found: ID does not exist" containerID="aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665"
Sep 11 21:20:05.758071 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.758002    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665"} err="failed to get container status \"aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665\": rpc error: code = NotFound desc = could not find container \"aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665\": container with ID starting with aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665 not found: ID does not exist"
Sep 11 21:20:05.758071 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.758024    2560 scope.go:117] "RemoveContainer" containerID="a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb"
Sep 11 21:20:05.758260 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:05.758246    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb\": container with ID starting with a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb not found: ID does not exist" containerID="a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb"
Sep 11 21:20:05.758318 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.758266    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb"} err="failed to get container status \"a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb\": rpc error: code = NotFound desc = could not find container \"a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb\": container with ID starting with a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb not found: ID does not exist"
Sep 11 21:20:05.758318 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.758285    2560 scope.go:117] "RemoveContainer" containerID="7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d"
Sep 11 21:20:05.758517 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:05.758502    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d\": container with ID starting with 7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d not found: ID does not exist" containerID="7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d"
Sep 11 21:20:05.758554 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.758520    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d"} err="failed to get container status \"7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d\": rpc error: code = NotFound desc = could not find container \"7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d\": container with ID starting with 7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d not found: ID does not exist"
Sep 11 21:20:05.758554 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.758535    2560 scope.go:117] "RemoveContainer" containerID="ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a"
Sep 11 21:20:05.758770 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:05.758754    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a\": container with ID starting with ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a not found: ID does not exist" containerID="ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a"
Sep 11 21:20:05.758811 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.758775    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a"} err="failed to get container status \"ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a\": rpc error: code = NotFound desc = could not find container \"ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a\": container with ID starting with ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a not found: ID does not exist"
Sep 11 21:20:05.758811 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.758787    2560 scope.go:117] "RemoveContainer" containerID="5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab"
Sep 11 21:20:05.759042 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759025    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab"} err="failed to get container status \"5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab\": rpc error: code = NotFound desc = could not find container \"5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab\": container with ID starting with 5ff1dcbf5163f939789f13fcf48db88c57bf4eabff0da378ef17d8cf92f932ab not found: ID does not exist"
Sep 11 21:20:05.759109 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759043    2560 scope.go:117] "RemoveContainer" containerID="eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2"
Sep 11 21:20:05.759285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759268    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2"} err="failed to get container status \"eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2\": rpc error: code = NotFound desc = could not find container \"eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2\": container with ID starting with eb0842e172f26dd339b3f86cb87432cf1823d5be1fc84941da15c8523dd2d2d2 not found: ID does not exist"
Sep 11 21:20:05.759329 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759285    2560 scope.go:117] "RemoveContainer" containerID="6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a"
Sep 11 21:20:05.759511 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759495    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a"} err="failed to get container status \"6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a\": rpc error: code = NotFound desc = could not find container \"6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a\": container with ID starting with 6228f092bba0b765a6506feb9e6c4b32bd9c7421796d10431f8fff50bf7e561a not found: ID does not exist"
Sep 11 21:20:05.759554 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759513    2560 scope.go:117] "RemoveContainer" containerID="aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665"
Sep 11 21:20:05.759724 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759705    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665"} err="failed to get container status \"aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665\": rpc error: code = NotFound desc = could not find container \"aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665\": container with ID starting with aaba6a74bfbd04a0c45223156e8c040265098dd8cdf7b885ced23902024cc665 not found: ID does not exist"
Sep 11 21:20:05.759784 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759726    2560 scope.go:117] "RemoveContainer" containerID="a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb"
Sep 11 21:20:05.759964 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759947    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb"} err="failed to get container status \"a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb\": rpc error: code = NotFound desc = could not find container \"a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb\": container with ID starting with a37c38a6a09266e22285674a50c1b855069ab894dbcb38995e6cef85a1a5e6eb not found: ID does not exist"
Sep 11 21:20:05.760015 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.759965    2560 scope.go:117] "RemoveContainer" containerID="7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d"
Sep 11 21:20:05.760188 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.760171    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d"} err="failed to get container status \"7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d\": rpc error: code = NotFound desc = could not find container \"7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d\": container with ID starting with 7ae6533747490eee69aba9aaf43cf12ccec3531dacb47f1d544c23f96f61766d not found: ID does not exist"
Sep 11 21:20:05.760230 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.760189    2560 scope.go:117] "RemoveContainer" containerID="ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a"
Sep 11 21:20:05.760465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:05.760435    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a"} err="failed to get container status \"ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a\": rpc error: code = NotFound desc = could not find container \"ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a\": container with ID starting with ced19908ad7bc4e74447f6249ad12c069a6400bf36715acc128e4f98cc90cf7a not found: ID does not exist"
Sep 11 21:20:06.799289 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:06.799255    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" path="/var/lib/kubelet/pods/fa6e7858-c26e-4c7b-8f6d-18a8374722d9/volumes"
Sep 11 21:20:08.243461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.243423    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:20:08.243922 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.243706    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="prometheus" containerID="cri-o://c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476" gracePeriod=600
Sep 11 21:20:08.243922 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.243732    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy" containerID="cri-o://b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79" gracePeriod=600
Sep 11 21:20:08.243922 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.243780    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="config-reloader" containerID="cri-o://ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b" gracePeriod=600
Sep 11 21:20:08.243922 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.243792    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy-thanos" containerID="cri-o://82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9" gracePeriod=600
Sep 11 21:20:08.243922 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.243732    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="thanos-sidecar" containerID="cri-o://6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b" gracePeriod=600
Sep 11 21:20:08.243922 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.243800    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy-web" containerID="cri-o://65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778" gracePeriod=600
Sep 11 21:20:08.487583 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.487560    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.564093 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564012    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-kube-rbac-proxy\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564093 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564057    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-trusted-ca-bundle\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564093 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564076    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564353 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564104    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-tls\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564353 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564131    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-metrics-client-ca\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564353 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564239    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-thanos-prometheus-http-client-file\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564353 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564294    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-web-config\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564353 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564329    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-2\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564366    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-metrics-client-certs\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564399    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-db\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564442    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-kubelet-serving-ca-bundle\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-grpc-tls\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564482    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564512    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-tls-assets\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564517    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564536    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-config-out\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564575    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-config\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.564610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564609    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-serving-certs-ca-bundle\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.565246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564726    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkxfc\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-kube-api-access-gkxfc\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.565246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564757    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:08.565246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564763    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-1\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.565246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564793    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-0\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.565246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.564839    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a7198b93-d4eb-402b-82cc-baa6b7906589\" (UID: \"a7198b93-d4eb-402b-82cc-baa6b7906589\") "
Sep 11 21:20:08.565246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.565058    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.565246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.565077    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-metrics-client-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.565246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.565091    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.565778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.565749    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:08.568041 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.566924    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:08.568451 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.568296    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:08.568451 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.568333    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:08.568602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.568574    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:08.568882 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.568807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:08.568996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.568923    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:08.568996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.568925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:08.569330 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.569009    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:08.569665 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.569496    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:08.569665 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.569563    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:08.569665 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.569617    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:08.569886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.569688    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-config-out" (OuterVolumeSpecName: "config-out") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:08.570729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.570706    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-kube-api-access-gkxfc" (OuterVolumeSpecName: "kube-api-access-gkxfc") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "kube-api-access-gkxfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:08.570904 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.570867    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-config" (OuterVolumeSpecName: "config") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:08.570984 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.570898    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:08.579050 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.579025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-web-config" (OuterVolumeSpecName: "web-config") pod "a7198b93-d4eb-402b-82cc-baa6b7906589" (UID: "a7198b93-d4eb-402b-82cc-baa6b7906589"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:08.665940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.665908    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.665940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.665939    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkxfc\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-kube-api-access-gkxfc\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.665950    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.665958    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.665967    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.665975    2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-kube-rbac-proxy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.665983    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.665993    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.666001    2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.666012    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-web-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.666019    2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-metrics-client-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.666027    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-prometheus-k8s-db\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.666035    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7198b93-d4eb-402b-82cc-baa6b7906589-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.666044    2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-secret-grpc-tls\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.666052    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7198b93-d4eb-402b-82cc-baa6b7906589-tls-assets\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.666059    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7198b93-d4eb-402b-82cc-baa6b7906589-config-out\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.666080 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.666066    2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7198b93-d4eb-402b-82cc-baa6b7906589-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:08.719872 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.719841    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerID="82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9" exitCode=0
Sep 11 21:20:08.719872 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.719864    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerID="b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79" exitCode=0
Sep 11 21:20:08.719872 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.719871    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerID="65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778" exitCode=0
Sep 11 21:20:08.719872 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.719877    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerID="6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b" exitCode=0
Sep 11 21:20:08.720074 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.719882    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerID="ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b" exitCode=0
Sep 11 21:20:08.720074 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.719887    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerID="c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476" exitCode=0
Sep 11 21:20:08.720074 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.719928    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.720074 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.719928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerDied","Data":"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"}
Sep 11 21:20:08.720074 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.720014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerDied","Data":"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"}
Sep 11 21:20:08.720074 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.720057    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerDied","Data":"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"}
Sep 11 21:20:08.720272 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.720080    2560 scope.go:117] "RemoveContainer" containerID="82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"
Sep 11 21:20:08.720272 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.720102    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerDied","Data":"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"}
Sep 11 21:20:08.720272 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.720144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerDied","Data":"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"}
Sep 11 21:20:08.720272 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.720186    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerDied","Data":"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"}
Sep 11 21:20:08.720272 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.720226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7198b93-d4eb-402b-82cc-baa6b7906589","Type":"ContainerDied","Data":"978ce94b737e82309b83b6a6546f5259c877dab321cb693e577ab69747814d8c"}
Sep 11 21:20:08.727765 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.727535    2560 scope.go:117] "RemoveContainer" containerID="b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"
Sep 11 21:20:08.734494 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.734476    2560 scope.go:117] "RemoveContainer" containerID="65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"
Sep 11 21:20:08.742922 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.742902    2560 scope.go:117] "RemoveContainer" containerID="6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"
Sep 11 21:20:08.747008 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.746985    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:20:08.749894 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.749877    2560 scope.go:117] "RemoveContainer" containerID="ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"
Sep 11 21:20:08.756490 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.756473    2560 scope.go:117] "RemoveContainer" containerID="c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"
Sep 11 21:20:08.757935 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.757914    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:20:08.763377 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.763349    2560 scope.go:117] "RemoveContainer" containerID="76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"
Sep 11 21:20:08.769603 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.769586    2560 scope.go:117] "RemoveContainer" containerID="82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"
Sep 11 21:20:08.769863 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:08.769846    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": container with ID starting with 82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9 not found: ID does not exist" containerID="82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"
Sep 11 21:20:08.769935 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.769869    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"} err="failed to get container status \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": rpc error: code = NotFound desc = could not find container \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": container with ID starting with 82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9 not found: ID does not exist"
Sep 11 21:20:08.769935 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.769892    2560 scope.go:117] "RemoveContainer" containerID="b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"
Sep 11 21:20:08.770143 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:08.770125    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": container with ID starting with b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79 not found: ID does not exist" containerID="b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"
Sep 11 21:20:08.770183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.770148    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"} err="failed to get container status \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": rpc error: code = NotFound desc = could not find container \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": container with ID starting with b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79 not found: ID does not exist"
Sep 11 21:20:08.770183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.770164    2560 scope.go:117] "RemoveContainer" containerID="65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"
Sep 11 21:20:08.770391 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:08.770369    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": container with ID starting with 65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778 not found: ID does not exist" containerID="65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"
Sep 11 21:20:08.770433 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.770394    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"} err="failed to get container status \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": rpc error: code = NotFound desc = could not find container \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": container with ID starting with 65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778 not found: ID does not exist"
Sep 11 21:20:08.770433 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.770413    2560 scope.go:117] "RemoveContainer" containerID="6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"
Sep 11 21:20:08.770616 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:08.770598    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": container with ID starting with 6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b not found: ID does not exist" containerID="6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"
Sep 11 21:20:08.770655 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.770621    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"} err="failed to get container status \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": rpc error: code = NotFound desc = could not find container \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": container with ID starting with 6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b not found: ID does not exist"
Sep 11 21:20:08.770655 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.770636    2560 scope.go:117] "RemoveContainer" containerID="ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"
Sep 11 21:20:08.770871 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:08.770851    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": container with ID starting with ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b not found: ID does not exist" containerID="ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"
Sep 11 21:20:08.770933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.770875    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"} err="failed to get container status \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": rpc error: code = NotFound desc = could not find container \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": container with ID starting with ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b not found: ID does not exist"
Sep 11 21:20:08.770933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.770888    2560 scope.go:117] "RemoveContainer" containerID="c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"
Sep 11 21:20:08.771102 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:08.771088    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": container with ID starting with c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476 not found: ID does not exist" containerID="c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"
Sep 11 21:20:08.771156 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.771107    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"} err="failed to get container status \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": rpc error: code = NotFound desc = could not find container \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": container with ID starting with c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476 not found: ID does not exist"
Sep 11 21:20:08.771156 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.771118    2560 scope.go:117] "RemoveContainer" containerID="76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"
Sep 11 21:20:08.771348 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:08.771333    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": container with ID starting with 76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7 not found: ID does not exist" containerID="76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"
Sep 11 21:20:08.771380 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.771351    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"} err="failed to get container status \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": rpc error: code = NotFound desc = could not find container \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": container with ID starting with 76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7 not found: ID does not exist"
Sep 11 21:20:08.771380 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.771362    2560 scope.go:117] "RemoveContainer" containerID="82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"
Sep 11 21:20:08.771577 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.771555    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"} err="failed to get container status \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": rpc error: code = NotFound desc = could not find container \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": container with ID starting with 82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9 not found: ID does not exist"
Sep 11 21:20:08.771577 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.771577    2560 scope.go:117] "RemoveContainer" containerID="b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"
Sep 11 21:20:08.771809 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.771791    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"} err="failed to get container status \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": rpc error: code = NotFound desc = could not find container \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": container with ID starting with b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79 not found: ID does not exist"
Sep 11 21:20:08.771809 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.771808    2560 scope.go:117] "RemoveContainer" containerID="65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"
Sep 11 21:20:08.772033 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772017    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"} err="failed to get container status \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": rpc error: code = NotFound desc = could not find container \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": container with ID starting with 65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778 not found: ID does not exist"
Sep 11 21:20:08.772072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772034    2560 scope.go:117] "RemoveContainer" containerID="6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"
Sep 11 21:20:08.772257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772242    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"} err="failed to get container status \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": rpc error: code = NotFound desc = could not find container \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": container with ID starting with 6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b not found: ID does not exist"
Sep 11 21:20:08.772307 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772257    2560 scope.go:117] "RemoveContainer" containerID="ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"
Sep 11 21:20:08.772438 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772423    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"} err="failed to get container status \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": rpc error: code = NotFound desc = could not find container \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": container with ID starting with ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b not found: ID does not exist"
Sep 11 21:20:08.772478 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772437    2560 scope.go:117] "RemoveContainer" containerID="c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"
Sep 11 21:20:08.772652 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772637    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"} err="failed to get container status \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": rpc error: code = NotFound desc = could not find container \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": container with ID starting with c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476 not found: ID does not exist"
Sep 11 21:20:08.772690 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772651    2560 scope.go:117] "RemoveContainer" containerID="76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"
Sep 11 21:20:08.772844 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772813    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"} err="failed to get container status \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": rpc error: code = NotFound desc = could not find container \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": container with ID starting with 76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7 not found: ID does not exist"
Sep 11 21:20:08.772891 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.772844    2560 scope.go:117] "RemoveContainer" containerID="82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"
Sep 11 21:20:08.773049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773034    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"} err="failed to get container status \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": rpc error: code = NotFound desc = could not find container \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": container with ID starting with 82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9 not found: ID does not exist"
Sep 11 21:20:08.773104 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773049    2560 scope.go:117] "RemoveContainer" containerID="b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"
Sep 11 21:20:08.773274 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773259    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"} err="failed to get container status \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": rpc error: code = NotFound desc = could not find container \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": container with ID starting with b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79 not found: ID does not exist"
Sep 11 21:20:08.773274 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773273    2560 scope.go:117] "RemoveContainer" containerID="65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"
Sep 11 21:20:08.773487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773472    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"} err="failed to get container status \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": rpc error: code = NotFound desc = could not find container \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": container with ID starting with 65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778 not found: ID does not exist"
Sep 11 21:20:08.773527 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773488    2560 scope.go:117] "RemoveContainer" containerID="6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"
Sep 11 21:20:08.773699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773683    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"} err="failed to get container status \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": rpc error: code = NotFound desc = could not find container \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": container with ID starting with 6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b not found: ID does not exist"
Sep 11 21:20:08.773699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773698    2560 scope.go:117] "RemoveContainer" containerID="ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"
Sep 11 21:20:08.773888 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773871    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"} err="failed to get container status \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": rpc error: code = NotFound desc = could not find container \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": container with ID starting with ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b not found: ID does not exist"
Sep 11 21:20:08.773944 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.773889    2560 scope.go:117] "RemoveContainer" containerID="c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"
Sep 11 21:20:08.774098 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774082    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"} err="failed to get container status \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": rpc error: code = NotFound desc = could not find container \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": container with ID starting with c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476 not found: ID does not exist"
Sep 11 21:20:08.774135 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774098    2560 scope.go:117] "RemoveContainer" containerID="76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"
Sep 11 21:20:08.774284 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774269    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"} err="failed to get container status \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": rpc error: code = NotFound desc = could not find container \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": container with ID starting with 76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7 not found: ID does not exist"
Sep 11 21:20:08.774324 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774284    2560 scope.go:117] "RemoveContainer" containerID="82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"
Sep 11 21:20:08.774465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774450    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"} err="failed to get container status \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": rpc error: code = NotFound desc = could not find container \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": container with ID starting with 82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9 not found: ID does not exist"
Sep 11 21:20:08.774506 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774466    2560 scope.go:117] "RemoveContainer" containerID="b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"
Sep 11 21:20:08.774668 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774645    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"} err="failed to get container status \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": rpc error: code = NotFound desc = could not find container \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": container with ID starting with b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79 not found: ID does not exist"
Sep 11 21:20:08.774712 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774671    2560 scope.go:117] "RemoveContainer" containerID="65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"
Sep 11 21:20:08.774877 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774858    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"} err="failed to get container status \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": rpc error: code = NotFound desc = could not find container \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": container with ID starting with 65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778 not found: ID does not exist"
Sep 11 21:20:08.774921 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.774878    2560 scope.go:117] "RemoveContainer" containerID="6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"
Sep 11 21:20:08.775067 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775052    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"} err="failed to get container status \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": rpc error: code = NotFound desc = could not find container \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": container with ID starting with 6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b not found: ID does not exist"
Sep 11 21:20:08.775110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775067    2560 scope.go:117] "RemoveContainer" containerID="ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"
Sep 11 21:20:08.775269 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775254    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"} err="failed to get container status \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": rpc error: code = NotFound desc = could not find container \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": container with ID starting with ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b not found: ID does not exist"
Sep 11 21:20:08.775309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775269    2560 scope.go:117] "RemoveContainer" containerID="c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"
Sep 11 21:20:08.775468 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775447    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"} err="failed to get container status \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": rpc error: code = NotFound desc = could not find container \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": container with ID starting with c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476 not found: ID does not exist"
Sep 11 21:20:08.775509 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775468    2560 scope.go:117] "RemoveContainer" containerID="76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"
Sep 11 21:20:08.775632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775614    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"} err="failed to get container status \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": rpc error: code = NotFound desc = could not find container \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": container with ID starting with 76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7 not found: ID does not exist"
Sep 11 21:20:08.775675 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775633    2560 scope.go:117] "RemoveContainer" containerID="82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"
Sep 11 21:20:08.775836 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775807    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"} err="failed to get container status \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": rpc error: code = NotFound desc = could not find container \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": container with ID starting with 82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9 not found: ID does not exist"
Sep 11 21:20:08.775875 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.775846    2560 scope.go:117] "RemoveContainer" containerID="b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"
Sep 11 21:20:08.776104 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.776085    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"} err="failed to get container status \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": rpc error: code = NotFound desc = could not find container \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": container with ID starting with b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79 not found: ID does not exist"
Sep 11 21:20:08.776170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.776105    2560 scope.go:117] "RemoveContainer" containerID="65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"
Sep 11 21:20:08.776380 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.776363    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"} err="failed to get container status \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": rpc error: code = NotFound desc = could not find container \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": container with ID starting with 65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778 not found: ID does not exist"
Sep 11 21:20:08.776440 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.776382    2560 scope.go:117] "RemoveContainer" containerID="6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"
Sep 11 21:20:08.776602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.776583    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"} err="failed to get container status \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": rpc error: code = NotFound desc = could not find container \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": container with ID starting with 6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b not found: ID does not exist"
Sep 11 21:20:08.776642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.776604    2560 scope.go:117] "RemoveContainer" containerID="ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"
Sep 11 21:20:08.776817 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.776799    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"} err="failed to get container status \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": rpc error: code = NotFound desc = could not find container \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": container with ID starting with ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b not found: ID does not exist"
Sep 11 21:20:08.776884 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.776817    2560 scope.go:117] "RemoveContainer" containerID="c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"
Sep 11 21:20:08.777074 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777058    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"} err="failed to get container status \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": rpc error: code = NotFound desc = could not find container \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": container with ID starting with c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476 not found: ID does not exist"
Sep 11 21:20:08.777126 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777075    2560 scope.go:117] "RemoveContainer" containerID="76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"
Sep 11 21:20:08.777277 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777262    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"} err="failed to get container status \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": rpc error: code = NotFound desc = could not find container \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": container with ID starting with 76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7 not found: ID does not exist"
Sep 11 21:20:08.777337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777277    2560 scope.go:117] "RemoveContainer" containerID="82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"
Sep 11 21:20:08.777479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777461    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9"} err="failed to get container status \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": rpc error: code = NotFound desc = could not find container \"82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9\": container with ID starting with 82e660a7728601452d909069631715a5bf18314e7e50cd03f1c166fa17e001c9 not found: ID does not exist"
Sep 11 21:20:08.777479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777477    2560 scope.go:117] "RemoveContainer" containerID="b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"
Sep 11 21:20:08.777729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777711    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79"} err="failed to get container status \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": rpc error: code = NotFound desc = could not find container \"b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79\": container with ID starting with b76a6ad6f46c71264c57f6d6aea6b4aa1d1049aad78e1636e97c23476be23f79 not found: ID does not exist"
Sep 11 21:20:08.777779 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777730    2560 scope.go:117] "RemoveContainer" containerID="65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"
Sep 11 21:20:08.777989 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777967    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778"} err="failed to get container status \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": rpc error: code = NotFound desc = could not find container \"65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778\": container with ID starting with 65897167659e53c140a40babe56e1ec797f3a9a790d42490a7f34d1252f34778 not found: ID does not exist"
Sep 11 21:20:08.778043 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.777992    2560 scope.go:117] "RemoveContainer" containerID="6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"
Sep 11 21:20:08.778223 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.778205    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b"} err="failed to get container status \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": rpc error: code = NotFound desc = could not find container \"6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b\": container with ID starting with 6cfcee23263de72821cdfe9be18100c1c7c8ebbcd372d83237b4e5fec2c3985b not found: ID does not exist"
Sep 11 21:20:08.778297 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.778224    2560 scope.go:117] "RemoveContainer" containerID="ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"
Sep 11 21:20:08.778440 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.778425    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b"} err="failed to get container status \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": rpc error: code = NotFound desc = could not find container \"ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b\": container with ID starting with ce029049daed7e34b6b0d765eef83694454c7c0a5e375937eb334ea83a298e6b not found: ID does not exist"
Sep 11 21:20:08.778490 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.778441    2560 scope.go:117] "RemoveContainer" containerID="c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"
Sep 11 21:20:08.778708 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.778690    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476"} err="failed to get container status \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": rpc error: code = NotFound desc = could not find container \"c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476\": container with ID starting with c2e7c567234a64f86cd0916ebf8791592a288a2e6facc5fb10e23ea108e32476 not found: ID does not exist"
Sep 11 21:20:08.778749 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.778710    2560 scope.go:117] "RemoveContainer" containerID="76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"
Sep 11 21:20:08.779014 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.778992    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7"} err="failed to get container status \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": rpc error: code = NotFound desc = could not find container \"76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7\": container with ID starting with 76e4776990e6fb35a5516b9cdbbb017c1e90d66c2878268b9f6b6aad35e8a4b7 not found: ID does not exist"
Sep 11 21:20:08.791323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791280    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:20:08.791516 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791504    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d91fbc0-baff-4df1-a581-7bb845067dca" containerName="console"
Sep 11 21:20:08.791556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791517    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d91fbc0-baff-4df1-a581-7bb845067dca" containerName="console"
Sep 11 21:20:08.791556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791526    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="init-config-reloader"
Sep 11 21:20:08.791556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791531    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="init-config-reloader"
Sep 11 21:20:08.791556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791541    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="prom-label-proxy"
Sep 11 21:20:08.791556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791546    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="prom-label-proxy"
Sep 11 21:20:08.791556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791552    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" containerName="console"
Sep 11 21:20:08.791556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791557    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" containerName="console"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791562    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy-metric"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791568    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy-metric"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791574    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy-web"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791579    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy-web"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791585    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="thanos-sidecar"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791590    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="thanos-sidecar"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791597    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="prometheus"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791602    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="prometheus"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791609    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="config-reloader"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791613    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="config-reloader"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791619    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy-thanos"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791623    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy-thanos"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791629    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791634    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791639    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="init-config-reloader"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791643    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="init-config-reloader"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791650    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy-web"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791654    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy-web"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791661    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c60e94-a264-48ee-8459-8facb8287df1" containerName="console"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791665    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c60e94-a264-48ee-8459-8facb8287df1" containerName="console"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791669    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="alertmanager"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791674    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="alertmanager"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791678    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="config-reloader"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791682    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="config-reloader"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791687    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791691    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791729    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="config-reloader"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791735    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy-thanos"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791740    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="27c60e94-a264-48ee-8459-8facb8287df1" containerName="console"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791746    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="config-reloader"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791750    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="alertmanager"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791757    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="prom-label-proxy"
Sep 11 21:20:08.791748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791763    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy-web"
Sep 11 21:20:08.792659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791768    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="prometheus"
Sep 11 21:20:08.792659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791773    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcb6e5c1-d8ef-48aa-aba7-3dd508be2b77" containerName="console"
Sep 11 21:20:08.792659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791777    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy-metric"
Sep 11 21:20:08.792659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791783    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy-web"
Sep 11 21:20:08.792659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791787    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6e7858-c26e-4c7b-8f6d-18a8374722d9" containerName="kube-rbac-proxy"
Sep 11 21:20:08.792659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791792    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d91fbc0-baff-4df1-a581-7bb845067dca" containerName="console"
Sep 11 21:20:08.792659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791796    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="thanos-sidecar"
Sep 11 21:20:08.792659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.791800    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" containerName="kube-rbac-proxy"
Sep 11 21:20:08.796555 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.796534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.799406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.799391    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 21:20:08.801256 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.801203    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7198b93-d4eb-402b-82cc-baa6b7906589" path="/var/lib/kubelet/pods/a7198b93-d4eb-402b-82cc-baa6b7906589/volumes"
Sep 11 21:20:08.801426 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.801412    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 21:20:08.801685 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.801667    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 21:20:08.805386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.802418    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 21:20:08.805386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.803563    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 21:20:08.805386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.804879    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 21:20:08.805386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.805093    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2bdtt\""
Sep 11 21:20:08.805386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.805122    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 21:20:08.805685 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.805643    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-75bkjcob5gahd\""
Sep 11 21:20:08.805856 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.805815    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 21:20:08.805929 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.805880    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 21:20:08.806082 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.806066    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 21:20:08.807671 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.806523    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 21:20:08.807671 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.806620    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 21:20:08.807671 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.806946    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 21:20:08.810572 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.810550    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 21:20:08.811102 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.811087    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 21:20:08.824349 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.824331    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:20:08.867761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzj9q\" (UniqueName: \"kubernetes.io/projected/8b1a56be-033f-4e3c-bc98-b98d238379bd-kube-api-access-qzj9q\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.867942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.867942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.867942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-web-config\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.867942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b1a56be-033f-4e3c-bc98-b98d238379bd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.867942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.867942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.867942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-config\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.867991    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.868006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.868060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.868081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.868103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.868148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.868181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b1a56be-033f-4e3c-bc98-b98d238379bd-config-out\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.868201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.868215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.868252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.868238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969243 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969243 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-config\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.969774 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970013 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b1a56be-033f-4e3c-bc98-b98d238379bd-config-out\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970100    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970292    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970334    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzj9q\" (UniqueName: \"kubernetes.io/projected/8b1a56be-033f-4e3c-bc98-b98d238379bd-kube-api-access-qzj9q\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-web-config\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b1a56be-033f-4e3c-bc98-b98d238379bd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.970890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.970664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.971636 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.971608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.972851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.972285    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.972851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.972577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.972851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.969951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.972851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.972580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.974199 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.973133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b1a56be-033f-4e3c-bc98-b98d238379bd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.974199 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.973440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.974199 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.973760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.974199 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.974146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.974491 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.974469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-config\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.974734 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.974717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b1a56be-033f-4e3c-bc98-b98d238379bd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.975221 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.975199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-web-config\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.975324 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.975265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.975391 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.975373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b1a56be-033f-4e3c-bc98-b98d238379bd-config-out\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.975501 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.975483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.975671 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.975653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b1a56be-033f-4e3c-bc98-b98d238379bd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:08.980028 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:08.980011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzj9q\" (UniqueName: \"kubernetes.io/projected/8b1a56be-033f-4e3c-bc98-b98d238379bd-kube-api-access-qzj9q\") pod \"prometheus-k8s-0\" (UID: \"8b1a56be-033f-4e3c-bc98-b98d238379bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:09.111139 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:09.111054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:09.395531 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:09.395507    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:20:09.396965 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:20:09.396940    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1a56be_033f_4e3c_bc98_b98d238379bd.slice/crio-9e449ad1d5fe3a21ba524eed48ffd18dd13c9bd4569ebedca3b114769d4539ce WatchSource:0}: Error finding container 9e449ad1d5fe3a21ba524eed48ffd18dd13c9bd4569ebedca3b114769d4539ce: Status 404 returned error can't find the container with id 9e449ad1d5fe3a21ba524eed48ffd18dd13c9bd4569ebedca3b114769d4539ce
Sep 11 21:20:09.725391 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:09.725303    2560 generic.go:356] "Generic (PLEG): container finished" podID="8b1a56be-033f-4e3c-bc98-b98d238379bd" containerID="95300f242683124bac189dbd901e0d64129371a2038b42bf45c346ff42315a06" exitCode=0
Sep 11 21:20:09.725545 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:09.725383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b1a56be-033f-4e3c-bc98-b98d238379bd","Type":"ContainerDied","Data":"95300f242683124bac189dbd901e0d64129371a2038b42bf45c346ff42315a06"}
Sep 11 21:20:09.725545 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:09.725458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b1a56be-033f-4e3c-bc98-b98d238379bd","Type":"ContainerStarted","Data":"9e449ad1d5fe3a21ba524eed48ffd18dd13c9bd4569ebedca3b114769d4539ce"}
Sep 11 21:20:10.734891 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:10.734851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b1a56be-033f-4e3c-bc98-b98d238379bd","Type":"ContainerStarted","Data":"68169339cc914dbd24be96d22be9a71e40c63e0f1e20706cc75f28861587a4e8"}
Sep 11 21:20:10.735334 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:10.734926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b1a56be-033f-4e3c-bc98-b98d238379bd","Type":"ContainerStarted","Data":"6776c31a36639ed5033044f0bfe439f5fb693e4a69ff96b37421aa17c26c32f4"}
Sep 11 21:20:10.735334 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:10.734972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b1a56be-033f-4e3c-bc98-b98d238379bd","Type":"ContainerStarted","Data":"408e5aa525bdddd1ac8811dd41cb494b4cb47ea6b0fe202e7594b3c1c1d88be3"}
Sep 11 21:20:10.735334 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:10.735014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b1a56be-033f-4e3c-bc98-b98d238379bd","Type":"ContainerStarted","Data":"3a6eddebc4321f2722be91455e00d056a814116bf0fe4c631812e724e669d746"}
Sep 11 21:20:10.735334 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:10.735061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b1a56be-033f-4e3c-bc98-b98d238379bd","Type":"ContainerStarted","Data":"13c479d78c8376249ced3dba5b4718962089d3b429e749e4cca0ed19dedd37b7"}
Sep 11 21:20:10.735334 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:10.735099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b1a56be-033f-4e3c-bc98-b98d238379bd","Type":"ContainerStarted","Data":"2bfe93a18c1d5cbc9a1f5846a1db9819167403c8d137ccfe6a137411224f326c"}
Sep 11 21:20:10.772847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:10.771646    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.752615069 podStartE2EDuration="2.771624861s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.009792ms" isStatefulPod=false podCreationTimestamp="2026-09-11 21:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:20:10.767922893 +0000 UTC m=+168.480582957" watchObservedRunningTime="2026-09-11 21:20:10.771624861 +0000 UTC m=+168.484284911"
Sep 11 21:20:14.111416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:14.111338    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:20:21.929874 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:21.929843    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67df9b69-lzpq8"]
Sep 11 21:20:21.933263 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:21.933245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:21.947989 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:21.947964    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67df9b69-lzpq8"]
Sep 11 21:20:22.080905 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.080861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-trusted-ca-bundle\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.081053 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.080920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-serving-cert\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.081053 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.081006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-service-ca\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.081053 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.081048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-config\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.081197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.081067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-oauth-serving-cert\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.081197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.081120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-oauth-config\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.081197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.081148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjngh\" (UniqueName: \"kubernetes.io/projected/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-kube-api-access-kjngh\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.182380 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.182294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-trusted-ca-bundle\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.182380 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.182344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-serving-cert\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.182380 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.182378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-service-ca\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.182647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.182406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-config\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.182647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.182421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-oauth-serving-cert\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.182647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.182437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-oauth-config\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.182647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.182455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjngh\" (UniqueName: \"kubernetes.io/projected/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-kube-api-access-kjngh\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.183283 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.183256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-service-ca\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.183395 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.183263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-config\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.183434 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.183373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-oauth-serving-cert\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.183490 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.183471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-trusted-ca-bundle\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.185063 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.185043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-oauth-config\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.185216 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.185196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-serving-cert\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.190653 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.190629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjngh\" (UniqueName: \"kubernetes.io/projected/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-kube-api-access-kjngh\") pod \"console-67df9b69-lzpq8\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") " pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.242561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.242526    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:22.517847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.517792    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67df9b69-lzpq8"]
Sep 11 21:20:22.520302 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:20:22.520278    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a5cf7fa_ea70_4512_b10a_64cc41d1efd4.slice/crio-c2bca4a994409bbe29df11264180b1bc8f6ec0f06467f5448cb1b06f5b2ebf6b WatchSource:0}: Error finding container c2bca4a994409bbe29df11264180b1bc8f6ec0f06467f5448cb1b06f5b2ebf6b: Status 404 returned error can't find the container with id c2bca4a994409bbe29df11264180b1bc8f6ec0f06467f5448cb1b06f5b2ebf6b
Sep 11 21:20:22.785444 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.785351    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67df9b69-lzpq8" event={"ID":"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4","Type":"ContainerStarted","Data":"a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca"}
Sep 11 21:20:22.785444 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.785409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67df9b69-lzpq8" event={"ID":"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4","Type":"ContainerStarted","Data":"c2bca4a994409bbe29df11264180b1bc8f6ec0f06467f5448cb1b06f5b2ebf6b"}
Sep 11 21:20:22.803981 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:22.803930    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67df9b69-lzpq8" podStartSLOduration=1.8039109880000002 podStartE2EDuration="1.803910988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:20:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:20:22.803647519 +0000 UTC m=+180.516307569" watchObservedRunningTime="2026-09-11 21:20:22.803910988 +0000 UTC m=+180.516571037"
Sep 11 21:20:32.243247 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:32.243209    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:32.243688 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:32.243279    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:32.247857 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:32.247814    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:32.821793 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:32.821768    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:20:32.869838 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:32.869792    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc5cbdbc7-mvl9h"]
Sep 11 21:20:57.891807 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:57.891759    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dc5cbdbc7-mvl9h" podUID="0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" containerName="console" containerID="cri-o://33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a" gracePeriod=15
Sep 11 21:20:58.133088 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.133066    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:20:58.266659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.266566    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-trusted-ca-bundle\") pod \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") "
Sep 11 21:20:58.266659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.266611    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-oauth-serving-cert\") pod \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") "
Sep 11 21:20:58.266659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.266651    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-service-ca\") pod \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") "
Sep 11 21:20:58.266988 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.266680    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrrbb\" (UniqueName: \"kubernetes.io/projected/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-kube-api-access-zrrbb\") pod \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") "
Sep 11 21:20:58.266988 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.266698    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-oauth-config\") pod \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") "
Sep 11 21:20:58.266988 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.266728    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-serving-cert\") pod \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") "
Sep 11 21:20:58.266988 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.266769    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-config\") pod \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\" (UID: \"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235\") "
Sep 11 21:20:58.267200 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.267076    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" (UID: "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:58.267253 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.267199    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-service-ca" (OuterVolumeSpecName: "service-ca") pod "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" (UID: "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:58.267301 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.267213    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" (UID: "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:58.267471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.267443    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-config" (OuterVolumeSpecName: "console-config") pod "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" (UID: "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:58.269103 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.269075    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" (UID: "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:58.269481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.269453    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" (UID: "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:58.269481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.269454    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-kube-api-access-zrrbb" (OuterVolumeSpecName: "kube-api-access-zrrbb") pod "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" (UID: "0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235"). InnerVolumeSpecName "kube-api-access-zrrbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:58.368183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.368128    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.368183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.368174    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-trusted-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.368183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.368183    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-oauth-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.368183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.368191    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.368183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.368200    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrrbb\" (UniqueName: \"kubernetes.io/projected/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-kube-api-access-zrrbb\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.368473 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.368209    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-oauth-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.368473 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.368217    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235-console-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.917531 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.917490    2560 generic.go:356] "Generic (PLEG): container finished" podID="0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" containerID="33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a" exitCode=0
Sep 11 21:20:58.918018 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.917540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc5cbdbc7-mvl9h" event={"ID":"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235","Type":"ContainerDied","Data":"33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a"}
Sep 11 21:20:58.918018 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.917557    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc5cbdbc7-mvl9h"
Sep 11 21:20:58.918018 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.917612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc5cbdbc7-mvl9h" event={"ID":"0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235","Type":"ContainerDied","Data":"966e2e484b8983eaf6a4a25526d61f3d0e36e6e055291f6d21e41828b343eebe"}
Sep 11 21:20:58.918018 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.917634    2560 scope.go:117] "RemoveContainer" containerID="33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a"
Sep 11 21:20:58.925699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.925677    2560 scope.go:117] "RemoveContainer" containerID="33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a"
Sep 11 21:20:58.925989 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:20:58.925969    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a\": container with ID starting with 33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a not found: ID does not exist" containerID="33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a"
Sep 11 21:20:58.926088 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.925995    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a"} err="failed to get container status \"33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a\": rpc error: code = NotFound desc = could not find container \"33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a\": container with ID starting with 33d72f7ee4c446d42cd1fc58bb4f6fb6e36d1c6110643067e1f9b27a811e1e5a not found: ID does not exist"
Sep 11 21:20:58.932605 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.932584    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc5cbdbc7-mvl9h"]
Sep 11 21:20:58.935342 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:20:58.935321    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dc5cbdbc7-mvl9h"]
Sep 11 21:21:00.799541 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:00.799504    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" path="/var/lib/kubelet/pods/0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235/volumes"
Sep 11 21:21:09.111770 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:09.111735    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:21:09.127666 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:09.127643    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:21:09.973715 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:09.973690    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:21:34.540177 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.540144    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ng2bg"]
Sep 11 21:21:34.540616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.540407    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" containerName="console"
Sep 11 21:21:34.540616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.540417    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" containerName="console"
Sep 11 21:21:34.540616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.540467    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b4b1f55-74bb-4eb6-8f96-aa17c4b7d235" containerName="console"
Sep 11 21:21:34.544513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.544498    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ng2bg"
Sep 11 21:21:34.547072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.547052    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 21:21:34.547444 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.547428    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5rmtj\""
Sep 11 21:21:34.548023 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.548008    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 21:21:34.554504 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.554479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9c5c\" (UniqueName: \"kubernetes.io/projected/276841b3-c6bc-4295-af33-118d88fc6f54-kube-api-access-d9c5c\") pod \"cert-manager-55b4d954d5-ng2bg\" (UID: \"276841b3-c6bc-4295-af33-118d88fc6f54\") " pod="cert-manager/cert-manager-55b4d954d5-ng2bg"
Sep 11 21:21:34.554608 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.554560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/276841b3-c6bc-4295-af33-118d88fc6f54-bound-sa-token\") pod \"cert-manager-55b4d954d5-ng2bg\" (UID: \"276841b3-c6bc-4295-af33-118d88fc6f54\") " pod="cert-manager/cert-manager-55b4d954d5-ng2bg"
Sep 11 21:21:34.555981 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.555959    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ng2bg"]
Sep 11 21:21:34.655812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.655775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/276841b3-c6bc-4295-af33-118d88fc6f54-bound-sa-token\") pod \"cert-manager-55b4d954d5-ng2bg\" (UID: \"276841b3-c6bc-4295-af33-118d88fc6f54\") " pod="cert-manager/cert-manager-55b4d954d5-ng2bg"
Sep 11 21:21:34.656026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.655914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9c5c\" (UniqueName: \"kubernetes.io/projected/276841b3-c6bc-4295-af33-118d88fc6f54-kube-api-access-d9c5c\") pod \"cert-manager-55b4d954d5-ng2bg\" (UID: \"276841b3-c6bc-4295-af33-118d88fc6f54\") " pod="cert-manager/cert-manager-55b4d954d5-ng2bg"
Sep 11 21:21:34.674018 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.673989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9c5c\" (UniqueName: \"kubernetes.io/projected/276841b3-c6bc-4295-af33-118d88fc6f54-kube-api-access-d9c5c\") pod \"cert-manager-55b4d954d5-ng2bg\" (UID: \"276841b3-c6bc-4295-af33-118d88fc6f54\") " pod="cert-manager/cert-manager-55b4d954d5-ng2bg"
Sep 11 21:21:34.679045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.679023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/276841b3-c6bc-4295-af33-118d88fc6f54-bound-sa-token\") pod \"cert-manager-55b4d954d5-ng2bg\" (UID: \"276841b3-c6bc-4295-af33-118d88fc6f54\") " pod="cert-manager/cert-manager-55b4d954d5-ng2bg"
Sep 11 21:21:34.859092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:34.859050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ng2bg"
Sep 11 21:21:35.149262 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:35.149187    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ng2bg"]
Sep 11 21:21:35.153091 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:21:35.153056    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod276841b3_c6bc_4295_af33_118d88fc6f54.slice/crio-a0b03205dde5b1f64efddc937ce55e49159eef73c5f0c471a92a353487465697 WatchSource:0}: Error finding container a0b03205dde5b1f64efddc937ce55e49159eef73c5f0c471a92a353487465697: Status 404 returned error can't find the container with id a0b03205dde5b1f64efddc937ce55e49159eef73c5f0c471a92a353487465697
Sep 11 21:21:36.049728 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:36.049690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ng2bg" event={"ID":"276841b3-c6bc-4295-af33-118d88fc6f54","Type":"ContainerStarted","Data":"a0b03205dde5b1f64efddc937ce55e49159eef73c5f0c471a92a353487465697"}
Sep 11 21:21:39.063211 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:39.063175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ng2bg" event={"ID":"276841b3-c6bc-4295-af33-118d88fc6f54","Type":"ContainerStarted","Data":"13b0960e185669594d6d6ffc1511705db5874567429887acb4633153f7ae5d00"}
Sep 11 21:21:39.121460 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:21:39.121399    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ng2bg" podStartSLOduration=2.055186118 podStartE2EDuration="5.121382364s" totalImagesPullingTime="3.066196246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:21:39.121162751 +0000 UTC m=+256.833822811" watchObservedRunningTime="2026-09-11 21:21:39.121382364 +0000 UTC m=+256.834042413"
Sep 11 21:22:02.382212 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.382175    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"]
Sep 11 21:22:02.385376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.385359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.388729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.388696    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 21:22:02.388892 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.388870    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:22:02.388977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.388911    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 21:22:02.388977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.388923    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 21:22:02.388977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.388870    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 21:22:02.389107 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.388870    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5lxsd\""
Sep 11 21:22:02.398939 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.397174    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"]
Sep 11 21:22:02.478380 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.478334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea681fc0-194b-4cd9-aaed-f0750c896f22-cert\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.478559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.478422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ea681fc0-194b-4cd9-aaed-f0750c896f22-manager-config\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.478559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.478459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea681fc0-194b-4cd9-aaed-f0750c896f22-metrics-cert\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.478559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.478483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhk8b\" (UniqueName: \"kubernetes.io/projected/ea681fc0-194b-4cd9-aaed-f0750c896f22-kube-api-access-mhk8b\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.578885 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.578847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea681fc0-194b-4cd9-aaed-f0750c896f22-metrics-cert\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.579025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.578902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhk8b\" (UniqueName: \"kubernetes.io/projected/ea681fc0-194b-4cd9-aaed-f0750c896f22-kube-api-access-mhk8b\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.579025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.578942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea681fc0-194b-4cd9-aaed-f0750c896f22-cert\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.579025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.578999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ea681fc0-194b-4cd9-aaed-f0750c896f22-manager-config\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.579684 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.579610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ea681fc0-194b-4cd9-aaed-f0750c896f22-manager-config\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.581448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.581425    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea681fc0-194b-4cd9-aaed-f0750c896f22-metrics-cert\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.581533 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.581516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea681fc0-194b-4cd9-aaed-f0750c896f22-cert\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.587308 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.587288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhk8b\" (UniqueName: \"kubernetes.io/projected/ea681fc0-194b-4cd9-aaed-f0750c896f22-kube-api-access-mhk8b\") pod \"lws-controller-manager-77b49fdcf4-vmwp4\" (UID: \"ea681fc0-194b-4cd9-aaed-f0750c896f22\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.694518 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.694431    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:02.968600 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:02.968518    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"]
Sep 11 21:22:02.971375 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:22:02.971338    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea681fc0_194b_4cd9_aaed_f0750c896f22.slice/crio-6bd59c51a688aae529d42ae599f4060f692d97371187a3b895a4f13c007d45a7 WatchSource:0}: Error finding container 6bd59c51a688aae529d42ae599f4060f692d97371187a3b895a4f13c007d45a7: Status 404 returned error can't find the container with id 6bd59c51a688aae529d42ae599f4060f692d97371187a3b895a4f13c007d45a7
Sep 11 21:22:03.152490 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:03.152460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4" event={"ID":"ea681fc0-194b-4cd9-aaed-f0750c896f22","Type":"ContainerStarted","Data":"6bd59c51a688aae529d42ae599f4060f692d97371187a3b895a4f13c007d45a7"}
Sep 11 21:22:06.166583 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:06.166539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4" event={"ID":"ea681fc0-194b-4cd9-aaed-f0750c896f22","Type":"ContainerStarted","Data":"b9b6c18f2415e88673ba19639d1598827f7c6be72e7480e101fee6d8d55b988f"}
Sep 11 21:22:06.167003 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:06.166600    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:06.194299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:06.194253    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4" podStartSLOduration=1.771369685 podStartE2EDuration="4.194238289s" totalImagesPullingTime="2.422868604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:06.193569039 +0000 UTC m=+283.906229087" watchObservedRunningTime="2026-09-11 21:22:06.194238289 +0000 UTC m=+283.906898338"
Sep 11 21:22:09.721529 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.721496    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"]
Sep 11 21:22:09.724852 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.724813    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.728118 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.728096    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l4wkn\""
Sep 11 21:22:09.728485 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.728469    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 21:22:09.728793 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.728766    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 21:22:09.729101 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.729084    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 21:22:09.729474 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.729458    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 21:22:09.834646 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.834611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78158658-1724-4cde-a29f-4e64223f3394-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.834866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.834661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78158658-1724-4cde-a29f-4e64223f3394-manifests\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.834866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.834744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78158658-1724-4cde-a29f-4e64223f3394-tmp\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.835000 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.834866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fshp\" (UniqueName: \"kubernetes.io/projected/78158658-1724-4cde-a29f-4e64223f3394-kube-api-access-4fshp\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.835000 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.834964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78158658-1724-4cde-a29f-4e64223f3394-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.836431 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.836400    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"]
Sep 11 21:22:09.935787 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.935751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78158658-1724-4cde-a29f-4e64223f3394-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.935787 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.935788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78158658-1724-4cde-a29f-4e64223f3394-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.936050 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.935810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78158658-1724-4cde-a29f-4e64223f3394-manifests\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.936050 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.935884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78158658-1724-4cde-a29f-4e64223f3394-tmp\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.936050 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.935930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fshp\" (UniqueName: \"kubernetes.io/projected/78158658-1724-4cde-a29f-4e64223f3394-kube-api-access-4fshp\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.936245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.936223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78158658-1724-4cde-a29f-4e64223f3394-manifests\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.938354 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.938325    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78158658-1724-4cde-a29f-4e64223f3394-tmp\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.938621 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.938605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78158658-1724-4cde-a29f-4e64223f3394-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.938748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.938726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78158658-1724-4cde-a29f-4e64223f3394-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:09.945639 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:09.945616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fshp\" (UniqueName: \"kubernetes.io/projected/78158658-1724-4cde-a29f-4e64223f3394-kube-api-access-4fshp\") pod \"opendatahub-operator-controller-manager-68b6c4779-sfgch\" (UID: \"78158658-1724-4cde-a29f-4e64223f3394\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:10.034617 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:10.034529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:10.323024 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:10.322996    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"]
Sep 11 21:22:10.325652 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:22:10.325621    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78158658_1724_4cde_a29f_4e64223f3394.slice/crio-2f6e4ce321057fe135ba510c87da58ad60dd2527e0ec8c9a78a4746fbdeefba4 WatchSource:0}: Error finding container 2f6e4ce321057fe135ba510c87da58ad60dd2527e0ec8c9a78a4746fbdeefba4: Status 404 returned error can't find the container with id 2f6e4ce321057fe135ba510c87da58ad60dd2527e0ec8c9a78a4746fbdeefba4
Sep 11 21:22:11.189658 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:11.189620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch" event={"ID":"78158658-1724-4cde-a29f-4e64223f3394","Type":"ContainerStarted","Data":"2f6e4ce321057fe135ba510c87da58ad60dd2527e0ec8c9a78a4746fbdeefba4"}
Sep 11 21:22:14.205313 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:14.205270    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch" event={"ID":"78158658-1724-4cde-a29f-4e64223f3394","Type":"ContainerStarted","Data":"4ace10b70282835a5f7ec8466feb53068158c8c143a6576b0dc467814e9a5fe0"}
Sep 11 21:22:15.212170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:15.212135    2560 generic.go:356] "Generic (PLEG): container finished" podID="78158658-1724-4cde-a29f-4e64223f3394" containerID="4ace10b70282835a5f7ec8466feb53068158c8c143a6576b0dc467814e9a5fe0" exitCode=0
Sep 11 21:22:15.212521 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:15.212189    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch" event={"ID":"78158658-1724-4cde-a29f-4e64223f3394","Type":"ContainerDied","Data":"4ace10b70282835a5f7ec8466feb53068158c8c143a6576b0dc467814e9a5fe0"}
Sep 11 21:22:16.218971 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:16.218937    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch" event={"ID":"78158658-1724-4cde-a29f-4e64223f3394","Type":"ContainerStarted","Data":"1b596a53372b658a0289d28a7699385b84462f183db884b0eef32525580a4afa"}
Sep 11 21:22:16.219407 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:16.219007    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:16.244959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:16.244911    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch" podStartSLOduration=2.9715945379999997 podStartE2EDuration="7.24489451s" totalImagesPullingTime="3.27104255s" totalInitContainerRuntime="1.002257422s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:16.242334032 +0000 UTC m=+293.954994081" watchObservedRunningTime="2026-09-11 21:22:16.24489451 +0000 UTC m=+293.957554560"
Sep 11 21:22:17.172264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:17.172234    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-vmwp4"
Sep 11 21:22:22.677511 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:22.677482    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 21:22:27.226609 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:27.226573    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-sfgch"
Sep 11 21:22:40.918481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:40.918450    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9v5pk"]
Sep 11 21:22:40.921245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:40.921228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:40.924594 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:40.924572    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 21:22:40.924721 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:40.924655    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5vdx2\""
Sep 11 21:22:40.935273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:40.935248    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9v5pk"]
Sep 11 21:22:40.995978 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:40.995947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed95ac20-0932-4d0c-b239-d15adfd8dfb2-cert\") pod \"odh-model-controller-7998c67dc4-9v5pk\" (UID: \"ed95ac20-0932-4d0c-b239-d15adfd8dfb2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:40.996150 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:40.995998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjwmd\" (UniqueName: \"kubernetes.io/projected/ed95ac20-0932-4d0c-b239-d15adfd8dfb2-kube-api-access-gjwmd\") pod \"odh-model-controller-7998c67dc4-9v5pk\" (UID: \"ed95ac20-0932-4d0c-b239-d15adfd8dfb2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:41.096532 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.096490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed95ac20-0932-4d0c-b239-d15adfd8dfb2-cert\") pod \"odh-model-controller-7998c67dc4-9v5pk\" (UID: \"ed95ac20-0932-4d0c-b239-d15adfd8dfb2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:41.096738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.096544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjwmd\" (UniqueName: \"kubernetes.io/projected/ed95ac20-0932-4d0c-b239-d15adfd8dfb2-kube-api-access-gjwmd\") pod \"odh-model-controller-7998c67dc4-9v5pk\" (UID: \"ed95ac20-0932-4d0c-b239-d15adfd8dfb2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:41.096738 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:22:41.096642    2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 11 21:22:41.096738 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:22:41.096714    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed95ac20-0932-4d0c-b239-d15adfd8dfb2-cert podName:ed95ac20-0932-4d0c-b239-d15adfd8dfb2 nodeName:}" failed. No retries permitted until 2026-09-11 21:22:41.596699784 +0000 UTC m=+319.309359811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ed95ac20-0932-4d0c-b239-d15adfd8dfb2-cert") pod "odh-model-controller-7998c67dc4-9v5pk" (UID: "ed95ac20-0932-4d0c-b239-d15adfd8dfb2") : secret "odh-model-controller-webhook-cert" not found
Sep 11 21:22:41.105755 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.105719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjwmd\" (UniqueName: \"kubernetes.io/projected/ed95ac20-0932-4d0c-b239-d15adfd8dfb2-kube-api-access-gjwmd\") pod \"odh-model-controller-7998c67dc4-9v5pk\" (UID: \"ed95ac20-0932-4d0c-b239-d15adfd8dfb2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:41.552589 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.552559    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l6j54"]
Sep 11 21:22:41.554891 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.554875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:41.557113 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.557093    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 21:22:41.583966 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.583940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l6j54"]
Sep 11 21:22:41.600148 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.600119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551f8cb3-0301-45e8-b920-4c24eda7cc52-tls-certs\") pod \"model-serving-api-54d89bd5fc-l6j54\" (UID: \"551f8cb3-0301-45e8-b920-4c24eda7cc52\") " pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:41.600262 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.600159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed95ac20-0932-4d0c-b239-d15adfd8dfb2-cert\") pod \"odh-model-controller-7998c67dc4-9v5pk\" (UID: \"ed95ac20-0932-4d0c-b239-d15adfd8dfb2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:41.600262 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.600233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4chkt\" (UniqueName: \"kubernetes.io/projected/551f8cb3-0301-45e8-b920-4c24eda7cc52-kube-api-access-4chkt\") pod \"model-serving-api-54d89bd5fc-l6j54\" (UID: \"551f8cb3-0301-45e8-b920-4c24eda7cc52\") " pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:41.602840 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.602788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed95ac20-0932-4d0c-b239-d15adfd8dfb2-cert\") pod \"odh-model-controller-7998c67dc4-9v5pk\" (UID: \"ed95ac20-0932-4d0c-b239-d15adfd8dfb2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:41.701578 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.701548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4chkt\" (UniqueName: \"kubernetes.io/projected/551f8cb3-0301-45e8-b920-4c24eda7cc52-kube-api-access-4chkt\") pod \"model-serving-api-54d89bd5fc-l6j54\" (UID: \"551f8cb3-0301-45e8-b920-4c24eda7cc52\") " pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:41.701744 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.701596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551f8cb3-0301-45e8-b920-4c24eda7cc52-tls-certs\") pod \"model-serving-api-54d89bd5fc-l6j54\" (UID: \"551f8cb3-0301-45e8-b920-4c24eda7cc52\") " pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:41.701744 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:22:41.701703    2560 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 11 21:22:41.701848 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:22:41.701767    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/551f8cb3-0301-45e8-b920-4c24eda7cc52-tls-certs podName:551f8cb3-0301-45e8-b920-4c24eda7cc52 nodeName:}" failed. No retries permitted until 2026-09-11 21:22:42.201748293 +0000 UTC m=+319.914408320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/551f8cb3-0301-45e8-b920-4c24eda7cc52-tls-certs") pod "model-serving-api-54d89bd5fc-l6j54" (UID: "551f8cb3-0301-45e8-b920-4c24eda7cc52") : secret "model-serving-api-tls" not found
Sep 11 21:22:41.713994 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.713969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4chkt\" (UniqueName: \"kubernetes.io/projected/551f8cb3-0301-45e8-b920-4c24eda7cc52-kube-api-access-4chkt\") pod \"model-serving-api-54d89bd5fc-l6j54\" (UID: \"551f8cb3-0301-45e8-b920-4c24eda7cc52\") " pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:41.715426 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.715406    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"]
Sep 11 21:22:41.717634 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.717616    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.720322 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.720293    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 21:22:41.720444 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.720428    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-79rf5\""
Sep 11 21:22:41.736329 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.736304    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"]
Sep 11 21:22:41.802264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.802231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.802264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.802268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a304be89-2601-4ca4-937a-a81df794032e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.802467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.802312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.802467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.802359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a304be89-2601-4ca4-937a-a81df794032e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.802467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.802383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6nfr\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-kube-api-access-v6nfr\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.802467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.802408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.802467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.802437    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.802467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.802452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.802682 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.802470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.830760 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.830736    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:41.903901 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.903874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904152 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.903913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a304be89-2601-4ca4-937a-a81df794032e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904152 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.903932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6nfr\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-kube-api-access-v6nfr\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904152 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904051    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904152 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904152 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904152 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904686 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904686 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a304be89-2601-4ca4-937a-a81df794032e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904686 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904686 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904929 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.904929 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.905009 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.904972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a304be89-2601-4ca4-937a-a81df794032e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.906777 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.906755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.906967 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.906950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a304be89-2601-4ca4-937a-a81df794032e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.914321 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.914303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6nfr\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-kube-api-access-v6nfr\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:41.918057 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:41.918041    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:42.035261 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.035229    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:42.099503 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.099446    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9v5pk"]
Sep 11 21:22:42.103322 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:22:42.103292    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded95ac20_0932_4d0c_b239_d15adfd8dfb2.slice/crio-922af7bfa4661759e4731128dd24a78c7515569eb8ded2879edddf85166ad52e WatchSource:0}: Error finding container 922af7bfa4661759e4731128dd24a78c7515569eb8ded2879edddf85166ad52e: Status 404 returned error can't find the container with id 922af7bfa4661759e4731128dd24a78c7515569eb8ded2879edddf85166ad52e
Sep 11 21:22:42.105044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.104788    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:22:42.206620 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.206590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551f8cb3-0301-45e8-b920-4c24eda7cc52-tls-certs\") pod \"model-serving-api-54d89bd5fc-l6j54\" (UID: \"551f8cb3-0301-45e8-b920-4c24eda7cc52\") " pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:42.209189 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.209157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551f8cb3-0301-45e8-b920-4c24eda7cc52-tls-certs\") pod \"model-serving-api-54d89bd5fc-l6j54\" (UID: \"551f8cb3-0301-45e8-b920-4c24eda7cc52\") " pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:42.308996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.308963    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"]
Sep 11 21:22:42.311948 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:22:42.311922    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda304be89_2601_4ca4_937a_a81df794032e.slice/crio-3c279ba37a1af762b5fa80b196e9a80d4f6d054fe318f1bd1b708a108b4c15de WatchSource:0}: Error finding container 3c279ba37a1af762b5fa80b196e9a80d4f6d054fe318f1bd1b708a108b4c15de: Status 404 returned error can't find the container with id 3c279ba37a1af762b5fa80b196e9a80d4f6d054fe318f1bd1b708a108b4c15de
Sep 11 21:22:42.326619 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.326584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l" event={"ID":"a304be89-2601-4ca4-937a-a81df794032e","Type":"ContainerStarted","Data":"3c279ba37a1af762b5fa80b196e9a80d4f6d054fe318f1bd1b708a108b4c15de"}
Sep 11 21:22:42.327787 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.327765    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk" event={"ID":"ed95ac20-0932-4d0c-b239-d15adfd8dfb2","Type":"ContainerStarted","Data":"922af7bfa4661759e4731128dd24a78c7515569eb8ded2879edddf85166ad52e"}
Sep 11 21:22:42.464948 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.464861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:42.738285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:42.738255    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l6j54"]
Sep 11 21:22:42.740455 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:22:42.740430    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551f8cb3_0301_45e8_b920_4c24eda7cc52.slice/crio-ad7f6430375153aa80416f7eb310fb4ea1379dcd123c2d5dcb18a69fa5b416c4 WatchSource:0}: Error finding container ad7f6430375153aa80416f7eb310fb4ea1379dcd123c2d5dcb18a69fa5b416c4: Status 404 returned error can't find the container with id ad7f6430375153aa80416f7eb310fb4ea1379dcd123c2d5dcb18a69fa5b416c4
Sep 11 21:22:43.337136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:43.337095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l6j54" event={"ID":"551f8cb3-0301-45e8-b920-4c24eda7cc52","Type":"ContainerStarted","Data":"ad7f6430375153aa80416f7eb310fb4ea1379dcd123c2d5dcb18a69fa5b416c4"}
Sep 11 21:22:47.268568 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.268530    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:22:47.268983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.268615    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:22:47.268983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.268671    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:22:47.356959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.356914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l" event={"ID":"a304be89-2601-4ca4-937a-a81df794032e","Type":"ContainerStarted","Data":"304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85"}
Sep 11 21:22:47.358935 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.358867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk" event={"ID":"ed95ac20-0932-4d0c-b239-d15adfd8dfb2","Type":"ContainerStarted","Data":"5c638a709e4c6ef454e136f1152c0d57fd3780ea4e47dd54cccb977104eab5c1"}
Sep 11 21:22:47.359040 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.358950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:47.360742 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.360721    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l6j54" event={"ID":"551f8cb3-0301-45e8-b920-4c24eda7cc52","Type":"ContainerStarted","Data":"5f4d35418d54d3bec1ad3414e818f7ccd6fd32ef1dbdedc9988455363dd1d6e7"}
Sep 11 21:22:47.360880 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.360866    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:22:47.401816 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.401765    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l" podStartSLOduration=1.447387858 podStartE2EDuration="6.401746109s" totalImagesPullingTime="4.954358251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:47.401209952 +0000 UTC m=+325.113870001" watchObservedRunningTime="2026-09-11 21:22:47.401746109 +0000 UTC m=+325.114406159"
Sep 11 21:22:47.435552 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.435486    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-l6j54" podStartSLOduration=1.915410233 podStartE2EDuration="6.435470832s" totalImagesPullingTime="4.520060599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:47.434351542 +0000 UTC m=+325.147011594" watchObservedRunningTime="2026-09-11 21:22:47.435470832 +0000 UTC m=+325.148130877"
Sep 11 21:22:47.483371 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.483279    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk" podStartSLOduration=2.329507753 podStartE2EDuration="7.483261812s" totalImagesPullingTime="5.153754059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:47.482730899 +0000 UTC m=+325.195390963" watchObservedRunningTime="2026-09-11 21:22:47.483261812 +0000 UTC m=+325.195921860"
Sep 11 21:22:47.676243 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:47.676208    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"]
Sep 11 21:22:48.035895 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:48.035846    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:48.037253 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:48.037230    2560 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 11 21:22:48.037309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:48.037279    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l" podUID="a304be89-2601-4ca4-937a-a81df794032e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 11 21:22:49.035670 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.035628    2560 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 11 21:22:49.036082 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.035691    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l" podUID="a304be89-2601-4ca4-937a-a81df794032e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 11 21:22:49.120268 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.120237    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"]
Sep 11 21:22:49.123729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.123707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.137275 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.137240    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 21:22:49.137384 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.137301    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2765v\""
Sep 11 21:22:49.137384 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.137374    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 21:22:49.137650 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.137636    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 21:22:49.151128 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.151104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"]
Sep 11 21:22:49.171328 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.171299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1773d242-8378-4e91-bd0b-e8eb4112da5a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.171465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.171339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.171465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.171372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.171465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.171396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.171465 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.171440    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.171611 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.171545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmljd\" (UniqueName: \"kubernetes.io/projected/1773d242-8378-4e91-bd0b-e8eb4112da5a-kube-api-access-mmljd\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.171611 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.171592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1773d242-8378-4e91-bd0b-e8eb4112da5a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.272533 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.272496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1773d242-8378-4e91-bd0b-e8eb4112da5a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.272533 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.272537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1773d242-8378-4e91-bd0b-e8eb4112da5a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.272767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.272565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.272767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.272594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.272767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.272619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.272767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.272646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.272767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.272722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmljd\" (UniqueName: \"kubernetes.io/projected/1773d242-8378-4e91-bd0b-e8eb4112da5a-kube-api-access-mmljd\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.273468 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.273440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.275199 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.275166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.275308 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.275170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.275466 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.275446    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1773d242-8378-4e91-bd0b-e8eb4112da5a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.275572 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.275556    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1773d242-8378-4e91-bd0b-e8eb4112da5a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.281436 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.281412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1773d242-8378-4e91-bd0b-e8eb4112da5a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.281436 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.281425    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmljd\" (UniqueName: \"kubernetes.io/projected/1773d242-8378-4e91-bd0b-e8eb4112da5a-kube-api-access-mmljd\") pod \"istiod-openshift-gateway-5677ccb49b-tnjdk\" (UID: \"1773d242-8378-4e91-bd0b-e8eb4112da5a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.370495 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.370436    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l" podUID="a304be89-2601-4ca4-937a-a81df794032e" containerName="istio-proxy" containerID="cri-o://304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85" gracePeriod=30
Sep 11 21:22:49.432603 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.432576    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:49.716170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:49.716143    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"]
Sep 11 21:22:49.717421 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:22:49.717395    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1773d242_8378_4e91_bd0b_e8eb4112da5a.slice/crio-a5644b2fb2a413ad63f92cd2c965e1b9bf49d12755f956c5dbbed015cec8ae65 WatchSource:0}: Error finding container a5644b2fb2a413ad63f92cd2c965e1b9bf49d12755f956c5dbbed015cec8ae65: Status 404 returned error can't find the container with id a5644b2fb2a413ad63f92cd2c965e1b9bf49d12755f956c5dbbed015cec8ae65
Sep 11 21:22:50.377861 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:50.377803    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk" event={"ID":"1773d242-8378-4e91-bd0b-e8eb4112da5a","Type":"ContainerStarted","Data":"a5644b2fb2a413ad63f92cd2c965e1b9bf49d12755f956c5dbbed015cec8ae65"}
Sep 11 21:22:51.975892 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:51.975811    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:22:51.976259 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:51.975938    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:22:52.390719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:52.390679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk" event={"ID":"1773d242-8378-4e91-bd0b-e8eb4112da5a","Type":"ContainerStarted","Data":"c10cceeebc72eb2ea83b13999c1ad3700b40579ca21074538b9aa6d5854db75e"}
Sep 11 21:22:52.390991 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:52.390970    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:52.419082 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:52.419010    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk" podStartSLOduration=1.163071078 podStartE2EDuration="3.418985418s" totalImagesPullingTime="2.25591434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:52.417351605 +0000 UTC m=+330.130011667" watchObservedRunningTime="2026-09-11 21:22:52.418985418 +0000 UTC m=+330.131645468"
Sep 11 21:22:53.397353 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:53.397323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk"
Sep 11 21:22:54.620560 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.620526    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:54.716181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716102    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6nfr\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-kube-api-access-v6nfr\") pod \"a304be89-2601-4ca4-937a-a81df794032e\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") "
Sep 11 21:22:54.716181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716159    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-credential-socket\") pod \"a304be89-2601-4ca4-937a-a81df794032e\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") "
Sep 11 21:22:54.716406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716185    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-envoy\") pod \"a304be89-2601-4ca4-937a-a81df794032e\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") "
Sep 11 21:22:54.716406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716202    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-istio-token\") pod \"a304be89-2601-4ca4-937a-a81df794032e\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") "
Sep 11 21:22:54.716406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716235    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a304be89-2601-4ca4-937a-a81df794032e-istiod-ca-cert\") pod \"a304be89-2601-4ca4-937a-a81df794032e\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") "
Sep 11 21:22:54.716406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716277    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-socket\") pod \"a304be89-2601-4ca4-937a-a81df794032e\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") "
Sep 11 21:22:54.716406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716330    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-certs\") pod \"a304be89-2601-4ca4-937a-a81df794032e\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") "
Sep 11 21:22:54.716406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716353    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a304be89-2601-4ca4-937a-a81df794032e-istio-podinfo\") pod \"a304be89-2601-4ca4-937a-a81df794032e\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") "
Sep 11 21:22:54.716406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716393    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-data\") pod \"a304be89-2601-4ca4-937a-a81df794032e\" (UID: \"a304be89-2601-4ca4-937a-a81df794032e\") "
Sep 11 21:22:54.716890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716572    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a304be89-2601-4ca4-937a-a81df794032e" (UID: "a304be89-2601-4ca4-937a-a81df794032e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:54.716890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716658    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a304be89-2601-4ca4-937a-a81df794032e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a304be89-2601-4ca4-937a-a81df794032e" (UID: "a304be89-2601-4ca4-937a-a81df794032e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:22:54.716890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716702    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a304be89-2601-4ca4-937a-a81df794032e" (UID: "a304be89-2601-4ca4-937a-a81df794032e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:54.716890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716761    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a304be89-2601-4ca4-937a-a81df794032e" (UID: "a304be89-2601-4ca4-937a-a81df794032e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:54.716890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.716808    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a304be89-2601-4ca4-937a-a81df794032e" (UID: "a304be89-2601-4ca4-937a-a81df794032e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:54.718725 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.718694    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a304be89-2601-4ca4-937a-a81df794032e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a304be89-2601-4ca4-937a-a81df794032e" (UID: "a304be89-2601-4ca4-937a-a81df794032e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:22:54.718725 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.718716    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a304be89-2601-4ca4-937a-a81df794032e" (UID: "a304be89-2601-4ca4-937a-a81df794032e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:54.718941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.718723    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a304be89-2601-4ca4-937a-a81df794032e" (UID: "a304be89-2601-4ca4-937a-a81df794032e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:54.718941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.718749    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-kube-api-access-v6nfr" (OuterVolumeSpecName: "kube-api-access-v6nfr") pod "a304be89-2601-4ca4-937a-a81df794032e" (UID: "a304be89-2601-4ca4-937a-a81df794032e"). InnerVolumeSpecName "kube-api-access-v6nfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:54.817688 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.817654    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:22:54.817688 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.817680    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:22:54.817909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.817694    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:22:54.817909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.817705    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a304be89-2601-4ca4-937a-a81df794032e-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:22:54.817909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.817716    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:22:54.817909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.817727    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:22:54.817909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.817739    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a304be89-2601-4ca4-937a-a81df794032e-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:22:54.817909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.817749    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a304be89-2601-4ca4-937a-a81df794032e-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:22:54.817909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:54.817759    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6nfr\" (UniqueName: \"kubernetes.io/projected/a304be89-2601-4ca4-937a-a81df794032e-kube-api-access-v6nfr\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:22:55.404024 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:55.403989    2560 generic.go:356] "Generic (PLEG): container finished" podID="a304be89-2601-4ca4-937a-a81df794032e" containerID="304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85" exitCode=0
Sep 11 21:22:55.404205 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:55.404045    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"
Sep 11 21:22:55.404205 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:55.404078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l" event={"ID":"a304be89-2601-4ca4-937a-a81df794032e","Type":"ContainerDied","Data":"304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85"}
Sep 11 21:22:55.404205 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:55.404139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l" event={"ID":"a304be89-2601-4ca4-937a-a81df794032e","Type":"ContainerDied","Data":"3c279ba37a1af762b5fa80b196e9a80d4f6d054fe318f1bd1b708a108b4c15de"}
Sep 11 21:22:55.404205 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:55.404168    2560 scope.go:117] "RemoveContainer" containerID="304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85"
Sep 11 21:22:55.417257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:55.417235    2560 scope.go:117] "RemoveContainer" containerID="304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85"
Sep 11 21:22:55.417527 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:22:55.417500    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85\": container with ID starting with 304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85 not found: ID does not exist" containerID="304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85"
Sep 11 21:22:55.417585 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:55.417533    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85"} err="failed to get container status \"304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85\": rpc error: code = NotFound desc = could not find container \"304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85\": container with ID starting with 304558a0fa87d3d7c2a1b66aef65527a425037b8a3ab3766abd361c870e3ef85 not found: ID does not exist"
Sep 11 21:22:55.436371 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:55.436345    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"]
Sep 11 21:22:55.444048 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:55.444025    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l"]
Sep 11 21:22:56.800353 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:56.800322    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a304be89-2601-4ca4-937a-a81df794032e" path="/var/lib/kubelet/pods/a304be89-2601-4ca4-937a-a81df794032e/volumes"
Sep 11 21:22:58.367509 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:58.367480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9v5pk"
Sep 11 21:22:58.369306 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:22:58.369288    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-l6j54"
Sep 11 21:23:39.972505 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:39.972469    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d45d994bf-nxmvd"]
Sep 11 21:23:39.973039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:39.972922    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a304be89-2601-4ca4-937a-a81df794032e" containerName="istio-proxy"
Sep 11 21:23:39.973039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:39.972942    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a304be89-2601-4ca4-937a-a81df794032e" containerName="istio-proxy"
Sep 11 21:23:39.973170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:39.973042    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a304be89-2601-4ca4-937a-a81df794032e" containerName="istio-proxy"
Sep 11 21:23:39.991113 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:39.991083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d45d994bf-nxmvd"]
Sep 11 21:23:39.991282 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:39.991175    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.115871 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.115840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-service-ca\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.115871 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.115874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-trusted-ca-bundle\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.116072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.115944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-oauth-serving-cert\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.116072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.115982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-console-config\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.116072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.116007    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a490a76-914c-46ca-a890-bf835610ba19-console-serving-cert\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.116072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.116025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vckn7\" (UniqueName: \"kubernetes.io/projected/7a490a76-914c-46ca-a890-bf835610ba19-kube-api-access-vckn7\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.116439 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.116085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a490a76-914c-46ca-a890-bf835610ba19-console-oauth-config\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.217271 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.217232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-service-ca\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.217271 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.217277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-trusted-ca-bundle\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.217512 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.217299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-oauth-serving-cert\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.217512 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.217323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-console-config\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.217512 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.217350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a490a76-914c-46ca-a890-bf835610ba19-console-serving-cert\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.217512 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.217368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vckn7\" (UniqueName: \"kubernetes.io/projected/7a490a76-914c-46ca-a890-bf835610ba19-kube-api-access-vckn7\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.217512 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.217398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a490a76-914c-46ca-a890-bf835610ba19-console-oauth-config\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.218137 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.218107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-service-ca\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.218137 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.218134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-oauth-serving-cert\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.218344 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.218267    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-trusted-ca-bundle\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.218469 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.218445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a490a76-914c-46ca-a890-bf835610ba19-console-config\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.220006 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.219981    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a490a76-914c-46ca-a890-bf835610ba19-console-serving-cert\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.220135 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.220111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a490a76-914c-46ca-a890-bf835610ba19-console-oauth-config\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.226813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.226766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vckn7\" (UniqueName: \"kubernetes.io/projected/7a490a76-914c-46ca-a890-bf835610ba19-kube-api-access-vckn7\") pod \"console-6d45d994bf-nxmvd\" (UID: \"7a490a76-914c-46ca-a890-bf835610ba19\") " pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.300973 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.300932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:40.575521 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.575479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d45d994bf-nxmvd"]
Sep 11 21:23:40.578545 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:23:40.578521    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a490a76_914c_46ca_a890_bf835610ba19.slice/crio-6478b8ba0c1dee27e80f4e60bf33417f863c2b38741e15e85a17968f5bed5d44 WatchSource:0}: Error finding container 6478b8ba0c1dee27e80f4e60bf33417f863c2b38741e15e85a17968f5bed5d44: Status 404 returned error can't find the container with id 6478b8ba0c1dee27e80f4e60bf33417f863c2b38741e15e85a17968f5bed5d44
Sep 11 21:23:40.600638 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:40.600605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d45d994bf-nxmvd" event={"ID":"7a490a76-914c-46ca-a890-bf835610ba19","Type":"ContainerStarted","Data":"6478b8ba0c1dee27e80f4e60bf33417f863c2b38741e15e85a17968f5bed5d44"}
Sep 11 21:23:41.611294 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:41.611245    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d45d994bf-nxmvd" event={"ID":"7a490a76-914c-46ca-a890-bf835610ba19","Type":"ContainerStarted","Data":"1ca00a6a2a8953fc82cbb5e8436b6699b896984a0eacb0af8e4b82315e5c2898"}
Sep 11 21:23:41.629965 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:41.629907    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d45d994bf-nxmvd" podStartSLOduration=2.6298923629999997 podStartE2EDuration="2.629892363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:23:41.6285894 +0000 UTC m=+379.341249466" watchObservedRunningTime="2026-09-11 21:23:41.629892363 +0000 UTC m=+379.342552412"
Sep 11 21:23:50.301356 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:50.301314    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:50.301881 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:50.301669    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:50.306129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:50.306109    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:50.650746 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:50.650721    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d45d994bf-nxmvd"
Sep 11 21:23:50.695620 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:23:50.695587    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67df9b69-lzpq8"]
Sep 11 21:24:15.716430 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:15.716384    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67df9b69-lzpq8" podUID="0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" containerName="console" containerID="cri-o://a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca" gracePeriod=15
Sep 11 21:24:15.956337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:15.956311    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:24:16.022786 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.022702    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-trusted-ca-bundle\") pod \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") "
Sep 11 21:24:16.022786 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.022734    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-oauth-config\") pod \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") "
Sep 11 21:24:16.022786 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.022760    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjngh\" (UniqueName: \"kubernetes.io/projected/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-kube-api-access-kjngh\") pod \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") "
Sep 11 21:24:16.023170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.022859    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-config\") pod \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") "
Sep 11 21:24:16.023170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.022896    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-service-ca\") pod \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") "
Sep 11 21:24:16.023170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.022920    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-oauth-serving-cert\") pod \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") "
Sep 11 21:24:16.023170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.022972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-serving-cert\") pod \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\" (UID: \"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4\") "
Sep 11 21:24:16.023376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.023216    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" (UID: "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:24:16.023435 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.023368    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" (UID: "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:24:16.023519 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.023489    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-service-ca" (OuterVolumeSpecName: "service-ca") pod "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" (UID: "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:24:16.023598 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.023570    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-config" (OuterVolumeSpecName: "console-config") pod "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" (UID: "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:24:16.025147 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.025123    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-kube-api-access-kjngh" (OuterVolumeSpecName: "kube-api-access-kjngh") pod "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" (UID: "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4"). InnerVolumeSpecName "kube-api-access-kjngh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:24:16.025672 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.025651    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" (UID: "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:24:16.025721 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.025673    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" (UID: "0a5cf7fa-ea70-4512-b10a-64cc41d1efd4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:24:16.123839 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.123789    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:24:16.123839 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.123814    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:24:16.123839 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.123841    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-oauth-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:24:16.124044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.123853    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:24:16.124044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.123861    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-trusted-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:24:16.124044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.123869    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-console-oauth-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:24:16.124044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.123877    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjngh\" (UniqueName: \"kubernetes.io/projected/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4-kube-api-access-kjngh\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:24:16.758066 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.758028    2560 generic.go:356] "Generic (PLEG): container finished" podID="0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" containerID="a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca" exitCode=0
Sep 11 21:24:16.758467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.758075    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67df9b69-lzpq8"
Sep 11 21:24:16.758467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.758092    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67df9b69-lzpq8" event={"ID":"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4","Type":"ContainerDied","Data":"a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca"}
Sep 11 21:24:16.758467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.758140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67df9b69-lzpq8" event={"ID":"0a5cf7fa-ea70-4512-b10a-64cc41d1efd4","Type":"ContainerDied","Data":"c2bca4a994409bbe29df11264180b1bc8f6ec0f06467f5448cb1b06f5b2ebf6b"}
Sep 11 21:24:16.758467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.758168    2560 scope.go:117] "RemoveContainer" containerID="a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca"
Sep 11 21:24:16.766541 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.766523    2560 scope.go:117] "RemoveContainer" containerID="a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca"
Sep 11 21:24:16.766865 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:24:16.766817    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca\": container with ID starting with a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca not found: ID does not exist" containerID="a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca"
Sep 11 21:24:16.766965 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.766876    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca"} err="failed to get container status \"a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca\": rpc error: code = NotFound desc = could not find container \"a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca\": container with ID starting with a0f234801d3a2ae0b113de3862be6dd433a6cca08083669a53e637f324fb7fca not found: ID does not exist"
Sep 11 21:24:16.793749 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.793723    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67df9b69-lzpq8"]
Sep 11 21:24:16.801500 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:16.801479    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67df9b69-lzpq8"]
Sep 11 21:24:18.800410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:18.800375    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" path="/var/lib/kubelet/pods/0a5cf7fa-ea70-4512-b10a-64cc41d1efd4/volumes"
Sep 11 21:24:54.568607 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.568528    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"]
Sep 11 21:24:54.569057 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.568857    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" containerName="console"
Sep 11 21:24:54.569057 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.568869    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" containerName="console"
Sep 11 21:24:54.569057 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.568923    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a5cf7fa-ea70-4512-b10a-64cc41d1efd4" containerName="console"
Sep 11 21:24:54.571703 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.571688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.575159 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.575139    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4mgzx\""
Sep 11 21:24:54.610155 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.610126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"]
Sep 11 21:24:54.760077 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.760042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsv4h\" (UniqueName: \"kubernetes.io/projected/873fa006-b769-42b7-b0ad-c16cdbbb700e-kube-api-access-qsv4h\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.760245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.760098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.760245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.760134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.760245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.760165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.760245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.760203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/873fa006-b769-42b7-b0ad-c16cdbbb700e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.760245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.760224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.760415 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.760251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.760415 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.760322    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.760415 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.760351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.860819 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.860745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.860819 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.860791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsv4h\" (UniqueName: \"kubernetes.io/projected/873fa006-b769-42b7-b0ad-c16cdbbb700e-kube-api-access-qsv4h\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861029 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.860854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861029 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.860898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861029 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.860933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861029 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.860971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/873fa006-b769-42b7-b0ad-c16cdbbb700e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861029 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.861005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861298 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.861035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861298 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.861083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861415 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.861310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861415 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.861341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861525 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.861495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861582 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.861532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.861788 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.861765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/873fa006-b769-42b7-b0ad-c16cdbbb700e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.863314 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.863295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.863424 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.863407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.868532 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.868500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/873fa006-b769-42b7-b0ad-c16cdbbb700e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.868644 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.868629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsv4h\" (UniqueName: \"kubernetes.io/projected/873fa006-b769-42b7-b0ad-c16cdbbb700e-kube-api-access-qsv4h\") pod \"maas-default-gateway-openshift-default-5ccb968c66-2gf9z\" (UID: \"873fa006-b769-42b7-b0ad-c16cdbbb700e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:54.881418 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:54.881390    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:55.162781 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:55.162759    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"]
Sep 11 21:24:55.165095 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:24:55.165060    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873fa006_b769_42b7_b0ad_c16cdbbb700e.slice/crio-3650e3de274929956b3b548064437cbe23f4cf87c593674e0080240710fdcd82 WatchSource:0}: Error finding container 3650e3de274929956b3b548064437cbe23f4cf87c593674e0080240710fdcd82: Status 404 returned error can't find the container with id 3650e3de274929956b3b548064437cbe23f4cf87c593674e0080240710fdcd82
Sep 11 21:24:55.167113 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:55.167081    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:24:55.167209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:55.167154    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:24:55.167209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:55.167203    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:24:55.925910 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:55.925871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" event={"ID":"873fa006-b769-42b7-b0ad-c16cdbbb700e","Type":"ContainerStarted","Data":"ff333ecb01ecb2e4bcf0ad4c39f7bbabd04d3d81d569202564a974ec8327f6b1"}
Sep 11 21:24:55.926285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:55.925927    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" event={"ID":"873fa006-b769-42b7-b0ad-c16cdbbb700e","Type":"ContainerStarted","Data":"3650e3de274929956b3b548064437cbe23f4cf87c593674e0080240710fdcd82"}
Sep 11 21:24:55.948727 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:55.948684    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" podStartSLOduration=1.948669459 podStartE2EDuration="1.948669459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:24:55.947422095 +0000 UTC m=+453.660082168" watchObservedRunningTime="2026-09-11 21:24:55.948669459 +0000 UTC m=+453.661329509"
Sep 11 21:24:56.882103 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:56.882067    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:56.886876 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:56.886851    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:56.937570 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:56.937543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:24:56.938472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:24:56.938453    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:26:09.301484 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:09.301451    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-57lf9"]
Sep 11 21:26:09.304750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:09.304729    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:09.320298 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:26:09.320267    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-dockercfg-b6gt9\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b6gt9\"" type="*v1.Secret"
Sep 11 21:26:09.320520 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:26:09.320497    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap"
Sep 11 21:26:09.320611 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:26:09.320583    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-processing-5b54b7fbb7-57lf9\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="1a607fc6-8797-4685-82f6-64490c7d4822" pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:09.339146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:09.339112    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-57lf9"]
Sep 11 21:26:09.406145 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:09.406118    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rv5v\" (UniqueName: \"kubernetes.io/projected/1a607fc6-8797-4685-82f6-64490c7d4822-kube-api-access-2rv5v\") pod \"payload-processing-5b54b7fbb7-57lf9\" (UID: \"1a607fc6-8797-4685-82f6-64490c7d4822\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:09.406273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:09.406152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a607fc6-8797-4685-82f6-64490c7d4822-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-57lf9\" (UID: \"1a607fc6-8797-4685-82f6-64490c7d4822\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:09.507252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:09.507224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rv5v\" (UniqueName: \"kubernetes.io/projected/1a607fc6-8797-4685-82f6-64490c7d4822-kube-api-access-2rv5v\") pod \"payload-processing-5b54b7fbb7-57lf9\" (UID: \"1a607fc6-8797-4685-82f6-64490c7d4822\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:09.507408 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:09.507259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a607fc6-8797-4685-82f6-64490c7d4822-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-57lf9\" (UID: \"1a607fc6-8797-4685-82f6-64490c7d4822\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:09.523350 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:09.523325    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rv5v\" (UniqueName: \"kubernetes.io/projected/1a607fc6-8797-4685-82f6-64490c7d4822-kube-api-access-2rv5v\") pod \"payload-processing-5b54b7fbb7-57lf9\" (UID: \"1a607fc6-8797-4685-82f6-64490c7d4822\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:10.226751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:10.226717    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b6gt9\""
Sep 11 21:26:10.402790 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:10.402757    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 21:26:10.408392 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:10.408359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a607fc6-8797-4685-82f6-64490c7d4822-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-57lf9\" (UID: \"1a607fc6-8797-4685-82f6-64490c7d4822\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:10.518262 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:10.518162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:10.829842 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:10.829789    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-57lf9"]
Sep 11 21:26:10.833338 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:26:10.833306    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a607fc6_8797_4685_82f6_64490c7d4822.slice/crio-3a4ac98e0852b4fab525050407b2b096be917b57b5100b1248b53fa23f4ac1c7 WatchSource:0}: Error finding container 3a4ac98e0852b4fab525050407b2b096be917b57b5100b1248b53fa23f4ac1c7: Status 404 returned error can't find the container with id 3a4ac98e0852b4fab525050407b2b096be917b57b5100b1248b53fa23f4ac1c7
Sep 11 21:26:11.249039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:11.248958    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9" event={"ID":"1a607fc6-8797-4685-82f6-64490c7d4822","Type":"ContainerStarted","Data":"3a4ac98e0852b4fab525050407b2b096be917b57b5100b1248b53fa23f4ac1c7"}
Sep 11 21:26:12.256024 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:12.255981    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9" event={"ID":"1a607fc6-8797-4685-82f6-64490c7d4822","Type":"ContainerStarted","Data":"b1fb8f26c38f77d40e53c6bd5b7c68ace246283bfa032d1944774b186c9d35e5"}
Sep 11 21:26:12.256413 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:12.256155    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:19.289125 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:19.289083    2560 generic.go:356] "Generic (PLEG): container finished" podID="873fa006-b769-42b7-b0ad-c16cdbbb700e" containerID="ff333ecb01ecb2e4bcf0ad4c39f7bbabd04d3d81d569202564a974ec8327f6b1" exitCode=0
Sep 11 21:26:19.289629 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:19.289155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" event={"ID":"873fa006-b769-42b7-b0ad-c16cdbbb700e","Type":"ContainerDied","Data":"ff333ecb01ecb2e4bcf0ad4c39f7bbabd04d3d81d569202564a974ec8327f6b1"}
Sep 11 21:26:19.289703 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:19.289651    2560 scope.go:117] "RemoveContainer" containerID="ff333ecb01ecb2e4bcf0ad4c39f7bbabd04d3d81d569202564a974ec8327f6b1"
Sep 11 21:26:19.290748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:19.290714    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:26:19.290877 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:19.290799    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:26:19.290925 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:19.290878    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:26:19.329247 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:19.329200    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9" podStartSLOduration=9.053918926 podStartE2EDuration="10.32918275s" totalImagesPullingTime="1.275263824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:26:12.289430999 +0000 UTC m=+530.002091048" watchObservedRunningTime="2026-09-11 21:26:19.32918275 +0000 UTC m=+537.041842798"
Sep 11 21:26:20.298057 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:20.298010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" event={"ID":"873fa006-b769-42b7-b0ad-c16cdbbb700e","Type":"ContainerStarted","Data":"123c89d39d035b782e6a74f5ac1ff5ab88c5f51c8b77e572b44e1332aa45c9da"}
Sep 11 21:26:20.882455 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:20.882424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:26:20.882741 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:20.882482    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2gf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 11 21:26:20.882926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:20.882902    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" podUID="873fa006-b769-42b7-b0ad-c16cdbbb700e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 11 21:26:21.882784 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:21.882747    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2gf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 11 21:26:21.883422 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:21.883387    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" podUID="873fa006-b769-42b7-b0ad-c16cdbbb700e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 11 21:26:22.891336 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:22.891297    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2gf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 11 21:26:22.891964 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:22.891929    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" podUID="873fa006-b769-42b7-b0ad-c16cdbbb700e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 11 21:26:23.262713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:23.262632    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-57lf9"
Sep 11 21:26:23.882358 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:23.882311    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2gf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 11 21:26:23.882568 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:23.882381    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" podUID="873fa006-b769-42b7-b0ad-c16cdbbb700e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 11 21:26:24.881796 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:24.881755    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-2gf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 11 21:26:24.882565 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:24.882535    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z" podUID="873fa006-b769-42b7-b0ad-c16cdbbb700e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 11 21:26:25.885437 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:25.885402    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:26:25.885847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:25.885660    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:26:25.886321 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:25.886300    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z"
Sep 11 21:26:45.097598 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.097565    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"]
Sep 11 21:26:45.100789 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.100774    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.104104 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.104083    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 21:26:45.104215 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.104114    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 21:26:45.104215 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.104117    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hc7mn\""
Sep 11 21:26:45.104215 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.104120    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 21:26:45.121357 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.121333    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"]
Sep 11 21:26:45.210647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.210617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e423e51-d2c5-449f-b48e-9ae54c953d3e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.210875 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.210674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.210875 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.210692    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.210875 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.210755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp6h2\" (UniqueName: \"kubernetes.io/projected/7e423e51-d2c5-449f-b48e-9ae54c953d3e-kube-api-access-kp6h2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.210875 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.210848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.211070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.210902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.311941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.311904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.312129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.311952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.312129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.311986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e423e51-d2c5-449f-b48e-9ae54c953d3e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.312129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.312023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.312129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.312038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.312369 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.312185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6h2\" (UniqueName: \"kubernetes.io/projected/7e423e51-d2c5-449f-b48e-9ae54c953d3e-kube-api-access-kp6h2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.312428 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.312380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.312480 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.312425    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.312480 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.312447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.314337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.314317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e423e51-d2c5-449f-b48e-9ae54c953d3e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.314631 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.314610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e423e51-d2c5-449f-b48e-9ae54c953d3e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.322037 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.322017    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp6h2\" (UniqueName: \"kubernetes.io/projected/7e423e51-d2c5-449f-b48e-9ae54c953d3e-kube-api-access-kp6h2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww\" (UID: \"7e423e51-d2c5-449f-b48e-9ae54c953d3e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.410784 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.410716    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:45.708834 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:45.708796    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"]
Sep 11 21:26:45.710476 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:26:45.710439    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e423e51_d2c5_449f_b48e_9ae54c953d3e.slice/crio-98ab57cc0342e9941432c172bfb6190f33ba4e5260907c783fd95db6df2a648d WatchSource:0}: Error finding container 98ab57cc0342e9941432c172bfb6190f33ba4e5260907c783fd95db6df2a648d: Status 404 returned error can't find the container with id 98ab57cc0342e9941432c172bfb6190f33ba4e5260907c783fd95db6df2a648d
Sep 11 21:26:46.420485 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:46.420442    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww" event={"ID":"7e423e51-d2c5-449f-b48e-9ae54c953d3e","Type":"ContainerStarted","Data":"98ab57cc0342e9941432c172bfb6190f33ba4e5260907c783fd95db6df2a648d"}
Sep 11 21:26:47.427072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:47.427028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww" event={"ID":"7e423e51-d2c5-449f-b48e-9ae54c953d3e","Type":"ContainerStarted","Data":"35526d8c57e6c6faf5e2740da1be98e8df201f15af4f0c4eb9cb232119956d0f"}
Sep 11 21:26:47.465292 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:47.465224    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww" podStartSLOduration=1.444321533 podStartE2EDuration="2.465204463s" totalImagesPullingTime="1.02088293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:26:47.46367995 +0000 UTC m=+565.176340001" watchObservedRunningTime="2026-09-11 21:26:47.465204463 +0000 UTC m=+565.177864512"
Sep 11 21:26:55.410898 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:55.410853    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:55.411342 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:55.410920    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:55.423259 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:55.423229    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:26:55.474512 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:26:55.474484    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww"
Sep 11 21:27:00.112998 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.112968    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"]
Sep 11 21:27:00.116490 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.116473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.119040 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.119021    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 21:27:00.129477 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.129455    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"]
Sep 11 21:27:00.252514 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.252479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.252514 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.252518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.252720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.252547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.252720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.252615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.252720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.252654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5sgm\" (UniqueName: \"kubernetes.io/projected/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-kube-api-access-r5sgm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.252720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.252677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.353789 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.353749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.353789 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.353789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.354067 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.353817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.354067 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.353870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.354067 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.353897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5sgm\" (UniqueName: \"kubernetes.io/projected/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-kube-api-access-r5sgm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.354067 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.353917    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.354263 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.354230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.354263 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.354252    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.354392 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.354308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.356443 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.356421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.356638 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.356622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.362709 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.362687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5sgm\" (UniqueName: \"kubernetes.io/projected/1a05ec59-3a14-4030-ae0b-9163c4ca78bb-kube-api-access-r5sgm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7p2cz\" (UID: \"1a05ec59-3a14-4030-ae0b-9163c4ca78bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.426900 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.426811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:00.703204 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:00.703141    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"]
Sep 11 21:27:00.705497 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:27:00.705474    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a05ec59_3a14_4030_ae0b_9163c4ca78bb.slice/crio-955ee521d9a1d1378869e1cad8ef3b423fb922181e95703874de646391ece687 WatchSource:0}: Error finding container 955ee521d9a1d1378869e1cad8ef3b423fb922181e95703874de646391ece687: Status 404 returned error can't find the container with id 955ee521d9a1d1378869e1cad8ef3b423fb922181e95703874de646391ece687
Sep 11 21:27:01.498866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:01.498773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz" event={"ID":"1a05ec59-3a14-4030-ae0b-9163c4ca78bb","Type":"ContainerStarted","Data":"c057a06cddfb80869cf944006efc5487cce08af8564285a5ac03c1c3976c51db"}
Sep 11 21:27:01.498866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:01.498836    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz" event={"ID":"1a05ec59-3a14-4030-ae0b-9163c4ca78bb","Type":"ContainerStarted","Data":"955ee521d9a1d1378869e1cad8ef3b423fb922181e95703874de646391ece687"}
Sep 11 21:27:01.519234 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:01.519187    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz" podStartSLOduration=1.331060328 podStartE2EDuration="1.519173787s" totalImagesPullingTime="188.113459ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:27:01.517625119 +0000 UTC m=+579.230285182" watchObservedRunningTime="2026-09-11 21:27:01.519173787 +0000 UTC m=+579.231833832"
Sep 11 21:27:10.427449 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:10.427412    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:10.427948 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:10.427486    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:10.440075 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:10.440046    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:10.554160 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:10.554127    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7p2cz"
Sep 11 21:27:28.427608 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.427573    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"]
Sep 11 21:27:28.432271 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.432253    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.435265 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.435239    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 21:27:28.465834 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.465781    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"]
Sep 11 21:27:28.492887 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.492849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.493038 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.492900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.493038 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.492954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.493038 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.493002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.493038 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.493030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff5nt\" (UniqueName: \"kubernetes.io/projected/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-kube-api-access-ff5nt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.493178 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.493073    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.594280 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.594241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.594280 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.594284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.594520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.594300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff5nt\" (UniqueName: \"kubernetes.io/projected/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-kube-api-access-ff5nt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.594520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.594325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.594520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.594380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.594520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.594425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.594797 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.594774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.594911 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.594784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.594966 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.594902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.596645 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.596625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.596932 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.596915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.604059 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.604033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff5nt\" (UniqueName: \"kubernetes.io/projected/8a858d55-d6cc-4201-8f5e-f884b32d1f7f-kube-api-access-ff5nt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4z4sr\" (UID: \"8a858d55-d6cc-4201-8f5e-f884b32d1f7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:28.743813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:28.743729    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:29.049630 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:29.049538    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"]
Sep 11 21:27:29.052753 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:27:29.052726    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a858d55_d6cc_4201_8f5e_f884b32d1f7f.slice/crio-ea00b30e4940a55f9d59691dd42ee9e22a0f79097bc9391b92c1a5326be2a66c WatchSource:0}: Error finding container ea00b30e4940a55f9d59691dd42ee9e22a0f79097bc9391b92c1a5326be2a66c: Status 404 returned error can't find the container with id ea00b30e4940a55f9d59691dd42ee9e22a0f79097bc9391b92c1a5326be2a66c
Sep 11 21:27:29.630245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:29.630209    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr" event={"ID":"8a858d55-d6cc-4201-8f5e-f884b32d1f7f","Type":"ContainerStarted","Data":"24e2ca7c7df2608f7cd41f29469088229a34370705b87720c76bdbfd6ff4abaa"}
Sep 11 21:27:29.630699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:29.630282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr" event={"ID":"8a858d55-d6cc-4201-8f5e-f884b32d1f7f","Type":"ContainerStarted","Data":"ea00b30e4940a55f9d59691dd42ee9e22a0f79097bc9391b92c1a5326be2a66c"}
Sep 11 21:27:29.656070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:29.655909    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr" podStartSLOduration=1.4550990050000001 podStartE2EDuration="1.655892665s" totalImagesPullingTime="200.79366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:27:29.655713296 +0000 UTC m=+607.368373344" watchObservedRunningTime="2026-09-11 21:27:29.655892665 +0000 UTC m=+607.368552713"
Sep 11 21:27:38.744611 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:38.744579    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:38.745088 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:38.744656    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:38.757039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:38.757014    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:27:39.687248 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:27:39.687219    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4z4sr"
Sep 11 21:29:22.392654 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.392577    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"]
Sep 11 21:29:22.395878 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.395862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.400599 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.400578    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-db06d6-openshift-default-dockercfg-qpvhj\""
Sep 11 21:29:22.423993 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.423964    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"]
Sep 11 21:29:22.519853 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.519795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istiod-ca-cert\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.520042 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.519933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-socket\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.520042 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.519967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-podinfo\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.520042 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.520010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-certs\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.520179 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.520089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-data\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.520179 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.520120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-token\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.520179 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.520142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h85z\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-kube-api-access-4h85z\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.520319 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.520183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-credential-socket\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.520319 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.520223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-envoy\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.621487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.621447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-socket\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.621487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.621488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-podinfo\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.621738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.621534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-certs\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.621738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.621576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-data\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.621738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.621599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-token\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.621738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.621625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h85z\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-kube-api-access-4h85z\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.622000 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.621739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-credential-socket\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.622000 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.621974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-envoy\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.622112 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.622002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-data\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.622112 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.621975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-socket\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.622112 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.622023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istiod-ca-cert\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.622271 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.622186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-credential-socket\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.622332 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.622290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-certs\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.622717 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.622695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istiod-ca-cert\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.624621 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.624593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-envoy\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.624772 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.624757    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-podinfo\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.630298 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.630276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-token\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.630772 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.630749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h85z\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-kube-api-access-4h85z\") pod \"e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") " pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.708725 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.708649    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-db06d6-openshift-default-dockercfg-qpvhj\""
Sep 11 21:29:22.716837 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.716798    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:22.999463 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:22.999432    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"]
Sep 11 21:29:23.001475 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:23.001450    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc8a6d7_e220_47c1_a03c_bcf84e14e9c0.slice/crio-9b18411ff63b5919b019aaf47a45371c2729a27b9fd4e9cbbd67da4bfb8d7339 WatchSource:0}: Error finding container 9b18411ff63b5919b019aaf47a45371c2729a27b9fd4e9cbbd67da4bfb8d7339: Status 404 returned error can't find the container with id 9b18411ff63b5919b019aaf47a45371c2729a27b9fd4e9cbbd67da4bfb8d7339
Sep 11 21:29:23.003705 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:23.003676    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:29:23.003787 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:23.003736    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:29:23.003787 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:23.003761    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:29:23.144101 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:23.144062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" event={"ID":"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0","Type":"ContainerStarted","Data":"9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5"}
Sep 11 21:29:23.144301 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:23.144133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" event={"ID":"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0","Type":"ContainerStarted","Data":"9b18411ff63b5919b019aaf47a45371c2729a27b9fd4e9cbbd67da4bfb8d7339"}
Sep 11 21:29:23.192848 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:23.192776    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" podStartSLOduration=1.19275792 podStartE2EDuration="1.19275792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:23.190976859 +0000 UTC m=+720.903636907" watchObservedRunningTime="2026-09-11 21:29:23.19275792 +0000 UTC m=+720.905417969"
Sep 11 21:29:23.717458 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:23.717421    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:24.723217 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:24.723183    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:25.152970 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:25.152938    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:25.153773 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:25.153750    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:28.445274 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.445241    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"]
Sep 11 21:29:28.448926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.448906    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:28.451615 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.451590    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-db06d6\""
Sep 11 21:29:28.452244 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.452224    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"]
Sep 11 21:29:28.455452 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.455434    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:28.479979 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.479955    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"]
Sep 11 21:29:28.492739 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.492717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"]
Sep 11 21:29:28.584278 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.584243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088b6dcb-6b88-450e-86fd-64d84a526273-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq\" (UID: \"088b6dcb-6b88-450e-86fd-64d84a526273\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:28.584494 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.584365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88bde9df-56d4-488f-9ac3-dc80cb611ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q\" (UID: \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:28.584494 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.584393    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nsjk\" (UniqueName: \"kubernetes.io/projected/88bde9df-56d4-488f-9ac3-dc80cb611ac9-kube-api-access-5nsjk\") pod \"payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q\" (UID: \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:28.584651 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.584551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms98d\" (UniqueName: \"kubernetes.io/projected/088b6dcb-6b88-450e-86fd-64d84a526273-kube-api-access-ms98d\") pod \"payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq\" (UID: \"088b6dcb-6b88-450e-86fd-64d84a526273\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:28.686068 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.686000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms98d\" (UniqueName: \"kubernetes.io/projected/088b6dcb-6b88-450e-86fd-64d84a526273-kube-api-access-ms98d\") pod \"payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq\" (UID: \"088b6dcb-6b88-450e-86fd-64d84a526273\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:28.686296 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.686128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088b6dcb-6b88-450e-86fd-64d84a526273-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq\" (UID: \"088b6dcb-6b88-450e-86fd-64d84a526273\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:28.686296 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.686180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88bde9df-56d4-488f-9ac3-dc80cb611ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q\" (UID: \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:28.686296 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.686208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nsjk\" (UniqueName: \"kubernetes.io/projected/88bde9df-56d4-488f-9ac3-dc80cb611ac9-kube-api-access-5nsjk\") pod \"payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q\" (UID: \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:28.686842 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.686808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88bde9df-56d4-488f-9ac3-dc80cb611ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q\" (UID: \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:28.686950 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.686929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088b6dcb-6b88-450e-86fd-64d84a526273-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq\" (UID: \"088b6dcb-6b88-450e-86fd-64d84a526273\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:28.707563 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.707496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms98d\" (UniqueName: \"kubernetes.io/projected/088b6dcb-6b88-450e-86fd-64d84a526273-kube-api-access-ms98d\") pod \"payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq\" (UID: \"088b6dcb-6b88-450e-86fd-64d84a526273\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:28.710782 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.710759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nsjk\" (UniqueName: \"kubernetes.io/projected/88bde9df-56d4-488f-9ac3-dc80cb611ac9-kube-api-access-5nsjk\") pod \"payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q\" (UID: \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:28.760276 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.760245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:28.767523 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:28.767495    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:29.080696 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.080668    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"]
Sep 11 21:29:29.083073 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:29.083032    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88bde9df_56d4_488f_9ac3_dc80cb611ac9.slice/crio-019281bc2d49adac60072c7ec544b7dd7e313555a5a9755ceac2fc7f7591ac82 WatchSource:0}: Error finding container 019281bc2d49adac60072c7ec544b7dd7e313555a5a9755ceac2fc7f7591ac82: Status 404 returned error can't find the container with id 019281bc2d49adac60072c7ec544b7dd7e313555a5a9755ceac2fc7f7591ac82
Sep 11 21:29:29.114590 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:29.114555    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088b6dcb_6b88_450e_86fd_64d84a526273.slice/crio-f57ecb87144b1f862a15ee7ba93c9a788fbc4e66e177285e898f306b8b33a831 WatchSource:0}: Error finding container f57ecb87144b1f862a15ee7ba93c9a788fbc4e66e177285e898f306b8b33a831: Status 404 returned error can't find the container with id f57ecb87144b1f862a15ee7ba93c9a788fbc4e66e177285e898f306b8b33a831
Sep 11 21:29:29.122191 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.122170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"]
Sep 11 21:29:29.177594 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.177559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq" event={"ID":"088b6dcb-6b88-450e-86fd-64d84a526273","Type":"ContainerStarted","Data":"9598838e4fac9d956b23909f4a0bd2ed64414694fc6c2c861feb6a854424c994"}
Sep 11 21:29:29.177749 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.177640    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq" event={"ID":"088b6dcb-6b88-450e-86fd-64d84a526273","Type":"ContainerStarted","Data":"f57ecb87144b1f862a15ee7ba93c9a788fbc4e66e177285e898f306b8b33a831"}
Sep 11 21:29:29.177749 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.177707    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:29.179748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.179719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q" event={"ID":"88bde9df-56d4-488f-9ac3-dc80cb611ac9","Type":"ContainerStarted","Data":"00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25"}
Sep 11 21:29:29.179890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.179773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q" event={"ID":"88bde9df-56d4-488f-9ac3-dc80cb611ac9","Type":"ContainerStarted","Data":"019281bc2d49adac60072c7ec544b7dd7e313555a5a9755ceac2fc7f7591ac82"}
Sep 11 21:29:29.180063 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.180022    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:29.248147 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.248094    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq" podStartSLOduration=1.248080048 podStartE2EDuration="1.248080048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:29.245738964 +0000 UTC m=+726.958399013" watchObservedRunningTime="2026-09-11 21:29:29.248080048 +0000 UTC m=+726.960740098"
Sep 11 21:29:29.361453 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:29.361359    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q" podStartSLOduration=1.361341847 podStartE2EDuration="1.361341847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:29.355385799 +0000 UTC m=+727.068045847" watchObservedRunningTime="2026-09-11 21:29:29.361341847 +0000 UTC m=+727.074001893"
Sep 11 21:29:30.890034 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:30.890002    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"]
Sep 11 21:29:30.893680 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:30.893659    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:30.896749 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:30.896717    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-83ba87-dockercfg-g5pfd\""
Sep 11 21:29:30.896880 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:30.896780    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-83ba87\""
Sep 11 21:29:30.944804 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:30.944780    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"]
Sep 11 21:29:31.010888 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.010859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgxn5\" (UniqueName: \"kubernetes.io/projected/4ac91e27-7d6b-47be-9d6a-77b47044a61e-kube-api-access-tgxn5\") pod \"payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr\" (UID: \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:31.011026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.010910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac91e27-7d6b-47be-9d6a-77b47044a61e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr\" (UID: \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:31.068255 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.068223    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"]
Sep 11 21:29:31.071720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.071704    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:31.111577 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.111545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxn5\" (UniqueName: \"kubernetes.io/projected/4ac91e27-7d6b-47be-9d6a-77b47044a61e-kube-api-access-tgxn5\") pod \"payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr\" (UID: \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:31.111749 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.111587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac91e27-7d6b-47be-9d6a-77b47044a61e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr\" (UID: \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:31.112351 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.112327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac91e27-7d6b-47be-9d6a-77b47044a61e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr\" (UID: \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:31.158240 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.158168    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"]
Sep 11 21:29:31.178305 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.178265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgxn5\" (UniqueName: \"kubernetes.io/projected/4ac91e27-7d6b-47be-9d6a-77b47044a61e-kube-api-access-tgxn5\") pod \"payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr\" (UID: \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:31.204370 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.204342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:31.212707 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.212684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsqbg\" (UniqueName: \"kubernetes.io/projected/1f7f4ea1-e126-4582-bb0b-54c608a1d290-kube-api-access-nsqbg\") pod \"payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5\" (UID: \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:31.212810 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.212724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f4ea1-e126-4582-bb0b-54c608a1d290-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5\" (UID: \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:31.314194 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.314160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsqbg\" (UniqueName: \"kubernetes.io/projected/1f7f4ea1-e126-4582-bb0b-54c608a1d290-kube-api-access-nsqbg\") pod \"payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5\" (UID: \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:31.314362 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.314222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f4ea1-e126-4582-bb0b-54c608a1d290-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5\" (UID: \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:31.314945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.314922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f4ea1-e126-4582-bb0b-54c608a1d290-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5\" (UID: \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:31.347198 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.347166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsqbg\" (UniqueName: \"kubernetes.io/projected/1f7f4ea1-e126-4582-bb0b-54c608a1d290-kube-api-access-nsqbg\") pod \"payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5\" (UID: \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:31.381781 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.381750    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:31.592629 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.592606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"]
Sep 11 21:29:31.595332 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:31.595307    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac91e27_7d6b_47be_9d6a_77b47044a61e.slice/crio-c9e7ef2dad0a024de363b41911b9f4c09ab30f77ba68396c35387cfc2e5522a8 WatchSource:0}: Error finding container c9e7ef2dad0a024de363b41911b9f4c09ab30f77ba68396c35387cfc2e5522a8: Status 404 returned error can't find the container with id c9e7ef2dad0a024de363b41911b9f4c09ab30f77ba68396c35387cfc2e5522a8
Sep 11 21:29:31.701814 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:31.701738    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"]
Sep 11 21:29:31.705312 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:31.705283    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7f4ea1_e126_4582_bb0b_54c608a1d290.slice/crio-5f9370216ec25d8e89b33b7d156bc31cb0f11cb4b4f2bb262aeae68cff9a15ff WatchSource:0}: Error finding container 5f9370216ec25d8e89b33b7d156bc31cb0f11cb4b4f2bb262aeae68cff9a15ff: Status 404 returned error can't find the container with id 5f9370216ec25d8e89b33b7d156bc31cb0f11cb4b4f2bb262aeae68cff9a15ff
Sep 11 21:29:32.199145 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.199113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5" event={"ID":"1f7f4ea1-e126-4582-bb0b-54c608a1d290","Type":"ContainerStarted","Data":"1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13"}
Sep 11 21:29:32.199666 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.199200    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:32.199666 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.199242    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5" event={"ID":"1f7f4ea1-e126-4582-bb0b-54c608a1d290","Type":"ContainerStarted","Data":"5f9370216ec25d8e89b33b7d156bc31cb0f11cb4b4f2bb262aeae68cff9a15ff"}
Sep 11 21:29:32.201123 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.201098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr" event={"ID":"4ac91e27-7d6b-47be-9d6a-77b47044a61e","Type":"ContainerStarted","Data":"824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded"}
Sep 11 21:29:32.201259 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.201146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr" event={"ID":"4ac91e27-7d6b-47be-9d6a-77b47044a61e","Type":"ContainerStarted","Data":"c9e7ef2dad0a024de363b41911b9f4c09ab30f77ba68396c35387cfc2e5522a8"}
Sep 11 21:29:32.201259 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.201242    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:32.223909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.223865    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5" podStartSLOduration=2.22385072 podStartE2EDuration="2.22385072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:32.221586955 +0000 UTC m=+729.934247004" watchObservedRunningTime="2026-09-11 21:29:32.22385072 +0000 UTC m=+729.936510806"
Sep 11 21:29:32.257273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.257226    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr" podStartSLOduration=2.257211628 podStartE2EDuration="2.257211628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:32.256545929 +0000 UTC m=+729.969205977" watchObservedRunningTime="2026-09-11 21:29:32.257211628 +0000 UTC m=+729.969871806"
Sep 11 21:29:32.861997 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.861965    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"]
Sep 11 21:29:32.865487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.865471    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:32.871404 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.871381    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-1a1e3a\""
Sep 11 21:29:32.871553 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.871430    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-1a1e3a-dockercfg-hlgs7\""
Sep 11 21:29:32.881864 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.881800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"]
Sep 11 21:29:32.928724 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.928691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt\" (UID: \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:32.928970 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:32.928734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqt7r\" (UniqueName: \"kubernetes.io/projected/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-kube-api-access-lqt7r\") pod \"payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt\" (UID: \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:33.029940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:33.029902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt\" (UID: \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:33.029940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:33.029935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqt7r\" (UniqueName: \"kubernetes.io/projected/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-kube-api-access-lqt7r\") pod \"payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt\" (UID: \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:33.030618 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:33.030596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt\" (UID: \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:33.040380 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:33.040356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqt7r\" (UniqueName: \"kubernetes.io/projected/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-kube-api-access-lqt7r\") pod \"payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt\" (UID: \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:33.183379 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:33.183280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:33.487309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:33.487279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"]
Sep 11 21:29:33.487690 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:33.487568    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfa6d79_e0f0_4dc7_add3_16b451bbed5d.slice/crio-c522c67b53324497e5898d96ed1f69cfde62e52f325fd7f83f1c74bde0b2f281 WatchSource:0}: Error finding container c522c67b53324497e5898d96ed1f69cfde62e52f325fd7f83f1c74bde0b2f281: Status 404 returned error can't find the container with id c522c67b53324497e5898d96ed1f69cfde62e52f325fd7f83f1c74bde0b2f281
Sep 11 21:29:34.213642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:34.213603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt" event={"ID":"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d","Type":"ContainerStarted","Data":"b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d"}
Sep 11 21:29:34.213898 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:34.213659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt" event={"ID":"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d","Type":"ContainerStarted","Data":"c522c67b53324497e5898d96ed1f69cfde62e52f325fd7f83f1c74bde0b2f281"}
Sep 11 21:29:34.213898 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:34.213688    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:34.281630 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:34.281563    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt" podStartSLOduration=2.2815401140000002 podStartE2EDuration="2.281540114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:34.28033524 +0000 UTC m=+731.992995289" watchObservedRunningTime="2026-09-11 21:29:34.281540114 +0000 UTC m=+731.994200166"
Sep 11 21:29:37.475690 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.475658    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"]
Sep 11 21:29:37.479754 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.479731    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:37.484145 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.484123    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-1e9b41-dockercfg-8mnml\""
Sep 11 21:29:37.484556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.484299    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-1e9b41\""
Sep 11 21:29:37.492132 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.492101    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"]
Sep 11 21:29:37.574157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.574126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j5lr\" (UniqueName: \"kubernetes.io/projected/98c4d771-a138-4820-bda7-0fd889e8fa58-kube-api-access-5j5lr\") pod \"payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn\" (UID: \"98c4d771-a138-4820-bda7-0fd889e8fa58\") " pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:37.574304 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.574252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c4d771-a138-4820-bda7-0fd889e8fa58-plugins-config-volume\") pod \"payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn\" (UID: \"98c4d771-a138-4820-bda7-0fd889e8fa58\") " pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:37.675235 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.675197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c4d771-a138-4820-bda7-0fd889e8fa58-plugins-config-volume\") pod \"payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn\" (UID: \"98c4d771-a138-4820-bda7-0fd889e8fa58\") " pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:37.675401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.675274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j5lr\" (UniqueName: \"kubernetes.io/projected/98c4d771-a138-4820-bda7-0fd889e8fa58-kube-api-access-5j5lr\") pod \"payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn\" (UID: \"98c4d771-a138-4820-bda7-0fd889e8fa58\") " pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:37.676011 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.675987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c4d771-a138-4820-bda7-0fd889e8fa58-plugins-config-volume\") pod \"payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn\" (UID: \"98c4d771-a138-4820-bda7-0fd889e8fa58\") " pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:37.684985 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.684952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j5lr\" (UniqueName: \"kubernetes.io/projected/98c4d771-a138-4820-bda7-0fd889e8fa58-kube-api-access-5j5lr\") pod \"payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn\" (UID: \"98c4d771-a138-4820-bda7-0fd889e8fa58\") " pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:37.795116 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:37.795021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:38.087948 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:38.087913    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"]
Sep 11 21:29:38.093165 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:38.093130    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c4d771_a138_4820_bda7_0fd889e8fa58.slice/crio-a9229f2a79da589b9de3a4d7124a2694142460af231b8a35ffa6c5d4a4b54a4e WatchSource:0}: Error finding container a9229f2a79da589b9de3a4d7124a2694142460af231b8a35ffa6c5d4a4b54a4e: Status 404 returned error can't find the container with id a9229f2a79da589b9de3a4d7124a2694142460af231b8a35ffa6c5d4a4b54a4e
Sep 11 21:29:38.244995 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:38.244953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn" event={"ID":"98c4d771-a138-4820-bda7-0fd889e8fa58","Type":"ContainerStarted","Data":"cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078"}
Sep 11 21:29:38.245176 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:38.245062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn" event={"ID":"98c4d771-a138-4820-bda7-0fd889e8fa58","Type":"ContainerStarted","Data":"a9229f2a79da589b9de3a4d7124a2694142460af231b8a35ffa6c5d4a4b54a4e"}
Sep 11 21:29:38.245333 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:38.245315    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:38.267558 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:38.267280    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn" podStartSLOduration=1.267260668 podStartE2EDuration="1.267260668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:38.264981396 +0000 UTC m=+735.977641458" watchObservedRunningTime="2026-09-11 21:29:38.267260668 +0000 UTC m=+735.979920718"
Sep 11 21:29:40.190171 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:40.189230    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:29:40.191359 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:40.190789    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:29:41.407559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.407518    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"]
Sep 11 21:29:41.412376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.412349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:41.418887 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.418861    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-5b37c5b2-dockercfg-zfk2b\""
Sep 11 21:29:41.420009 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.419983    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-5b37c5b2\""
Sep 11 21:29:41.433228 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.433190    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"]
Sep 11 21:29:41.523620 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.523576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzwxv\" (UniqueName: \"kubernetes.io/projected/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-kube-api-access-hzwxv\") pod \"payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c\" (UID: \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:41.523803 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.523658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c\" (UID: \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:41.625074 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.625035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c\" (UID: \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:41.625285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.625163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzwxv\" (UniqueName: \"kubernetes.io/projected/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-kube-api-access-hzwxv\") pod \"payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c\" (UID: \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:41.625806 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.625780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c\" (UID: \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:41.651424 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.651382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzwxv\" (UniqueName: \"kubernetes.io/projected/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-kube-api-access-hzwxv\") pod \"payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c\" (UID: \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:41.724428 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:41.724345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:42.015065 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:42.014969    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"]
Sep 11 21:29:42.024390 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:42.024357    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0ef1c2_7b3a_4ee6_bc20_76d7be132520.slice/crio-288d0f497c1e27971b3619e163e2d467265db4d999ec5270183a0d0a8f518f6d WatchSource:0}: Error finding container 288d0f497c1e27971b3619e163e2d467265db4d999ec5270183a0d0a8f518f6d: Status 404 returned error can't find the container with id 288d0f497c1e27971b3619e163e2d467265db4d999ec5270183a0d0a8f518f6d
Sep 11 21:29:42.268418 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:42.268329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c" event={"ID":"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520","Type":"ContainerStarted","Data":"1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387"}
Sep 11 21:29:42.268586 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:42.268420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c" event={"ID":"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520","Type":"ContainerStarted","Data":"288d0f497c1e27971b3619e163e2d467265db4d999ec5270183a0d0a8f518f6d"}
Sep 11 21:29:42.268586 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:42.268472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:42.293072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:42.293012    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c" podStartSLOduration=1.292995725 podStartE2EDuration="1.292995725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:42.291170271 +0000 UTC m=+740.003830321" watchObservedRunningTime="2026-09-11 21:29:42.292995725 +0000 UTC m=+740.005655774"
Sep 11 21:29:43.208412 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:43.208379    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:29:43.208891 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:43.208480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:29:44.280185 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:44.280149    2560 generic.go:356] "Generic (PLEG): container finished" podID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerID="9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5" exitCode=0
Sep 11 21:29:44.280633 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:44.280217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" event={"ID":"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0","Type":"ContainerDied","Data":"9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5"}
Sep 11 21:29:44.280633 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:44.280605    2560 scope.go:117] "RemoveContainer" containerID="9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5"
Sep 11 21:29:44.281806 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:44.281778    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:29:44.281894 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:44.281873    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:29:44.281941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:44.281928    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:29:45.231237 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:45.231205    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:29:45.288352 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:45.288320    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" event={"ID":"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0","Type":"ContainerStarted","Data":"e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d"}
Sep 11 21:29:45.717532 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:45.717496    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:45.717933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:45.717904    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 11 21:29:45.718089 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:45.717972    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 11 21:29:46.717448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:46.717414    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 11 21:29:46.717901 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:46.717473    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 11 21:29:47.718245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:47.718196    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 11 21:29:47.718707 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:47.718265    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 11 21:29:48.718305 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:48.718264    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 11 21:29:48.718711 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:48.718337    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 11 21:29:49.252864 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:49.252812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:29:49.717297 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:49.717257    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 11 21:29:49.717498 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:49.717326    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 11 21:29:50.717450 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:50.717412    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 11 21:29:50.718005 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:50.717499    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 11 21:29:51.722482 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:51.722452    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:51.722891 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:51.722782    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:51.723481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:51.723455    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:29:53.202040 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.202005    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"]
Sep 11 21:29:53.205387 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.205371    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"
Sep 11 21:29:53.208114 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.208086    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:29:53.208240 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.208182    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:29:53.220913 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.220886    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"]
Sep 11 21:29:53.275211 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.275182    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:29:53.352727 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.352695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722b5e80-901d-4291-9fc2-ccb06c127835-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq\" (UID: \"722b5e80-901d-4291-9fc2-ccb06c127835\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"
Sep 11 21:29:53.453512 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.453437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722b5e80-901d-4291-9fc2-ccb06c127835-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq\" (UID: \"722b5e80-901d-4291-9fc2-ccb06c127835\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"
Sep 11 21:29:53.454122 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.454098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722b5e80-901d-4291-9fc2-ccb06c127835-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq\" (UID: \"722b5e80-901d-4291-9fc2-ccb06c127835\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"
Sep 11 21:29:53.515092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.515062    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"
Sep 11 21:29:53.789454 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.789428    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"]
Sep 11 21:29:53.795684 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:53.795667    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:29:54.342443 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.342410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq" event={"ID":"722b5e80-901d-4291-9fc2-ccb06c127835","Type":"ContainerStarted","Data":"faa485d5795c9d152547349497e2e85759e65cd66bb8f710583e7cbba469b063"}
Sep 11 21:29:54.408656 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.408625    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"]
Sep 11 21:29:54.413550 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.413530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:29:54.416195 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.416171    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-02c60f-dockercfg-db8wc\""
Sep 11 21:29:54.416195 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.416190    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-02c60f\""
Sep 11 21:29:54.427738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.427706    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"]
Sep 11 21:29:54.445509 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.445476    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"]
Sep 11 21:29:54.449072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.449055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:29:54.459670 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.459646    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"]
Sep 11 21:29:54.565711 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.565680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d34a17ab-c0ae-481e-909d-d151e3d10b53-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g\" (UID: \"d34a17ab-c0ae-481e-909d-d151e3d10b53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:29:54.565941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.565724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgwv4\" (UniqueName: \"kubernetes.io/projected/44d18f0d-37d8-4e63-8a71-c5d783a234fd-kube-api-access-tgwv4\") pod \"payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw\" (UID: \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:29:54.565941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.565780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbvkx\" (UniqueName: \"kubernetes.io/projected/d34a17ab-c0ae-481e-909d-d151e3d10b53-kube-api-access-rbvkx\") pod \"payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g\" (UID: \"d34a17ab-c0ae-481e-909d-d151e3d10b53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:29:54.565941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.565814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44d18f0d-37d8-4e63-8a71-c5d783a234fd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw\" (UID: \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:29:54.666600 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.666504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvkx\" (UniqueName: \"kubernetes.io/projected/d34a17ab-c0ae-481e-909d-d151e3d10b53-kube-api-access-rbvkx\") pod \"payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g\" (UID: \"d34a17ab-c0ae-481e-909d-d151e3d10b53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:29:54.666600 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.666566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44d18f0d-37d8-4e63-8a71-c5d783a234fd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw\" (UID: \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:29:54.666848 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.666691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d34a17ab-c0ae-481e-909d-d151e3d10b53-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g\" (UID: \"d34a17ab-c0ae-481e-909d-d151e3d10b53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:29:54.666848 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.666742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgwv4\" (UniqueName: \"kubernetes.io/projected/44d18f0d-37d8-4e63-8a71-c5d783a234fd-kube-api-access-tgwv4\") pod \"payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw\" (UID: \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:29:54.667946 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.667888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44d18f0d-37d8-4e63-8a71-c5d783a234fd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw\" (UID: \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:29:54.668346 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.668307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d34a17ab-c0ae-481e-909d-d151e3d10b53-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g\" (UID: \"d34a17ab-c0ae-481e-909d-d151e3d10b53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:29:54.677498 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.677468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbvkx\" (UniqueName: \"kubernetes.io/projected/d34a17ab-c0ae-481e-909d-d151e3d10b53-kube-api-access-rbvkx\") pod \"payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g\" (UID: \"d34a17ab-c0ae-481e-909d-d151e3d10b53\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:29:54.677630 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.677607    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgwv4\" (UniqueName: \"kubernetes.io/projected/44d18f0d-37d8-4e63-8a71-c5d783a234fd-kube-api-access-tgwv4\") pod \"payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw\" (UID: \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:29:54.724674 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.724647    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:29:54.760460 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:54.760423    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:29:55.009342 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.009314    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"]
Sep 11 21:29:55.009814 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:55.009783    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34a17ab_c0ae_481e_909d_d151e3d10b53.slice/crio-49a905aaab69c1ec5700f0ac9f258ed3b91dcaedbb6891aab306a03d47c7a476 WatchSource:0}: Error finding container 49a905aaab69c1ec5700f0ac9f258ed3b91dcaedbb6891aab306a03d47c7a476: Status 404 returned error can't find the container with id 49a905aaab69c1ec5700f0ac9f258ed3b91dcaedbb6891aab306a03d47c7a476
Sep 11 21:29:55.062620 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.062595    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"]
Sep 11 21:29:55.065814 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:29:55.065787    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d18f0d_37d8_4e63_8a71_c5d783a234fd.slice/crio-aad3f7dc96eb0484c38b9fb2b2f164c44bbd04ba75f12a8901b36d2df63599a1 WatchSource:0}: Error finding container aad3f7dc96eb0484c38b9fb2b2f164c44bbd04ba75f12a8901b36d2df63599a1: Status 404 returned error can't find the container with id aad3f7dc96eb0484c38b9fb2b2f164c44bbd04ba75f12a8901b36d2df63599a1
Sep 11 21:29:55.350757 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.350712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g" event={"ID":"d34a17ab-c0ae-481e-909d-d151e3d10b53","Type":"ContainerStarted","Data":"6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd"}
Sep 11 21:29:55.351244 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.350776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g" event={"ID":"d34a17ab-c0ae-481e-909d-d151e3d10b53","Type":"ContainerStarted","Data":"49a905aaab69c1ec5700f0ac9f258ed3b91dcaedbb6891aab306a03d47c7a476"}
Sep 11 21:29:55.351244 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.350916    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:29:55.353240 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.353213    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw" event={"ID":"44d18f0d-37d8-4e63-8a71-c5d783a234fd","Type":"ContainerStarted","Data":"273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2"}
Sep 11 21:29:55.353381 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.353266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw" event={"ID":"44d18f0d-37d8-4e63-8a71-c5d783a234fd","Type":"ContainerStarted","Data":"aad3f7dc96eb0484c38b9fb2b2f164c44bbd04ba75f12a8901b36d2df63599a1"}
Sep 11 21:29:55.353381 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.353296    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:29:55.381197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.381143    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g" podStartSLOduration=1.381121645 podStartE2EDuration="1.381121645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:55.378328683 +0000 UTC m=+753.090988733" watchObservedRunningTime="2026-09-11 21:29:55.381121645 +0000 UTC m=+753.093781689"
Sep 11 21:29:55.411012 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:55.410953    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw" podStartSLOduration=1.4109352560000001 podStartE2EDuration="1.410935256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:55.409649718 +0000 UTC m=+753.122309775" watchObservedRunningTime="2026-09-11 21:29:55.410935256 +0000 UTC m=+753.123595305"
Sep 11 21:29:57.371680 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:57.371593    2560 generic.go:356] "Generic (PLEG): container finished" podID="722b5e80-901d-4291-9fc2-ccb06c127835" containerID="822a0b1b149af4e7526cd08b372ff8e454b3b471d3cb3217310bbf9351fd0b0c" exitCode=0
Sep 11 21:29:57.372063 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:57.371674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq" event={"ID":"722b5e80-901d-4291-9fc2-ccb06c127835","Type":"ContainerDied","Data":"822a0b1b149af4e7526cd08b372ff8e454b3b471d3cb3217310bbf9351fd0b0c"}
Sep 11 21:29:58.517932 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:58.517906    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"
Sep 11 21:29:58.605222 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:58.605188    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722b5e80-901d-4291-9fc2-ccb06c127835-maas-api-service-ca\") pod \"722b5e80-901d-4291-9fc2-ccb06c127835\" (UID: \"722b5e80-901d-4291-9fc2-ccb06c127835\") "
Sep 11 21:29:58.605522 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:58.605502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/722b5e80-901d-4291-9fc2-ccb06c127835-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "722b5e80-901d-4291-9fc2-ccb06c127835" (UID: "722b5e80-901d-4291-9fc2-ccb06c127835"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:29:58.707233 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:58.707153    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722b5e80-901d-4291-9fc2-ccb06c127835-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:29:59.383916 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:59.383885    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"
Sep 11 21:29:59.384067 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:59.383928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq" event={"ID":"722b5e80-901d-4291-9fc2-ccb06c127835","Type":"ContainerDied","Data":"faa485d5795c9d152547349497e2e85759e65cd66bb8f710583e7cbba469b063"}
Sep 11 21:29:59.384067 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:29:59.383972    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="faa485d5795c9d152547349497e2e85759e65cd66bb8f710583e7cbba469b063"
Sep 11 21:30:00.216145 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.216109    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp"]
Sep 11 21:30:00.216563 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.216549    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="722b5e80-901d-4291-9fc2-ccb06c127835" containerName="revoke-keys"
Sep 11 21:30:00.216607 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.216565    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="722b5e80-901d-4291-9fc2-ccb06c127835" containerName="revoke-keys"
Sep 11 21:30:00.216652 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.216642    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="722b5e80-901d-4291-9fc2-ccb06c127835" containerName="revoke-keys"
Sep 11 21:30:00.219968 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.219949    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd"]
Sep 11 21:30:00.220082 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.220059    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp"
Sep 11 21:30:00.222971 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.222951    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:30:00.223397 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.223379    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"]
Sep 11 21:30:00.223481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.223467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd"
Sep 11 21:30:00.227237 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.227213    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"
Sep 11 21:30:00.231481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.231461    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp"
Sep 11 21:30:00.239039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.239022    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd"
Sep 11 21:30:00.254198 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.254174    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd"]
Sep 11 21:30:00.259782 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.259755    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp"]
Sep 11 21:30:00.268122 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.268051    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"]
Sep 11 21:30:00.279939 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.279917    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"
Sep 11 21:30:00.302419 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.300805    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k"]
Sep 11 21:30:00.306620 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.306583    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k"
Sep 11 21:30:00.333656 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.333623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k"]
Sep 11 21:30:00.352792 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.352763    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k"
Sep 11 21:30:00.531341 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.531291    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp"]
Sep 11 21:30:00.533301 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:30:00.533271    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d72908_c56b_48bd_958f_4c73e63b8b52.slice/crio-304739906dc9ce39c19dcd90167b3254f89f606f8c3e09c9fbda51beb3a03975 WatchSource:0}: Error finding container 304739906dc9ce39c19dcd90167b3254f89f606f8c3e09c9fbda51beb3a03975: Status 404 returned error can't find the container with id 304739906dc9ce39c19dcd90167b3254f89f606f8c3e09c9fbda51beb3a03975
Sep 11 21:30:00.556776 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.556731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd"]
Sep 11 21:30:00.558791 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:30:00.558751    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0a3ac5_9904_4f11_8eb5_2722e3f1fbc7.slice/crio-59a84af2d2ddfe3e4135f0b0008b7fafa8955f61b50d141625b78c516e9045e9 WatchSource:0}: Error finding container 59a84af2d2ddfe3e4135f0b0008b7fafa8955f61b50d141625b78c516e9045e9: Status 404 returned error can't find the container with id 59a84af2d2ddfe3e4135f0b0008b7fafa8955f61b50d141625b78c516e9045e9
Sep 11 21:30:00.592516 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.592491    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"]
Sep 11 21:30:00.598962 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:30:00.598940    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2857170b_8a2a_4a52_8c11_3cabe44cf875.slice/crio-385ac15f04ccddedb61e75918a57d6cd50e457f52a53da3dedb34fe9c0915cf7 WatchSource:0}: Error finding container 385ac15f04ccddedb61e75918a57d6cd50e457f52a53da3dedb34fe9c0915cf7: Status 404 returned error can't find the container with id 385ac15f04ccddedb61e75918a57d6cd50e457f52a53da3dedb34fe9c0915cf7
Sep 11 21:30:00.642537 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:00.642514    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k"]
Sep 11 21:30:00.645304 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:30:00.645280    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf786a3ef_a06b_409b_aee1_08b5028340b9.slice/crio-43a80455a1d1bee646d992f2eee66926b2d3bbb6227f7fa9e0a70c8fb36b60fa WatchSource:0}: Error finding container 43a80455a1d1bee646d992f2eee66926b2d3bbb6227f7fa9e0a70c8fb36b60fa: Status 404 returned error can't find the container with id 43a80455a1d1bee646d992f2eee66926b2d3bbb6227f7fa9e0a70c8fb36b60fa
Sep 11 21:30:01.396934 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.396903    2560 generic.go:356] "Generic (PLEG): container finished" podID="f786a3ef-a06b-409b-aee1-08b5028340b9" containerID="14f9c40506b9ce83c591149350abb39f7731bcd7425111b4ad4e5ac62c7b84fc" exitCode=7
Sep 11 21:30:01.397246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.396985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k" event={"ID":"f786a3ef-a06b-409b-aee1-08b5028340b9","Type":"ContainerDied","Data":"14f9c40506b9ce83c591149350abb39f7731bcd7425111b4ad4e5ac62c7b84fc"}
Sep 11 21:30:01.397246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.397042    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k" event={"ID":"f786a3ef-a06b-409b-aee1-08b5028340b9","Type":"ContainerStarted","Data":"43a80455a1d1bee646d992f2eee66926b2d3bbb6227f7fa9e0a70c8fb36b60fa"}
Sep 11 21:30:01.397246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.397129    2560 scope.go:117] "RemoveContainer" containerID="14f9c40506b9ce83c591149350abb39f7731bcd7425111b4ad4e5ac62c7b84fc"
Sep 11 21:30:01.398847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.398813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs" event={"ID":"2857170b-8a2a-4a52-8c11-3cabe44cf875","Type":"ContainerStarted","Data":"85ef3411b550626710b853104a2406add298d017c970ff8d28966b5f14d05501"}
Sep 11 21:30:01.398945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.398870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs" event={"ID":"2857170b-8a2a-4a52-8c11-3cabe44cf875","Type":"ContainerStarted","Data":"385ac15f04ccddedb61e75918a57d6cd50e457f52a53da3dedb34fe9c0915cf7"}
Sep 11 21:30:01.400555 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.400531    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd" event={"ID":"aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7","Type":"ContainerStarted","Data":"58fc079f83fbf9bf0926d676a03200d647a760323c05e940891fea8f75968736"}
Sep 11 21:30:01.400657 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.400580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd" event={"ID":"aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7","Type":"ContainerStarted","Data":"59a84af2d2ddfe3e4135f0b0008b7fafa8955f61b50d141625b78c516e9045e9"}
Sep 11 21:30:01.402862 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.402840    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp" event={"ID":"06d72908-c56b-48bd-958f-4c73e63b8b52","Type":"ContainerStarted","Data":"ef099cbfc4de5c94c1cd23e097099e0f6c0ab92a78cf1aa881825eb6d4ded831"}
Sep 11 21:30:01.402955 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.402878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp" event={"ID":"06d72908-c56b-48bd-958f-4c73e63b8b52","Type":"ContainerStarted","Data":"304739906dc9ce39c19dcd90167b3254f89f606f8c3e09c9fbda51beb3a03975"}
Sep 11 21:30:01.476492 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.476444    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp" podStartSLOduration=1.476427036 podStartE2EDuration="1.476427036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:01.475023738 +0000 UTC m=+759.187683786" watchObservedRunningTime="2026-09-11 21:30:01.476427036 +0000 UTC m=+759.189087085"
Sep 11 21:30:01.509709 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.509665    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs" podStartSLOduration=1.50964902 podStartE2EDuration="1.50964902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:01.507568897 +0000 UTC m=+759.220228947" watchObservedRunningTime="2026-09-11 21:30:01.50964902 +0000 UTC m=+759.222309068"
Sep 11 21:30:01.535216 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:01.535171    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd" podStartSLOduration=1.53515507 podStartE2EDuration="1.53515507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:01.53187824 +0000 UTC m=+759.244538289" watchObservedRunningTime="2026-09-11 21:30:01.53515507 +0000 UTC m=+759.247815119"
Sep 11 21:30:02.409783 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:02.409738    2560 generic.go:356] "Generic (PLEG): container finished" podID="06d72908-c56b-48bd-958f-4c73e63b8b52" containerID="ef099cbfc4de5c94c1cd23e097099e0f6c0ab92a78cf1aa881825eb6d4ded831" exitCode=0
Sep 11 21:30:02.410212 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:02.409835    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp" event={"ID":"06d72908-c56b-48bd-958f-4c73e63b8b52","Type":"ContainerDied","Data":"ef099cbfc4de5c94c1cd23e097099e0f6c0ab92a78cf1aa881825eb6d4ded831"}
Sep 11 21:30:02.411818 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:02.411796    2560 generic.go:356] "Generic (PLEG): container finished" podID="f786a3ef-a06b-409b-aee1-08b5028340b9" containerID="24da2276d798e4fafae213c0e969957f2d07f45cd5a2c08e94e1c16393ff9a40" exitCode=0
Sep 11 21:30:02.411951 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:02.411898    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k" event={"ID":"f786a3ef-a06b-409b-aee1-08b5028340b9","Type":"ContainerDied","Data":"24da2276d798e4fafae213c0e969957f2d07f45cd5a2c08e94e1c16393ff9a40"}
Sep 11 21:30:02.412025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:02.411959    2560 scope.go:117] "RemoveContainer" containerID="14f9c40506b9ce83c591149350abb39f7731bcd7425111b4ad4e5ac62c7b84fc"
Sep 11 21:30:02.413519 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:02.413500    2560 generic.go:356] "Generic (PLEG): container finished" podID="2857170b-8a2a-4a52-8c11-3cabe44cf875" containerID="85ef3411b550626710b853104a2406add298d017c970ff8d28966b5f14d05501" exitCode=0
Sep 11 21:30:02.413639 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:02.413564    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs" event={"ID":"2857170b-8a2a-4a52-8c11-3cabe44cf875","Type":"ContainerDied","Data":"85ef3411b550626710b853104a2406add298d017c970ff8d28966b5f14d05501"}
Sep 11 21:30:02.415088 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:02.415069    2560 generic.go:356] "Generic (PLEG): container finished" podID="aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7" containerID="58fc079f83fbf9bf0926d676a03200d647a760323c05e940891fea8f75968736" exitCode=0
Sep 11 21:30:02.415166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:02.415145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd" event={"ID":"aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7","Type":"ContainerDied","Data":"58fc079f83fbf9bf0926d676a03200d647a760323c05e940891fea8f75968736"}
Sep 11 21:30:03.591945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:03.591916    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp"
Sep 11 21:30:03.642322 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:03.642297    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd"
Sep 11 21:30:03.644349 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:03.644329    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"
Sep 11 21:30:03.646438 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:03.646422    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k"
Sep 11 21:30:04.046759 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.046724    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"]
Sep 11 21:30:04.051398 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.051368    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"]
Sep 11 21:30:04.115623 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.115592    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"]
Sep 11 21:30:04.115867 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.115839    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c" podUID="3f0ef1c2-7b3a-4ee6-bc20-76d7be132520" containerName="payload-pre-processing" containerID="cri-o://1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387" gracePeriod=30
Sep 11 21:30:04.364759 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.364715    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"]
Sep 11 21:30:04.367009 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.366982    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b37c5b2-rflzq"]
Sep 11 21:30:04.378282 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.378253    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:30:04.428738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.428705    2560 generic.go:356] "Generic (PLEG): container finished" podID="3f0ef1c2-7b3a-4ee6-bc20-76d7be132520" containerID="1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387" exitCode=0
Sep 11 21:30:04.428960 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.428756    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"
Sep 11 21:30:04.428960 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.428785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c" event={"ID":"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520","Type":"ContainerDied","Data":"1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387"}
Sep 11 21:30:04.428960 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.428854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c" event={"ID":"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520","Type":"ContainerDied","Data":"288d0f497c1e27971b3619e163e2d467265db4d999ec5270183a0d0a8f518f6d"}
Sep 11 21:30:04.428960 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.428887    2560 scope.go:117] "RemoveContainer" containerID="1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387"
Sep 11 21:30:04.430437 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.430419    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k"
Sep 11 21:30:04.430567 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.430472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k" event={"ID":"f786a3ef-a06b-409b-aee1-08b5028340b9","Type":"ContainerDied","Data":"43a80455a1d1bee646d992f2eee66926b2d3bbb6227f7fa9e0a70c8fb36b60fa"}
Sep 11 21:30:04.430567 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.430533    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43a80455a1d1bee646d992f2eee66926b2d3bbb6227f7fa9e0a70c8fb36b60fa"
Sep 11 21:30:04.432581 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.432559    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="385ac15f04ccddedb61e75918a57d6cd50e457f52a53da3dedb34fe9c0915cf7"
Sep 11 21:30:04.432712 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.432582    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"
Sep 11 21:30:04.434420 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.434403    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd"
Sep 11 21:30:04.434722 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.434443    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd" event={"ID":"aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7","Type":"ContainerDied","Data":"59a84af2d2ddfe3e4135f0b0008b7fafa8955f61b50d141625b78c516e9045e9"}
Sep 11 21:30:04.434722 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.434487    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59a84af2d2ddfe3e4135f0b0008b7fafa8955f61b50d141625b78c516e9045e9"
Sep 11 21:30:04.436959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.436931    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp" event={"ID":"06d72908-c56b-48bd-958f-4c73e63b8b52","Type":"ContainerDied","Data":"304739906dc9ce39c19dcd90167b3254f89f606f8c3e09c9fbda51beb3a03975"}
Sep 11 21:30:04.437073 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.436980    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="304739906dc9ce39c19dcd90167b3254f89f606f8c3e09c9fbda51beb3a03975"
Sep 11 21:30:04.437170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.437147    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp"
Sep 11 21:30:04.440967 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.440949    2560 scope.go:117] "RemoveContainer" containerID="1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387"
Sep 11 21:30:04.441272 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:30:04.441252    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387\": container with ID starting with 1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387 not found: ID does not exist" containerID="1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387"
Sep 11 21:30:04.441352 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.441287    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387"} err="failed to get container status \"1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387\": rpc error: code = NotFound desc = could not find container \"1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387\": container with ID starting with 1a1b022616714fb2b5382cd73e581e3f15ee1e0c209fe4dd99f5023c2f966387 not found: ID does not exist"
Sep 11 21:30:04.447505 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:30:04.447480    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="2857170b-8a2a-4a52-8c11-3cabe44cf875" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"
Sep 11 21:30:04.453750 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:30:04.453725    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="2857170b-8a2a-4a52-8c11-3cabe44cf875" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"
Sep 11 21:30:04.464816 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:30:04.464791    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="2857170b-8a2a-4a52-8c11-3cabe44cf875" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"
Sep 11 21:30:04.466064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.466048    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-plugins-config-volume\") pod \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\" (UID: \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\") "
Sep 11 21:30:04.466197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.466184    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzwxv\" (UniqueName: \"kubernetes.io/projected/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-kube-api-access-hzwxv\") pod \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\" (UID: \"3f0ef1c2-7b3a-4ee6-bc20-76d7be132520\") "
Sep 11 21:30:04.466434 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.466408    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f0ef1c2-7b3a-4ee6-bc20-76d7be132520" (UID: "3f0ef1c2-7b3a-4ee6-bc20-76d7be132520"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:30:04.468710 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.468689    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-kube-api-access-hzwxv" (OuterVolumeSpecName: "kube-api-access-hzwxv") pod "3f0ef1c2-7b3a-4ee6-bc20-76d7be132520" (UID: "3f0ef1c2-7b3a-4ee6-bc20-76d7be132520"). InnerVolumeSpecName "kube-api-access-hzwxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:30:04.567134 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.567106    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzwxv\" (UniqueName: \"kubernetes.io/projected/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-kube-api-access-hzwxv\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:30:04.567134 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.567131    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:30:04.750651 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:30:04.750620    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0ef1c2_7b3a_4ee6_bc20_76d7be132520.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 21:30:04.756003 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.755979    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"]
Sep 11 21:30:04.759754 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:30:04.759723    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="2857170b-8a2a-4a52-8c11-3cabe44cf875" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-5b37c5b2-29819370-8v6hs"
Sep 11 21:30:04.760436 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.760418    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c"]
Sep 11 21:30:04.805683 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.805653    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2857170b-8a2a-4a52-8c11-3cabe44cf875" path="/var/lib/kubelet/pods/2857170b-8a2a-4a52-8c11-3cabe44cf875/volumes"
Sep 11 21:30:04.806051 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.806036    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0ef1c2-7b3a-4ee6-bc20-76d7be132520" path="/var/lib/kubelet/pods/3f0ef1c2-7b3a-4ee6-bc20-76d7be132520/volumes"
Sep 11 21:30:04.806322 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:04.806310    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="722b5e80-901d-4291-9fc2-ccb06c127835" path="/var/lib/kubelet/pods/722b5e80-901d-4291-9fc2-ccb06c127835/volumes"
Sep 11 21:30:06.366528 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:06.366497    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:30:06.366933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:06.366660    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:30:14.012947 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.012908    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"]
Sep 11 21:30:14.013323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013298    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0ef1c2-7b3a-4ee6-bc20-76d7be132520" containerName="payload-pre-processing"
Sep 11 21:30:14.013323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013309    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0ef1c2-7b3a-4ee6-bc20-76d7be132520" containerName="payload-pre-processing"
Sep 11 21:30:14.013323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013321    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f786a3ef-a06b-409b-aee1-08b5028340b9" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013326    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f786a3ef-a06b-409b-aee1-08b5028340b9" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013339    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f786a3ef-a06b-409b-aee1-08b5028340b9" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013345    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f786a3ef-a06b-409b-aee1-08b5028340b9" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013354    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2857170b-8a2a-4a52-8c11-3cabe44cf875" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013359    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2857170b-8a2a-4a52-8c11-3cabe44cf875" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013372    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013377    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013384    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d72908-c56b-48bd-958f-4c73e63b8b52" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013388    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d72908-c56b-48bd-958f-4c73e63b8b52" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013444    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d72908-c56b-48bd-958f-4c73e63b8b52" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013453    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f786a3ef-a06b-409b-aee1-08b5028340b9" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013461    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2857170b-8a2a-4a52-8c11-3cabe44cf875" containerName="cleanup"
Sep 11 21:30:14.013461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013469    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0ef1c2-7b3a-4ee6-bc20-76d7be132520" containerName="payload-pre-processing"
Sep 11 21:30:14.014051 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013475    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7" containerName="cleanup"
Sep 11 21:30:14.014051 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.013480    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f786a3ef-a06b-409b-aee1-08b5028340b9" containerName="cleanup"
Sep 11 21:30:14.018193 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.018174    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:14.021499 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.021477    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d3e394ce\""
Sep 11 21:30:14.022520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.022498    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d3e394ce-dockercfg-rzk7m\""
Sep 11 21:30:14.032086 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.032063    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"]
Sep 11 21:30:14.058673 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.058643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/901fc295-80b2-4dee-a8bb-08fcc06d5ced-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9\" (UID: \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:14.058783 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.058761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnp8j\" (UniqueName: \"kubernetes.io/projected/901fc295-80b2-4dee-a8bb-08fcc06d5ced-kube-api-access-fnp8j\") pod \"payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9\" (UID: \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:14.159872 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.159814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnp8j\" (UniqueName: \"kubernetes.io/projected/901fc295-80b2-4dee-a8bb-08fcc06d5ced-kube-api-access-fnp8j\") pod \"payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9\" (UID: \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:14.160055 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.159949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/901fc295-80b2-4dee-a8bb-08fcc06d5ced-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9\" (UID: \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:14.160747 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.160710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/901fc295-80b2-4dee-a8bb-08fcc06d5ced-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9\" (UID: \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:14.176121 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.170403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnp8j\" (UniqueName: \"kubernetes.io/projected/901fc295-80b2-4dee-a8bb-08fcc06d5ced-kube-api-access-fnp8j\") pod \"payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9\" (UID: \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:14.329071 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.329040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:14.603399 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:14.603374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"]
Sep 11 21:30:14.605092 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:30:14.605070    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901fc295_80b2_4dee_a8bb_08fcc06d5ced.slice/crio-3d25e73406706523dd08c344a6b563e76f32ca5e546e9d38bb44afbe3509a04a WatchSource:0}: Error finding container 3d25e73406706523dd08c344a6b563e76f32ca5e546e9d38bb44afbe3509a04a: Status 404 returned error can't find the container with id 3d25e73406706523dd08c344a6b563e76f32ca5e546e9d38bb44afbe3509a04a
Sep 11 21:30:15.497388 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:15.497338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9" event={"ID":"901fc295-80b2-4dee-a8bb-08fcc06d5ced","Type":"ContainerStarted","Data":"d0e08f2b2f6ac36a0ee08e8d6d33377b47aa833996e8d9cbdf69c08ddca8dcf7"}
Sep 11 21:30:15.497912 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:15.497400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9" event={"ID":"901fc295-80b2-4dee-a8bb-08fcc06d5ced","Type":"ContainerStarted","Data":"3d25e73406706523dd08c344a6b563e76f32ca5e546e9d38bb44afbe3509a04a"}
Sep 11 21:30:15.497912 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:15.497523    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:15.525092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:15.524782    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9" podStartSLOduration=2.524764244 podStartE2EDuration="2.524764244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:15.523740465 +0000 UTC m=+773.236400513" watchObservedRunningTime="2026-09-11 21:30:15.524764244 +0000 UTC m=+773.237424294"
Sep 11 21:30:26.506733 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:26.506697    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:38.466078 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:38.466030    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"]
Sep 11 21:30:38.473405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:38.473390    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"
Sep 11 21:30:38.476423 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:38.476404    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:30:38.476544 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:38.476504    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:30:38.483726 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:38.483706    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"]
Sep 11 21:30:38.597883 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:38.597817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34acbc7-6233-44cf-9241-d47b233882ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr\" (UID: \"b34acbc7-6233-44cf-9241-d47b233882ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"
Sep 11 21:30:38.698589 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:38.698558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34acbc7-6233-44cf-9241-d47b233882ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr\" (UID: \"b34acbc7-6233-44cf-9241-d47b233882ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"
Sep 11 21:30:38.699207 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:38.699185    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34acbc7-6233-44cf-9241-d47b233882ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr\" (UID: \"b34acbc7-6233-44cf-9241-d47b233882ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"
Sep 11 21:30:38.784324 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:38.784247    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"
Sep 11 21:30:39.068009 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:39.067980    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"]
Sep 11 21:30:39.070363 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:30:39.070330    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34acbc7_6233_44cf_9241_d47b233882ed.slice/crio-b40487f6aa7c72b3ede8e646f973fc2ccc2e37489cc9409b63016cbb09bab537 WatchSource:0}: Error finding container b40487f6aa7c72b3ede8e646f973fc2ccc2e37489cc9409b63016cbb09bab537: Status 404 returned error can't find the container with id b40487f6aa7c72b3ede8e646f973fc2ccc2e37489cc9409b63016cbb09bab537
Sep 11 21:30:39.627685 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:39.627652    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr" event={"ID":"b34acbc7-6233-44cf-9241-d47b233882ed","Type":"ContainerStarted","Data":"5a3bb20b6a9e729b3d43b484e0b34e741969aa0389d90b0a5d959b684689bfe0"}
Sep 11 21:30:39.628097 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:39.627700    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr" event={"ID":"b34acbc7-6233-44cf-9241-d47b233882ed","Type":"ContainerStarted","Data":"b40487f6aa7c72b3ede8e646f973fc2ccc2e37489cc9409b63016cbb09bab537"}
Sep 11 21:30:39.647015 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:39.646969    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr" podStartSLOduration=1.646953101 podStartE2EDuration="1.646953101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:39.644638379 +0000 UTC m=+797.357298426" watchObservedRunningTime="2026-09-11 21:30:39.646953101 +0000 UTC m=+797.359613147"
Sep 11 21:30:40.634906 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:40.634871    2560 generic.go:356] "Generic (PLEG): container finished" podID="b34acbc7-6233-44cf-9241-d47b233882ed" containerID="5a3bb20b6a9e729b3d43b484e0b34e741969aa0389d90b0a5d959b684689bfe0" exitCode=0
Sep 11 21:30:40.635324 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:40.634971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr" event={"ID":"b34acbc7-6233-44cf-9241-d47b233882ed","Type":"ContainerDied","Data":"5a3bb20b6a9e729b3d43b484e0b34e741969aa0389d90b0a5d959b684689bfe0"}
Sep 11 21:30:41.783516 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:41.783482    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"
Sep 11 21:30:41.929230 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:41.929143    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34acbc7-6233-44cf-9241-d47b233882ed-maas-api-service-ca\") pod \"b34acbc7-6233-44cf-9241-d47b233882ed\" (UID: \"b34acbc7-6233-44cf-9241-d47b233882ed\") "
Sep 11 21:30:41.929481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:41.929458    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34acbc7-6233-44cf-9241-d47b233882ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b34acbc7-6233-44cf-9241-d47b233882ed" (UID: "b34acbc7-6233-44cf-9241-d47b233882ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:30:42.030564 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:42.030525    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34acbc7-6233-44cf-9241-d47b233882ed-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:30:42.652723 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:42.652691    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"
Sep 11 21:30:42.652926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:42.652737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr" event={"ID":"b34acbc7-6233-44cf-9241-d47b233882ed","Type":"ContainerDied","Data":"b40487f6aa7c72b3ede8e646f973fc2ccc2e37489cc9409b63016cbb09bab537"}
Sep 11 21:30:42.652926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:42.652790    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b40487f6aa7c72b3ede8e646f973fc2ccc2e37489cc9409b63016cbb09bab537"
Sep 11 21:30:50.450500 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.450418    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"]
Sep 11 21:30:50.450959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.450672    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9" podUID="901fc295-80b2-4dee-a8bb-08fcc06d5ced" containerName="payload-pre-processing" containerID="cri-o://d0e08f2b2f6ac36a0ee08e8d6d33377b47aa833996e8d9cbdf69c08ddca8dcf7" gracePeriod=30
Sep 11 21:30:50.704627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.704560    2560 generic.go:356] "Generic (PLEG): container finished" podID="901fc295-80b2-4dee-a8bb-08fcc06d5ced" containerID="d0e08f2b2f6ac36a0ee08e8d6d33377b47aa833996e8d9cbdf69c08ddca8dcf7" exitCode=0
Sep 11 21:30:50.704751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.704628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9" event={"ID":"901fc295-80b2-4dee-a8bb-08fcc06d5ced","Type":"ContainerDied","Data":"d0e08f2b2f6ac36a0ee08e8d6d33377b47aa833996e8d9cbdf69c08ddca8dcf7"}
Sep 11 21:30:50.704751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.704679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9" event={"ID":"901fc295-80b2-4dee-a8bb-08fcc06d5ced","Type":"ContainerDied","Data":"3d25e73406706523dd08c344a6b563e76f32ca5e546e9d38bb44afbe3509a04a"}
Sep 11 21:30:50.704751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.704702    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d25e73406706523dd08c344a6b563e76f32ca5e546e9d38bb44afbe3509a04a"
Sep 11 21:30:50.712463 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.712444    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:50.794625 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.794588    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"]
Sep 11 21:30:50.802807 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.802776    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3e394ce-2k9wr"]
Sep 11 21:30:50.811233 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.810486    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnp8j\" (UniqueName: \"kubernetes.io/projected/901fc295-80b2-4dee-a8bb-08fcc06d5ced-kube-api-access-fnp8j\") pod \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\" (UID: \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\") "
Sep 11 21:30:50.811233 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.810623    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/901fc295-80b2-4dee-a8bb-08fcc06d5ced-plugins-config-volume\") pod \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\" (UID: \"901fc295-80b2-4dee-a8bb-08fcc06d5ced\") "
Sep 11 21:30:50.811649 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.811498    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/901fc295-80b2-4dee-a8bb-08fcc06d5ced-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "901fc295-80b2-4dee-a8bb-08fcc06d5ced" (UID: "901fc295-80b2-4dee-a8bb-08fcc06d5ced"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:30:50.814243 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.814210    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/901fc295-80b2-4dee-a8bb-08fcc06d5ced-kube-api-access-fnp8j" (OuterVolumeSpecName: "kube-api-access-fnp8j") pod "901fc295-80b2-4dee-a8bb-08fcc06d5ced" (UID: "901fc295-80b2-4dee-a8bb-08fcc06d5ced"). InnerVolumeSpecName "kube-api-access-fnp8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:30:50.912035 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.911994    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnp8j\" (UniqueName: \"kubernetes.io/projected/901fc295-80b2-4dee-a8bb-08fcc06d5ced-kube-api-access-fnp8j\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:30:50.912035 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:50.912026    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/901fc295-80b2-4dee-a8bb-08fcc06d5ced-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:30:51.709251 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.709221    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"
Sep 11 21:30:51.764463 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.764429    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"]
Sep 11 21:30:51.778835 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.778784    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9"]
Sep 11 21:30:51.812614 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.812580    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"]
Sep 11 21:30:51.813027 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.813013    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901fc295-80b2-4dee-a8bb-08fcc06d5ced" containerName="payload-pre-processing"
Sep 11 21:30:51.813070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.813028    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="901fc295-80b2-4dee-a8bb-08fcc06d5ced" containerName="payload-pre-processing"
Sep 11 21:30:51.813070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.813039    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34acbc7-6233-44cf-9241-d47b233882ed" containerName="revoke-keys"
Sep 11 21:30:51.813070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.813044    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34acbc7-6233-44cf-9241-d47b233882ed" containerName="revoke-keys"
Sep 11 21:30:51.813176 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.813100    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b34acbc7-6233-44cf-9241-d47b233882ed" containerName="revoke-keys"
Sep 11 21:30:51.813176 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.813109    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="901fc295-80b2-4dee-a8bb-08fcc06d5ced" containerName="payload-pre-processing"
Sep 11 21:30:51.816322 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.816304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:51.819406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.819365    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b0bde17e-openshift-default-dockercfg-j7qpt\""
Sep 11 21:30:51.835101 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.835067    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"]
Sep 11 21:30:51.923048 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.923012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-podinfo\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:51.923048 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.923052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-certs\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:51.923249 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.923076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cbbce-c4bf-4b86-8871-317ed89fecfa-istiod-ca-cert\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:51.923249 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.923200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-token\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:51.923249 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.923242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-data\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:51.923361 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.923264    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-credential-socket\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:51.923361 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.923347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs58b\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-kube-api-access-gs58b\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:51.923434 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.923376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-socket\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:51.923434 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:51.923397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-envoy\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.023986 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.023900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-podinfo\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.023986 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.023938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-certs\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.023986 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.023977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cbbce-c4bf-4b86-8871-317ed89fecfa-istiod-ca-cert\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-token\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-data\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-credential-socket\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs58b\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-kube-api-access-gs58b\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-socket\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-envoy\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024644 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-certs\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024644 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-data\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024979 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-socket\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.024979 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.024730    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-credential-socket\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.025102 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.025003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cbbce-c4bf-4b86-8871-317ed89fecfa-istiod-ca-cert\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.026649 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.026628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-envoy\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.026803 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.026714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-podinfo\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.041628 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.041605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs58b\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-kube-api-access-gs58b\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.041628 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.041620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-token\") pod \"e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") " pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.126214 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.126183    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:52.423143 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.423117    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"]
Sep 11 21:30:52.423879 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:30:52.423849    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373cbbce_c4bf_4b86_8871_317ed89fecfa.slice/crio-c04c98ff48416279e27cd085ea105d4c4f92bb6f387c0675a6b3f372aa7eb24c WatchSource:0}: Error finding container c04c98ff48416279e27cd085ea105d4c4f92bb6f387c0675a6b3f372aa7eb24c: Status 404 returned error can't find the container with id c04c98ff48416279e27cd085ea105d4c4f92bb6f387c0675a6b3f372aa7eb24c
Sep 11 21:30:52.426167 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.426128    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:30:52.426285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.426217    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:30:52.426285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.426261    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:30:52.718504 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.718417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" event={"ID":"373cbbce-c4bf-4b86-8871-317ed89fecfa","Type":"ContainerStarted","Data":"53eeaee13ddd6df89b64b53660e053bb85915a6738e26636c543e915a2201903"}
Sep 11 21:30:52.718504 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.718479    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" event={"ID":"373cbbce-c4bf-4b86-8871-317ed89fecfa","Type":"ContainerStarted","Data":"c04c98ff48416279e27cd085ea105d4c4f92bb6f387c0675a6b3f372aa7eb24c"}
Sep 11 21:30:52.744930 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.744883    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" podStartSLOduration=1.7448667150000001 podStartE2EDuration="1.744866715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:52.743532939 +0000 UTC m=+810.456192987" watchObservedRunningTime="2026-09-11 21:30:52.744866715 +0000 UTC m=+810.457526761"
Sep 11 21:30:52.803298 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.803268    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="901fc295-80b2-4dee-a8bb-08fcc06d5ced" path="/var/lib/kubelet/pods/901fc295-80b2-4dee-a8bb-08fcc06d5ced/volumes"
Sep 11 21:30:52.803605 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:52.803592    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b34acbc7-6233-44cf-9241-d47b233882ed" path="/var/lib/kubelet/pods/b34acbc7-6233-44cf-9241-d47b233882ed/volumes"
Sep 11 21:30:53.126377 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:53.126342    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:53.131618 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:53.131594    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:53.724181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:53.724150    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:30:53.725145 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:30:53.725123    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:31:17.855241 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:17.855208    2560 generic.go:356] "Generic (PLEG): container finished" podID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerID="53eeaee13ddd6df89b64b53660e053bb85915a6738e26636c543e915a2201903" exitCode=0
Sep 11 21:31:17.855586 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:17.855273    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" event={"ID":"373cbbce-c4bf-4b86-8871-317ed89fecfa","Type":"ContainerDied","Data":"53eeaee13ddd6df89b64b53660e053bb85915a6738e26636c543e915a2201903"}
Sep 11 21:31:17.855705 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:17.855692    2560 scope.go:117] "RemoveContainer" containerID="53eeaee13ddd6df89b64b53660e053bb85915a6738e26636c543e915a2201903"
Sep 11 21:31:17.856912 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:17.856881    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:31:17.857021 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:17.856971    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:31:17.857085 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:17.857020    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:31:18.862761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:18.862727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" event={"ID":"373cbbce-c4bf-4b86-8871-317ed89fecfa","Type":"ContainerStarted","Data":"dc6785d546a548853691920ed76071e59c1f2f87f2f280d1ec5dc9b3b4641da2"}
Sep 11 21:31:19.127260 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:19.127168    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:31:19.127970 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:19.127941    2560 patch_prober.go:28] interesting pod/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:31:19.128088 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:19.128006    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 21:31:20.127031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:20.127002    2560 patch_prober.go:28] interesting pod/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:31:20.127392 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:20.127052    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 21:31:21.127274 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:21.127234    2560 patch_prober.go:28] interesting pod/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:31:21.127668 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:21.127302    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 21:31:22.127031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:22.126996    2560 patch_prober.go:28] interesting pod/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:31:22.127231 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:22.127050    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 21:31:23.126657 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:23.126615    2560 patch_prober.go:28] interesting pod/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:31:23.127148 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:23.126684    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 21:31:23.724252 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:23.724218    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:31:24.127683 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:24.127647    2560 patch_prober.go:28] interesting pod/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:31:24.128102 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:24.127724    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 21:31:25.131426 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.131365    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:31:25.132801 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.132775    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:31:25.134125 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.134105    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"]
Sep 11 21:31:25.137696 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.137679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"
Sep 11 21:31:25.140437 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.140417    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:31:25.141043 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.141027    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:31:25.154645 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.154623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"]
Sep 11 21:31:25.163264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.163224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f15c7d8-4c11-4a30-8895-b9bc96c16858-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn\" (UID: \"5f15c7d8-4c11-4a30-8895-b9bc96c16858\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"
Sep 11 21:31:25.264795 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.264765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f15c7d8-4c11-4a30-8895-b9bc96c16858-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn\" (UID: \"5f15c7d8-4c11-4a30-8895-b9bc96c16858\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"
Sep 11 21:31:25.265494 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.265467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f15c7d8-4c11-4a30-8895-b9bc96c16858-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn\" (UID: \"5f15c7d8-4c11-4a30-8895-b9bc96c16858\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"
Sep 11 21:31:25.448165 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.448084    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"
Sep 11 21:31:25.734154 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.734126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"]
Sep 11 21:31:25.735614 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:31:25.735587    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f15c7d8_4c11_4a30_8895_b9bc96c16858.slice/crio-f92d70f743576f2e11de1208a207124b477405a5e4a8b8d4c2831dc13ed8f519 WatchSource:0}: Error finding container f92d70f743576f2e11de1208a207124b477405a5e4a8b8d4c2831dc13ed8f519: Status 404 returned error can't find the container with id f92d70f743576f2e11de1208a207124b477405a5e4a8b8d4c2831dc13ed8f519
Sep 11 21:31:25.906387 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:25.906355    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn" event={"ID":"5f15c7d8-4c11-4a30-8895-b9bc96c16858","Type":"ContainerStarted","Data":"f92d70f743576f2e11de1208a207124b477405a5e4a8b8d4c2831dc13ed8f519"}
Sep 11 21:31:26.914841 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:26.914785    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f15c7d8-4c11-4a30-8895-b9bc96c16858" containerID="3ac679b57b278ee566f4a379d9f08dd7aefa8c6f446b29f2322c28381dcc0b1e" exitCode=0
Sep 11 21:31:26.915227 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:26.914879    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn" event={"ID":"5f15c7d8-4c11-4a30-8895-b9bc96c16858","Type":"ContainerDied","Data":"3ac679b57b278ee566f4a379d9f08dd7aefa8c6f446b29f2322c28381dcc0b1e"}
Sep 11 21:31:28.058648 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:28.058623    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"
Sep 11 21:31:28.094432 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:28.094398    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f15c7d8-4c11-4a30-8895-b9bc96c16858-maas-api-service-ca\") pod \"5f15c7d8-4c11-4a30-8895-b9bc96c16858\" (UID: \"5f15c7d8-4c11-4a30-8895-b9bc96c16858\") "
Sep 11 21:31:28.094842 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:28.094791    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f15c7d8-4c11-4a30-8895-b9bc96c16858-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5f15c7d8-4c11-4a30-8895-b9bc96c16858" (UID: "5f15c7d8-4c11-4a30-8895-b9bc96c16858"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:31:28.195925 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:28.195809    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f15c7d8-4c11-4a30-8895-b9bc96c16858-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:28.927342 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:28.927308    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn" event={"ID":"5f15c7d8-4c11-4a30-8895-b9bc96c16858","Type":"ContainerDied","Data":"f92d70f743576f2e11de1208a207124b477405a5e4a8b8d4c2831dc13ed8f519"}
Sep 11 21:31:28.927342 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:28.927342    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"
Sep 11 21:31:28.927542 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:28.927354    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f92d70f743576f2e11de1208a207124b477405a5e4a8b8d4c2831dc13ed8f519"
Sep 11 21:31:36.677087 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:36.677046    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"]
Sep 11 21:31:36.679360 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:36.679334    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b0bde17e-pnwnn"]
Sep 11 21:31:36.801101 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:36.801069    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f15c7d8-4c11-4a30-8895-b9bc96c16858" path="/var/lib/kubelet/pods/5f15c7d8-4c11-4a30-8895-b9bc96c16858/volumes"
Sep 11 21:31:37.839078 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:37.839045    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"]
Sep 11 21:31:37.839538 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:37.839264    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy" containerID="cri-o://dc6785d546a548853691920ed76071e59c1f2f87f2f280d1ec5dc9b3b4641da2" gracePeriod=30
Sep 11 21:31:38.637956 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.637925    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"]
Sep 11 21:31:38.638364 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.638351    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f15c7d8-4c11-4a30-8895-b9bc96c16858" containerName="revoke-keys"
Sep 11 21:31:38.638364 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.638364    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f15c7d8-4c11-4a30-8895-b9bc96c16858" containerName="revoke-keys"
Sep 11 21:31:38.638461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.638451    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f15c7d8-4c11-4a30-8895-b9bc96c16858" containerName="revoke-keys"
Sep 11 21:31:38.641738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.641718    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.645117 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.645096    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0cd86cdc-openshift-default-dockercfg-7mpkr\""
Sep 11 21:31:38.661334 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.661313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"]
Sep 11 21:31:38.692431 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.692405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110a818-003b-446f-94a2-552a7d99da10-istio-podinfo\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.692535 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.692433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-socket\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.692535 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.692456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-istio-token\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.692535 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.692485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-certs\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.692701 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.692554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-envoy\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.692701 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.692620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-data\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.692701 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.692658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110a818-003b-446f-94a2-552a7d99da10-istiod-ca-cert\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.692890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.692750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgqk4\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-kube-api-access-sgqk4\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.692890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.692817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-credential-socket\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.793715 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.793660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-data\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.793715 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.793718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110a818-003b-446f-94a2-552a7d99da10-istiod-ca-cert\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794004 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.793775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgqk4\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-kube-api-access-sgqk4\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794004 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.793811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-credential-socket\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794004 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.793903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110a818-003b-446f-94a2-552a7d99da10-istio-podinfo\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794004 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.793935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-socket\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794004 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.793975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-istio-token\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.794033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-certs\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.794083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-envoy\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.794162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-data\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.794201    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-credential-socket\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.794271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-socket\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.794459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-certs\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.794602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.794584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110a818-003b-446f-94a2-552a7d99da10-istiod-ca-cert\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.796399 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.796378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-envoy\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.796650 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.796627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110a818-003b-446f-94a2-552a7d99da10-istio-podinfo\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.805032 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.805005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-istio-token\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.805401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.805367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgqk4\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-kube-api-access-sgqk4\") pod \"e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") " pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:38.951402 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:38.951323    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:39.234312 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:39.234283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"]
Sep 11 21:31:39.238448 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:31:39.238391    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd110a818_003b_446f_94a2_552a7d99da10.slice/crio-ede3a773b2ef9059f8ba9e7493099407a8b461c3e0b00bc7442fc95a23d7c97b WatchSource:0}: Error finding container ede3a773b2ef9059f8ba9e7493099407a8b461c3e0b00bc7442fc95a23d7c97b: Status 404 returned error can't find the container with id ede3a773b2ef9059f8ba9e7493099407a8b461c3e0b00bc7442fc95a23d7c97b
Sep 11 21:31:39.241577 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:39.241542    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:31:39.241649 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:39.241611    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:31:39.241649 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:39.241640    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:31:39.991195 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:39.990627    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" event={"ID":"d110a818-003b-446f-94a2-552a7d99da10","Type":"ContainerStarted","Data":"3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4"}
Sep 11 21:31:39.991195 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:39.990702    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" event={"ID":"d110a818-003b-446f-94a2-552a7d99da10","Type":"ContainerStarted","Data":"ede3a773b2ef9059f8ba9e7493099407a8b461c3e0b00bc7442fc95a23d7c97b"}
Sep 11 21:31:40.012346 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:40.012288    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" podStartSLOduration=2.012267655 podStartE2EDuration="2.012267655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:40.011437132 +0000 UTC m=+857.724097179" watchObservedRunningTime="2026-09-11 21:31:40.012267655 +0000 UTC m=+857.724927704"
Sep 11 21:31:40.135889 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:40.135845    2560 patch_prober.go:28] interesting pod/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 21:31:40.136085 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:40.135916    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:31:40.952003 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:40.951968    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:40.957169 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:40.957146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:40.996363 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:40.996333    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:40.997319 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:40.997299    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:31:43.010181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.010144    2560 generic.go:356] "Generic (PLEG): container finished" podID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerID="dc6785d546a548853691920ed76071e59c1f2f87f2f280d1ec5dc9b3b4641da2" exitCode=0
Sep 11 21:31:43.010616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.010215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" event={"ID":"373cbbce-c4bf-4b86-8871-317ed89fecfa","Type":"ContainerDied","Data":"dc6785d546a548853691920ed76071e59c1f2f87f2f280d1ec5dc9b3b4641da2"}
Sep 11 21:31:43.010967 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.010626    2560 scope.go:117] "RemoveContainer" containerID="53eeaee13ddd6df89b64b53660e053bb85915a6738e26636c543e915a2201903"
Sep 11 21:31:43.101886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.101795    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:31:43.237535 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.237503    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cbbce-c4bf-4b86-8871-317ed89fecfa-istiod-ca-cert\") pod \"373cbbce-c4bf-4b86-8871-317ed89fecfa\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") "
Sep 11 21:31:43.237535 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.237552    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-envoy\") pod \"373cbbce-c4bf-4b86-8871-317ed89fecfa\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") "
Sep 11 21:31:43.237977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.237579    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs58b\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-kube-api-access-gs58b\") pod \"373cbbce-c4bf-4b86-8871-317ed89fecfa\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") "
Sep 11 21:31:43.237977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.237710    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-socket\") pod \"373cbbce-c4bf-4b86-8871-317ed89fecfa\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") "
Sep 11 21:31:43.237977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.237754    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-certs\") pod \"373cbbce-c4bf-4b86-8871-317ed89fecfa\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") "
Sep 11 21:31:43.237977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.237869    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-credential-socket\") pod \"373cbbce-c4bf-4b86-8871-317ed89fecfa\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") "
Sep 11 21:31:43.237977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.237911    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-data\") pod \"373cbbce-c4bf-4b86-8871-317ed89fecfa\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") "
Sep 11 21:31:43.238254 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.237983    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-token\") pod \"373cbbce-c4bf-4b86-8871-317ed89fecfa\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") "
Sep 11 21:31:43.238254 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.238012    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373cbbce-c4bf-4b86-8871-317ed89fecfa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "373cbbce-c4bf-4b86-8871-317ed89fecfa" (UID: "373cbbce-c4bf-4b86-8871-317ed89fecfa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:31:43.238254 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.238027    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-podinfo\") pod \"373cbbce-c4bf-4b86-8871-317ed89fecfa\" (UID: \"373cbbce-c4bf-4b86-8871-317ed89fecfa\") "
Sep 11 21:31:43.238254 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.238223    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "373cbbce-c4bf-4b86-8871-317ed89fecfa" (UID: "373cbbce-c4bf-4b86-8871-317ed89fecfa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:31:43.238446 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.238240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "373cbbce-c4bf-4b86-8871-317ed89fecfa" (UID: "373cbbce-c4bf-4b86-8871-317ed89fecfa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:31:43.238446 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.238404    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:43.238446 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.238423    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:43.238446 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.238437    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cbbce-c4bf-4b86-8871-317ed89fecfa-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:43.238446 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.238412    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-data" (OuterVolumeSpecName: "istio-data") pod "373cbbce-c4bf-4b86-8871-317ed89fecfa" (UID: "373cbbce-c4bf-4b86-8871-317ed89fecfa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:31:43.238699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.238473    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "373cbbce-c4bf-4b86-8871-317ed89fecfa" (UID: "373cbbce-c4bf-4b86-8871-317ed89fecfa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:31:43.240645 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.240621    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-kube-api-access-gs58b" (OuterVolumeSpecName: "kube-api-access-gs58b") pod "373cbbce-c4bf-4b86-8871-317ed89fecfa" (UID: "373cbbce-c4bf-4b86-8871-317ed89fecfa"). InnerVolumeSpecName "kube-api-access-gs58b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:31:43.240731 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.240697    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "373cbbce-c4bf-4b86-8871-317ed89fecfa" (UID: "373cbbce-c4bf-4b86-8871-317ed89fecfa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:31:43.240967 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.240951    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-token" (OuterVolumeSpecName: "istio-token") pod "373cbbce-c4bf-4b86-8871-317ed89fecfa" (UID: "373cbbce-c4bf-4b86-8871-317ed89fecfa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:31:43.241039 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.241014    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "373cbbce-c4bf-4b86-8871-317ed89fecfa" (UID: "373cbbce-c4bf-4b86-8871-317ed89fecfa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:31:43.339917 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.339878    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:43.339917 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.339910    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:43.339917 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.339919    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:43.339917 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.339927    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:43.340185 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.339934    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cbbce-c4bf-4b86-8871-317ed89fecfa-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:43.340185 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:43.339942    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs58b\" (UniqueName: \"kubernetes.io/projected/373cbbce-c4bf-4b86-8871-317ed89fecfa-kube-api-access-gs58b\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:44.017014 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.016978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv" event={"ID":"373cbbce-c4bf-4b86-8871-317ed89fecfa","Type":"ContainerDied","Data":"c04c98ff48416279e27cd085ea105d4c4f92bb6f387c0675a6b3f372aa7eb24c"}
Sep 11 21:31:44.017014 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.017009    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"
Sep 11 21:31:44.017498 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.017043    2560 scope.go:117] "RemoveContainer" containerID="dc6785d546a548853691920ed76071e59c1f2f87f2f280d1ec5dc9b3b4641da2"
Sep 11 21:31:44.036072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.036048    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"]
Sep 11 21:31:44.036437 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.036426    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy"
Sep 11 21:31:44.036479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.036439    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy"
Sep 11 21:31:44.036514 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.036508    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy"
Sep 11 21:31:44.036546 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.036519    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy"
Sep 11 21:31:44.040378 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.040361    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:44.042594 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.042575    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0cd86cdc-dockercfg-jl8tg\""
Sep 11 21:31:44.043121 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.043106    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0cd86cdc\""
Sep 11 21:31:44.058469 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.058447    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"]
Sep 11 21:31:44.061408 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.061373    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"]
Sep 11 21:31:44.063358 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.063337    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv"]
Sep 11 21:31:44.148547 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.148509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5xmm\" (UniqueName: \"kubernetes.io/projected/2c1f52a5-16b8-414b-bb08-4733d1330f90-kube-api-access-k5xmm\") pod \"payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r\" (UID: \"2c1f52a5-16b8-414b-bb08-4733d1330f90\") " pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:44.148872 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.148812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c1f52a5-16b8-414b-bb08-4733d1330f90-plugins-config-volume\") pod \"payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r\" (UID: \"2c1f52a5-16b8-414b-bb08-4733d1330f90\") " pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:44.250001 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.249959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5xmm\" (UniqueName: \"kubernetes.io/projected/2c1f52a5-16b8-414b-bb08-4733d1330f90-kube-api-access-k5xmm\") pod \"payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r\" (UID: \"2c1f52a5-16b8-414b-bb08-4733d1330f90\") " pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:44.250001 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.250009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c1f52a5-16b8-414b-bb08-4733d1330f90-plugins-config-volume\") pod \"payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r\" (UID: \"2c1f52a5-16b8-414b-bb08-4733d1330f90\") " pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:44.250656 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.250636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c1f52a5-16b8-414b-bb08-4733d1330f90-plugins-config-volume\") pod \"payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r\" (UID: \"2c1f52a5-16b8-414b-bb08-4733d1330f90\") " pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:44.261664 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.261642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5xmm\" (UniqueName: \"kubernetes.io/projected/2c1f52a5-16b8-414b-bb08-4733d1330f90-kube-api-access-k5xmm\") pod \"payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r\" (UID: \"2c1f52a5-16b8-414b-bb08-4733d1330f90\") " pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:44.349788 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.349755    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:44.625341 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.625216    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"]
Sep 11 21:31:44.628120 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:31:44.628092    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c1f52a5_16b8_414b_bb08_4733d1330f90.slice/crio-70b6b6c4f9ae9546a1016fd9372b9791d07833ee5ddd35c305718651586b0351 WatchSource:0}: Error finding container 70b6b6c4f9ae9546a1016fd9372b9791d07833ee5ddd35c305718651586b0351: Status 404 returned error can't find the container with id 70b6b6c4f9ae9546a1016fd9372b9791d07833ee5ddd35c305718651586b0351
Sep 11 21:31:44.801069 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:44.801039    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" path="/var/lib/kubelet/pods/373cbbce-c4bf-4b86-8871-317ed89fecfa/volumes"
Sep 11 21:31:45.024699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:45.024601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r" event={"ID":"2c1f52a5-16b8-414b-bb08-4733d1330f90","Type":"ContainerStarted","Data":"4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca"}
Sep 11 21:31:45.024699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:45.024661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r" event={"ID":"2c1f52a5-16b8-414b-bb08-4733d1330f90","Type":"ContainerStarted","Data":"70b6b6c4f9ae9546a1016fd9372b9791d07833ee5ddd35c305718651586b0351"}
Sep 11 21:31:45.024699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:45.024693    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:45.043961 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:45.043914    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r" podStartSLOduration=1.043897841 podStartE2EDuration="1.043897841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:45.040688247 +0000 UTC m=+862.753348295" watchObservedRunningTime="2026-09-11 21:31:45.043897841 +0000 UTC m=+862.756557890"
Sep 11 21:31:48.643781 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.643742    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"]
Sep 11 21:31:48.644245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.644231    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy"
Sep 11 21:31:48.644311 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.644247    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="373cbbce-c4bf-4b86-8871-317ed89fecfa" containerName="istio-proxy"
Sep 11 21:31:48.647461 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.647445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"
Sep 11 21:31:48.650191 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.650167    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:31:48.650310 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.650187    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:31:48.657503 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.657481    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"]
Sep 11 21:31:48.797354 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.797321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8ec18e-13e6-403a-b233-4f633b08dd67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-1e9b41-kln75\" (UID: \"1b8ec18e-13e6-403a-b233-4f633b08dd67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"
Sep 11 21:31:48.898583 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.898506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8ec18e-13e6-403a-b233-4f633b08dd67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-1e9b41-kln75\" (UID: \"1b8ec18e-13e6-403a-b233-4f633b08dd67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"
Sep 11 21:31:48.899129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.899110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8ec18e-13e6-403a-b233-4f633b08dd67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-1e9b41-kln75\" (UID: \"1b8ec18e-13e6-403a-b233-4f633b08dd67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"
Sep 11 21:31:48.959206 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:48.959178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"
Sep 11 21:31:49.232659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:49.232630    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"]
Sep 11 21:31:49.234612 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:31:49.234586    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8ec18e_13e6_403a_b233_4f633b08dd67.slice/crio-51a8058eaae7a1d2ebd5e398b7257851a591ace7cee9f6ea0d6e8dd17b6a8160 WatchSource:0}: Error finding container 51a8058eaae7a1d2ebd5e398b7257851a591ace7cee9f6ea0d6e8dd17b6a8160: Status 404 returned error can't find the container with id 51a8058eaae7a1d2ebd5e398b7257851a591ace7cee9f6ea0d6e8dd17b6a8160
Sep 11 21:31:50.068264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:50.068233    2560 generic.go:356] "Generic (PLEG): container finished" podID="1b8ec18e-13e6-403a-b233-4f633b08dd67" containerID="1bfd6fdc799175f69a70bc869a9b32e5e67b6782c5d177ee5dbe2f3d54dc3a62" exitCode=0
Sep 11 21:31:50.068622 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:50.068311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75" event={"ID":"1b8ec18e-13e6-403a-b233-4f633b08dd67","Type":"ContainerDied","Data":"1bfd6fdc799175f69a70bc869a9b32e5e67b6782c5d177ee5dbe2f3d54dc3a62"}
Sep 11 21:31:50.068622 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:50.068363    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75" event={"ID":"1b8ec18e-13e6-403a-b233-4f633b08dd67","Type":"ContainerStarted","Data":"51a8058eaae7a1d2ebd5e398b7257851a591ace7cee9f6ea0d6e8dd17b6a8160"}
Sep 11 21:31:51.206609 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:51.206586    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"
Sep 11 21:31:51.323336 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:51.323300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8ec18e-13e6-403a-b233-4f633b08dd67-maas-api-service-ca\") pod \"1b8ec18e-13e6-403a-b233-4f633b08dd67\" (UID: \"1b8ec18e-13e6-403a-b233-4f633b08dd67\") "
Sep 11 21:31:51.323661 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:51.323638    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b8ec18e-13e6-403a-b233-4f633b08dd67-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1b8ec18e-13e6-403a-b233-4f633b08dd67" (UID: "1b8ec18e-13e6-403a-b233-4f633b08dd67"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:31:51.424944 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:51.424861    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8ec18e-13e6-403a-b233-4f633b08dd67-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:52.080695 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:52.080667    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"
Sep 11 21:31:52.080894 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:52.080660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75" event={"ID":"1b8ec18e-13e6-403a-b233-4f633b08dd67","Type":"ContainerDied","Data":"51a8058eaae7a1d2ebd5e398b7257851a591ace7cee9f6ea0d6e8dd17b6a8160"}
Sep 11 21:31:52.080894 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:52.080787    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51a8058eaae7a1d2ebd5e398b7257851a591ace7cee9f6ea0d6e8dd17b6a8160"
Sep 11 21:31:56.039930 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:56.039900    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:31:59.307056 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.307021    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"]
Sep 11 21:31:59.307781 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.307750    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn" podUID="98c4d771-a138-4820-bda7-0fd889e8fa58" containerName="payload-processing" containerID="cri-o://cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078" gracePeriod=30
Sep 11 21:31:59.512987 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.512867    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"]
Sep 11 21:31:59.515488 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.515469    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1e9b41-kln75"]
Sep 11 21:31:59.649037 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.649010    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:31:59.714404 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.714363    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c4d771-a138-4820-bda7-0fd889e8fa58-plugins-config-volume\") pod \"98c4d771-a138-4820-bda7-0fd889e8fa58\" (UID: \"98c4d771-a138-4820-bda7-0fd889e8fa58\") "
Sep 11 21:31:59.714553 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.714482    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j5lr\" (UniqueName: \"kubernetes.io/projected/98c4d771-a138-4820-bda7-0fd889e8fa58-kube-api-access-5j5lr\") pod \"98c4d771-a138-4820-bda7-0fd889e8fa58\" (UID: \"98c4d771-a138-4820-bda7-0fd889e8fa58\") "
Sep 11 21:31:59.715264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.715240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98c4d771-a138-4820-bda7-0fd889e8fa58-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98c4d771-a138-4820-bda7-0fd889e8fa58" (UID: "98c4d771-a138-4820-bda7-0fd889e8fa58"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:31:59.716759 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.716738    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98c4d771-a138-4820-bda7-0fd889e8fa58-kube-api-access-5j5lr" (OuterVolumeSpecName: "kube-api-access-5j5lr") pod "98c4d771-a138-4820-bda7-0fd889e8fa58" (UID: "98c4d771-a138-4820-bda7-0fd889e8fa58"). InnerVolumeSpecName "kube-api-access-5j5lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:31:59.815810 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.815766    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98c4d771-a138-4820-bda7-0fd889e8fa58-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:31:59.815810 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:31:59.815806    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j5lr\" (UniqueName: \"kubernetes.io/projected/98c4d771-a138-4820-bda7-0fd889e8fa58-kube-api-access-5j5lr\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:00.140369 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.140332    2560 generic.go:356] "Generic (PLEG): container finished" podID="98c4d771-a138-4820-bda7-0fd889e8fa58" containerID="cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078" exitCode=0
Sep 11 21:32:00.140542 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.140408    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"
Sep 11 21:32:00.140542 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.140518    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn" event={"ID":"98c4d771-a138-4820-bda7-0fd889e8fa58","Type":"ContainerDied","Data":"cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078"}
Sep 11 21:32:00.140620 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.140561    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn" event={"ID":"98c4d771-a138-4820-bda7-0fd889e8fa58","Type":"ContainerDied","Data":"a9229f2a79da589b9de3a4d7124a2694142460af231b8a35ffa6c5d4a4b54a4e"}
Sep 11 21:32:00.140620 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.140589    2560 scope.go:117] "RemoveContainer" containerID="cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078"
Sep 11 21:32:00.153220 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.153201    2560 scope.go:117] "RemoveContainer" containerID="cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078"
Sep 11 21:32:00.153515 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:32:00.153496    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078\": container with ID starting with cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078 not found: ID does not exist" containerID="cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078"
Sep 11 21:32:00.153562 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.153524    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078"} err="failed to get container status \"cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078\": rpc error: code = NotFound desc = could not find container \"cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078\": container with ID starting with cb556cd925f07ea9a9079379d9e8cf0e59e88b0fa56a3d781a3ddf0900cd1078 not found: ID does not exist"
Sep 11 21:32:00.165964 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.165936    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"]
Sep 11 21:32:00.172401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.172378    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn"]
Sep 11 21:32:00.800964 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.800922    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b8ec18e-13e6-403a-b233-4f633b08dd67" path="/var/lib/kubelet/pods/1b8ec18e-13e6-403a-b233-4f633b08dd67/volumes"
Sep 11 21:32:00.801404 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:00.801294    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98c4d771-a138-4820-bda7-0fd889e8fa58" path="/var/lib/kubelet/pods/98c4d771-a138-4820-bda7-0fd889e8fa58/volumes"
Sep 11 21:32:04.165655 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:04.165621    2560 generic.go:356] "Generic (PLEG): container finished" podID="d110a818-003b-446f-94a2-552a7d99da10" containerID="3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4" exitCode=0
Sep 11 21:32:04.166105 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:04.165684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" event={"ID":"d110a818-003b-446f-94a2-552a7d99da10","Type":"ContainerDied","Data":"3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4"}
Sep 11 21:32:04.166150 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:04.166103    2560 scope.go:117] "RemoveContainer" containerID="3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4"
Sep 11 21:32:04.167214 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:04.167182    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:32:04.167278 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:04.167255    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:32:04.167319 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:04.167287    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:32:05.184247 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:05.181912    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" event={"ID":"d110a818-003b-446f-94a2-552a7d99da10","Type":"ContainerStarted","Data":"986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc"}
Sep 11 21:32:05.952457 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:05.952424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:32:05.952641 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:05.952625    2560 patch_prober.go:28] interesting pod/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 21:32:05.952692 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:05.952675    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 21:32:06.952513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:06.952476    2560 patch_prober.go:28] interesting pod/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 21:32:06.953044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:06.952546    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 21:32:07.952401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:07.952364    2560 patch_prober.go:28] interesting pod/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 21:32:07.952700 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:07.952426    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 21:32:08.952340 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:08.952307    2560 patch_prober.go:28] interesting pod/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 21:32:08.952514 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:08.952361    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 21:32:09.951998 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:09.951963    2560 patch_prober.go:28] interesting pod/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 21:32:09.952430 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:09.952026    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 21:32:10.956113 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:10.956081    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:32:10.956545 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:10.956486    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:32:10.957106 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:10.957089    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:32:12.201372 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.201337    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"]
Sep 11 21:32:12.201842 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.201618    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r" podUID="2c1f52a5-16b8-414b-bb08-4733d1330f90" containerName="payload-processing" containerID="cri-o://4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca" gracePeriod=30
Sep 11 21:32:12.454899 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.454873    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:32:12.531847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.531095    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5xmm\" (UniqueName: \"kubernetes.io/projected/2c1f52a5-16b8-414b-bb08-4733d1330f90-kube-api-access-k5xmm\") pod \"2c1f52a5-16b8-414b-bb08-4733d1330f90\" (UID: \"2c1f52a5-16b8-414b-bb08-4733d1330f90\") "
Sep 11 21:32:12.531847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.531275    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c1f52a5-16b8-414b-bb08-4733d1330f90-plugins-config-volume\") pod \"2c1f52a5-16b8-414b-bb08-4733d1330f90\" (UID: \"2c1f52a5-16b8-414b-bb08-4733d1330f90\") "
Sep 11 21:32:12.532096 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.532039    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1f52a5-16b8-414b-bb08-4733d1330f90-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c1f52a5-16b8-414b-bb08-4733d1330f90" (UID: "2c1f52a5-16b8-414b-bb08-4733d1330f90"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:32:12.535350 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.535305    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1f52a5-16b8-414b-bb08-4733d1330f90-kube-api-access-k5xmm" (OuterVolumeSpecName: "kube-api-access-k5xmm") pod "2c1f52a5-16b8-414b-bb08-4733d1330f90" (UID: "2c1f52a5-16b8-414b-bb08-4733d1330f90"). InnerVolumeSpecName "kube-api-access-k5xmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:32:12.633224 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.633112    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c1f52a5-16b8-414b-bb08-4733d1330f90-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:12.633224 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.633146    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5xmm\" (UniqueName: \"kubernetes.io/projected/2c1f52a5-16b8-414b-bb08-4733d1330f90-kube-api-access-k5xmm\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:12.661692 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:12.661645    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"]
Sep 11 21:32:13.237886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.237844    2560 generic.go:356] "Generic (PLEG): container finished" podID="2c1f52a5-16b8-414b-bb08-4733d1330f90" containerID="4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca" exitCode=0
Sep 11 21:32:13.238286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.237894    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"
Sep 11 21:32:13.238286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.237934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r" event={"ID":"2c1f52a5-16b8-414b-bb08-4733d1330f90","Type":"ContainerDied","Data":"4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca"}
Sep 11 21:32:13.238286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.237993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r" event={"ID":"2c1f52a5-16b8-414b-bb08-4733d1330f90","Type":"ContainerDied","Data":"70b6b6c4f9ae9546a1016fd9372b9791d07833ee5ddd35c305718651586b0351"}
Sep 11 21:32:13.238286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.238020    2560 scope.go:117] "RemoveContainer" containerID="4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca"
Sep 11 21:32:13.238286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.238269    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy" containerID="cri-o://986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc" gracePeriod=30
Sep 11 21:32:13.247487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.247471    2560 scope.go:117] "RemoveContainer" containerID="4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca"
Sep 11 21:32:13.247870 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:32:13.247847    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca\": container with ID starting with 4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca not found: ID does not exist" containerID="4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca"
Sep 11 21:32:13.247977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.247876    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca"} err="failed to get container status \"4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca\": rpc error: code = NotFound desc = could not find container \"4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca\": container with ID starting with 4589ff5fe3eee7e11517ddbb2b4a29f3cd87e541cbefb2b8ad13022f1acbd5ca not found: ID does not exist"
Sep 11 21:32:13.277718 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.277688    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"]
Sep 11 21:32:13.290956 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:13.290927    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r"]
Sep 11 21:32:14.801776 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:14.801700    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c1f52a5-16b8-414b-bb08-4733d1330f90" path="/var/lib/kubelet/pods/2c1f52a5-16b8-414b-bb08-4733d1330f90/volumes"
Sep 11 21:32:18.492032 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.492002    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:32:18.592574 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592538    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110a818-003b-446f-94a2-552a7d99da10-istiod-ca-cert\") pod \"d110a818-003b-446f-94a2-552a7d99da10\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") "
Sep 11 21:32:18.592761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592609    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110a818-003b-446f-94a2-552a7d99da10-istio-podinfo\") pod \"d110a818-003b-446f-94a2-552a7d99da10\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") "
Sep 11 21:32:18.592761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592641    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-socket\") pod \"d110a818-003b-446f-94a2-552a7d99da10\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") "
Sep 11 21:32:18.592761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592678    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-envoy\") pod \"d110a818-003b-446f-94a2-552a7d99da10\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") "
Sep 11 21:32:18.592761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592713    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgqk4\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-kube-api-access-sgqk4\") pod \"d110a818-003b-446f-94a2-552a7d99da10\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") "
Sep 11 21:32:18.593026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592767    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-istio-token\") pod \"d110a818-003b-446f-94a2-552a7d99da10\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") "
Sep 11 21:32:18.593026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592794    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-credential-socket\") pod \"d110a818-003b-446f-94a2-552a7d99da10\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") "
Sep 11 21:32:18.593026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592868    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-data\") pod \"d110a818-003b-446f-94a2-552a7d99da10\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") "
Sep 11 21:32:18.593026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-certs\") pod \"d110a818-003b-446f-94a2-552a7d99da10\" (UID: \"d110a818-003b-446f-94a2-552a7d99da10\") "
Sep 11 21:32:18.593026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592966    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d110a818-003b-446f-94a2-552a7d99da10-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d110a818-003b-446f-94a2-552a7d99da10" (UID: "d110a818-003b-446f-94a2-552a7d99da10"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:32:18.593026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.592994    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d110a818-003b-446f-94a2-552a7d99da10" (UID: "d110a818-003b-446f-94a2-552a7d99da10"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:32:18.593335 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.593155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d110a818-003b-446f-94a2-552a7d99da10" (UID: "d110a818-003b-446f-94a2-552a7d99da10"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:32:18.593335 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.593308    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110a818-003b-446f-94a2-552a7d99da10-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:18.593335 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.593323    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:18.593335 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.593331    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:18.593561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.593538    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-data" (OuterVolumeSpecName: "istio-data") pod "d110a818-003b-446f-94a2-552a7d99da10" (UID: "d110a818-003b-446f-94a2-552a7d99da10"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:32:18.593711 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.593694    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d110a818-003b-446f-94a2-552a7d99da10" (UID: "d110a818-003b-446f-94a2-552a7d99da10"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:32:18.595067 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.595047    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-istio-token" (OuterVolumeSpecName: "istio-token") pod "d110a818-003b-446f-94a2-552a7d99da10" (UID: "d110a818-003b-446f-94a2-552a7d99da10"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:32:18.595220 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.595202    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d110a818-003b-446f-94a2-552a7d99da10" (UID: "d110a818-003b-446f-94a2-552a7d99da10"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:32:18.595440 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.595420    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d110a818-003b-446f-94a2-552a7d99da10-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d110a818-003b-446f-94a2-552a7d99da10" (UID: "d110a818-003b-446f-94a2-552a7d99da10"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:32:18.595440 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.595426    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-kube-api-access-sgqk4" (OuterVolumeSpecName: "kube-api-access-sgqk4") pod "d110a818-003b-446f-94a2-552a7d99da10" (UID: "d110a818-003b-446f-94a2-552a7d99da10"). InnerVolumeSpecName "kube-api-access-sgqk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:32:18.694786 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.694752    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:18.694786 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.694781    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110a818-003b-446f-94a2-552a7d99da10-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:18.694786 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.694790    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:18.695063 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.694798    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgqk4\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-kube-api-access-sgqk4\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:18.695063 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.694807    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110a818-003b-446f-94a2-552a7d99da10-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:18.695063 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:18.694815    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110a818-003b-446f-94a2-552a7d99da10-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:32:19.276918 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.276881    2560 generic.go:356] "Generic (PLEG): container finished" podID="d110a818-003b-446f-94a2-552a7d99da10" containerID="986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc" exitCode=0
Sep 11 21:32:19.277129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.276944    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"
Sep 11 21:32:19.277129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.276972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" event={"ID":"d110a818-003b-446f-94a2-552a7d99da10","Type":"ContainerDied","Data":"986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc"}
Sep 11 21:32:19.277129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.277067    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw" event={"ID":"d110a818-003b-446f-94a2-552a7d99da10","Type":"ContainerDied","Data":"ede3a773b2ef9059f8ba9e7493099407a8b461c3e0b00bc7442fc95a23d7c97b"}
Sep 11 21:32:19.277129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.277100    2560 scope.go:117] "RemoveContainer" containerID="986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc"
Sep 11 21:32:19.289593 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.289576    2560 scope.go:117] "RemoveContainer" containerID="3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4"
Sep 11 21:32:19.295834 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.295795    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"]
Sep 11 21:32:19.299061 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.299044    2560 scope.go:117] "RemoveContainer" containerID="986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc"
Sep 11 21:32:19.299146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.299111    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw"]
Sep 11 21:32:19.299369 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:32:19.299351    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc\": container with ID starting with 986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc not found: ID does not exist" containerID="986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc"
Sep 11 21:32:19.299416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.299376    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc"} err="failed to get container status \"986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc\": rpc error: code = NotFound desc = could not find container \"986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc\": container with ID starting with 986acae81ee3b9d14755c3367397a38e6f67307dfd5cd1d645f955e36cce55bc not found: ID does not exist"
Sep 11 21:32:19.299416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.299394    2560 scope.go:117] "RemoveContainer" containerID="3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4"
Sep 11 21:32:19.299633 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:32:19.299613    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4\": container with ID starting with 3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4 not found: ID does not exist" containerID="3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4"
Sep 11 21:32:19.299693 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:19.299641    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4"} err="failed to get container status \"3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4\": rpc error: code = NotFound desc = could not find container \"3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4\": container with ID starting with 3e427b06d890f72535f1e12e5a409f44dc908373aefa1456c85f9585ed2688f4 not found: ID does not exist"
Sep 11 21:32:20.801383 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:20.801347    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d110a818-003b-446f-94a2-552a7d99da10" path="/var/lib/kubelet/pods/d110a818-003b-446f-94a2-552a7d99da10/volumes"
Sep 11 21:32:43.433371 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433338    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"]
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433737    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433749    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433765    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98c4d771-a138-4820-bda7-0fd889e8fa58" containerName="payload-processing"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433771    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="98c4d771-a138-4820-bda7-0fd889e8fa58" containerName="payload-processing"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433777    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c1f52a5-16b8-414b-bb08-4733d1330f90" containerName="payload-processing"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433784    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1f52a5-16b8-414b-bb08-4733d1330f90" containerName="payload-processing"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433793    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433798    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433804    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b8ec18e-13e6-403a-b233-4f633b08dd67" containerName="revoke-keys"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433809    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b8ec18e-13e6-403a-b233-4f633b08dd67" containerName="revoke-keys"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433896    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="98c4d771-a138-4820-bda7-0fd889e8fa58" containerName="payload-processing"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433904    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b8ec18e-13e6-403a-b233-4f633b08dd67" containerName="revoke-keys"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433913    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy"
Sep 11 21:32:43.433909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433919    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d110a818-003b-446f-94a2-552a7d99da10" containerName="istio-proxy"
Sep 11 21:32:43.434397 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.433926    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c1f52a5-16b8-414b-bb08-4733d1330f90" containerName="payload-processing"
Sep 11 21:32:43.437428 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.437410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.440069 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.440044    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-c0162b-openshift-default-dockercfg-rn2gf\""
Sep 11 21:32:43.450534 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.450506    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"]
Sep 11 21:32:43.526738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.526692    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-podinfo\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.527096 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.527066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-token\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.527202 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.527132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz89n\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-kube-api-access-xz89n\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.527202 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.527166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-socket\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.527202 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.527182    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istiod-ca-cert\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.527401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.527303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-data\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.527401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.527362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-credential-socket\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.527401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.527385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-envoy\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.527571 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.527410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-certs\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.628659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.628620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-envoy\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.628852 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.628670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-certs\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.628852 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.628706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-podinfo\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.628852 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.628740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-token\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.628852 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.628771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz89n\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-kube-api-access-xz89n\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.629070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.628855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-socket\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.629070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.628888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istiod-ca-cert\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.629070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.628986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-data\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.629234 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.629068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-credential-socket\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.629234 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.629158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-certs\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.629324 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.629253    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-socket\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.629365 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.629331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-data\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.629401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.629380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-credential-socket\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.629625 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.629606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istiod-ca-cert\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.631307 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.631284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-podinfo\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.631535 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.631520    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-envoy\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.637534 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.637505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-token\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.637662 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.637633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz89n\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-kube-api-access-xz89n\") pod \"e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") " pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:43.748271 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:43.748192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:44.042335 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:44.042312    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"]
Sep 11 21:32:44.045029 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:32:44.045002    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ce16b3_a6f9_4ecd_9fe4_2841075ceb71.slice/crio-49c16a02df447b7808cf41ad0c7928212f9f6ebec4005df8eed5aadf29c32cdd WatchSource:0}: Error finding container 49c16a02df447b7808cf41ad0c7928212f9f6ebec4005df8eed5aadf29c32cdd: Status 404 returned error can't find the container with id 49c16a02df447b7808cf41ad0c7928212f9f6ebec4005df8eed5aadf29c32cdd
Sep 11 21:32:44.047387 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:44.047351    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:32:44.047482 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:44.047420    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:32:44.047482 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:44.047453    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:32:44.416648 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:44.416616    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" event={"ID":"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71","Type":"ContainerStarted","Data":"db01461b845705db9fcecec8501bc7bd78d4c642998f85c2c5553cf9d1b83c82"}
Sep 11 21:32:44.416866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:44.416668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" event={"ID":"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71","Type":"ContainerStarted","Data":"49c16a02df447b7808cf41ad0c7928212f9f6ebec4005df8eed5aadf29c32cdd"}
Sep 11 21:32:44.438487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:44.438421    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" podStartSLOduration=1.438405945 podStartE2EDuration="1.438405945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:44.436881995 +0000 UTC m=+922.149542044" watchObservedRunningTime="2026-09-11 21:32:44.438405945 +0000 UTC m=+922.151065994"
Sep 11 21:32:44.748376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:44.748296    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:45.754130 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:45.754101    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:46.429496 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:46.429461    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:32:46.430979 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:32:46.430951    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:33:09.562583 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:09.562484    2560 generic.go:356] "Generic (PLEG): container finished" podID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerID="db01461b845705db9fcecec8501bc7bd78d4c642998f85c2c5553cf9d1b83c82" exitCode=0
Sep 11 21:33:09.562583 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:09.562557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" event={"ID":"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71","Type":"ContainerDied","Data":"db01461b845705db9fcecec8501bc7bd78d4c642998f85c2c5553cf9d1b83c82"}
Sep 11 21:33:09.563258 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:09.562993    2560 scope.go:117] "RemoveContainer" containerID="db01461b845705db9fcecec8501bc7bd78d4c642998f85c2c5553cf9d1b83c82"
Sep 11 21:33:09.564142 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:09.564110    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:33:09.564227 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:09.564179    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:33:09.564227 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:09.564211    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:33:10.569941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:10.569906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" event={"ID":"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71","Type":"ContainerStarted","Data":"a58751f4e85ed561dd3f4d99326c03b6902751b59575cd1e1b87a8adf4bf19dd"}
Sep 11 21:33:10.748637 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:10.748601    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:33:10.748899 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:10.748875    2560 patch_prober.go:28] interesting pod/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 21:33:10.748959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:10.748937    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 21:33:11.749382 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:11.749346    2560 patch_prober.go:28] interesting pod/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 21:33:11.749764 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:11.749400    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 21:33:12.749478 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:12.749437    2560 patch_prober.go:28] interesting pod/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 21:33:12.749910 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:12.749511    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 21:33:13.748698 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:13.748653    2560 patch_prober.go:28] interesting pod/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 21:33:13.748929 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:13.748744    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 21:33:14.748760 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:14.748723    2560 patch_prober.go:28] interesting pod/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 21:33:14.749250 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:14.748774    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 21:33:15.825865 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:15.825808    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:33:15.826604 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:15.826579    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:33:15.827680 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:15.827660    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:33:50.232750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.232673    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"]
Sep 11 21:33:50.236553 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.236531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.240433 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.240410    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0ddeac18-openshift-default-dockercfg-246mh\""
Sep 11 21:33:50.260365 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.260338    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"]
Sep 11 21:33:50.370767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.370731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-envoy\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.370965 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.370785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-credential-socket\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.370965 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.370899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqfwp\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-kube-api-access-tqfwp\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.370965 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.370929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istiod-ca-cert\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.371092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.370963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-certs\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.371092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.371040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-socket\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.371092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.371066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-podinfo\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.371207 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.371119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-token\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.371207 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.371179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-data\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472275 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-certs\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472476 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-socket\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472476 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-podinfo\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472476 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-token\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-data\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-envoy\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-credential-socket\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqfwp\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-kube-api-access-tqfwp\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472681    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istiod-ca-cert\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-socket\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-certs\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.472909 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.472896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-data\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.473150 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.473129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-credential-socket\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.473695 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.473669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istiod-ca-cert\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.475094 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.475074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-envoy\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.475309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.475287    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-podinfo\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.482433 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.480740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqfwp\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-kube-api-access-tqfwp\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.482433 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.482304    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-token\") pod \"e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") " pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.547641 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.547561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:50.840463 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.840433    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"]
Sep 11 21:33:50.844350 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:33:50.844320    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdbf7f09_7b8f_4639_8593_6a59f9adbb91.slice/crio-6de52164fa0fa1813bfe3bef93a5bb6b4d74d6d5fc8157b3e1b7f3160f7fb765 WatchSource:0}: Error finding container 6de52164fa0fa1813bfe3bef93a5bb6b4d74d6d5fc8157b3e1b7f3160f7fb765: Status 404 returned error can't find the container with id 6de52164fa0fa1813bfe3bef93a5bb6b4d74d6d5fc8157b3e1b7f3160f7fb765
Sep 11 21:33:50.846938 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.846896    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:33:50.847057 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.846987    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:33:50.847057 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:50.847030    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:33:51.798129 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:51.798087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" event={"ID":"bdbf7f09-7b8f-4639-8593-6a59f9adbb91","Type":"ContainerStarted","Data":"630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93"}
Sep 11 21:33:51.798525 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:51.798150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" event={"ID":"bdbf7f09-7b8f-4639-8593-6a59f9adbb91","Type":"ContainerStarted","Data":"6de52164fa0fa1813bfe3bef93a5bb6b4d74d6d5fc8157b3e1b7f3160f7fb765"}
Sep 11 21:33:51.823965 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:51.823921    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" podStartSLOduration=1.823904231 podStartE2EDuration="1.823904231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:33:51.821434619 +0000 UTC m=+989.534094660" watchObservedRunningTime="2026-09-11 21:33:51.823904231 +0000 UTC m=+989.536564280"
Sep 11 21:33:52.547915 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:52.547879    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:52.553350 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:52.553326    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:52.802927 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:52.802849    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:52.803896 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:52.803877    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:33:59.995901 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:59.995867    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"]
Sep 11 21:33:59.999542 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:33:59.999525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"
Sep 11 21:34:00.002210 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:00.002187    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:34:00.002339 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:00.002187    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:34:00.007879 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:00.007852    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"]
Sep 11 21:34:00.074244 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:00.074210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eed07a3-e224-46c7-a83c-5c6b27c5cfb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c0162b-49tfn\" (UID: \"0eed07a3-e224-46c7-a83c-5c6b27c5cfb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"
Sep 11 21:34:00.175317 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:00.175285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eed07a3-e224-46c7-a83c-5c6b27c5cfb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c0162b-49tfn\" (UID: \"0eed07a3-e224-46c7-a83c-5c6b27c5cfb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"
Sep 11 21:34:00.175938 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:00.175918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eed07a3-e224-46c7-a83c-5c6b27c5cfb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c0162b-49tfn\" (UID: \"0eed07a3-e224-46c7-a83c-5c6b27c5cfb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"
Sep 11 21:34:00.311792 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:00.311718    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"
Sep 11 21:34:00.589559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:00.589535    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"]
Sep 11 21:34:00.591388 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:34:00.591358    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eed07a3_e224_46c7_a83c_5c6b27c5cfb0.slice/crio-60397382cbff80435fd11a63265b0dc7e49159bf06212f976555b79cfccdc7ca WatchSource:0}: Error finding container 60397382cbff80435fd11a63265b0dc7e49159bf06212f976555b79cfccdc7ca: Status 404 returned error can't find the container with id 60397382cbff80435fd11a63265b0dc7e49159bf06212f976555b79cfccdc7ca
Sep 11 21:34:00.846498 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:00.846432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn" event={"ID":"0eed07a3-e224-46c7-a83c-5c6b27c5cfb0","Type":"ContainerStarted","Data":"60397382cbff80435fd11a63265b0dc7e49159bf06212f976555b79cfccdc7ca"}
Sep 11 21:34:01.693189 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.693147    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"]
Sep 11 21:34:01.696732 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.696713    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:01.699379 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.699349    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0ddeac18\""
Sep 11 21:34:01.699511 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.699441    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0ddeac18-dockercfg-t62nl\""
Sep 11 21:34:01.708337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.708302    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"]
Sep 11 21:34:01.800159 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.800112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dtnf\" (UniqueName: \"kubernetes.io/projected/63bde92c-6878-4fa9-be9b-5470cb382f71-kube-api-access-5dtnf\") pod \"payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89\" (UID: \"63bde92c-6878-4fa9-be9b-5470cb382f71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:01.800452 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.800425    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63bde92c-6878-4fa9-be9b-5470cb382f71-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89\" (UID: \"63bde92c-6878-4fa9-be9b-5470cb382f71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:01.853688 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.853654    2560 generic.go:356] "Generic (PLEG): container finished" podID="0eed07a3-e224-46c7-a83c-5c6b27c5cfb0" containerID="4f7e20ee91b2edb28b0cc3eaecd4515b72c4c737a86b63aa3d0b1ec0c154a8e3" exitCode=0
Sep 11 21:34:01.853905 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.853691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn" event={"ID":"0eed07a3-e224-46c7-a83c-5c6b27c5cfb0","Type":"ContainerDied","Data":"4f7e20ee91b2edb28b0cc3eaecd4515b72c4c737a86b63aa3d0b1ec0c154a8e3"}
Sep 11 21:34:01.902049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.902006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dtnf\" (UniqueName: \"kubernetes.io/projected/63bde92c-6878-4fa9-be9b-5470cb382f71-kube-api-access-5dtnf\") pod \"payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89\" (UID: \"63bde92c-6878-4fa9-be9b-5470cb382f71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:01.902245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.902079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63bde92c-6878-4fa9-be9b-5470cb382f71-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89\" (UID: \"63bde92c-6878-4fa9-be9b-5470cb382f71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:01.902746 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.902723    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63bde92c-6878-4fa9-be9b-5470cb382f71-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89\" (UID: \"63bde92c-6878-4fa9-be9b-5470cb382f71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:01.910757 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:01.910731    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dtnf\" (UniqueName: \"kubernetes.io/projected/63bde92c-6878-4fa9-be9b-5470cb382f71-kube-api-access-5dtnf\") pod \"payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89\" (UID: \"63bde92c-6878-4fa9-be9b-5470cb382f71\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:02.007887 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:02.007750    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:02.282856 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:02.282811    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"]
Sep 11 21:34:02.284771 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:34:02.284740    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bde92c_6878_4fa9_be9b_5470cb382f71.slice/crio-284dcc27d6180d2b765d4c403f9316d91983bb1443aebd615b493a1a90941cc4 WatchSource:0}: Error finding container 284dcc27d6180d2b765d4c403f9316d91983bb1443aebd615b493a1a90941cc4: Status 404 returned error can't find the container with id 284dcc27d6180d2b765d4c403f9316d91983bb1443aebd615b493a1a90941cc4
Sep 11 21:34:02.860360 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:02.860322    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89" event={"ID":"63bde92c-6878-4fa9-be9b-5470cb382f71","Type":"ContainerStarted","Data":"7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11"}
Sep 11 21:34:02.860791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:02.860384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89" event={"ID":"63bde92c-6878-4fa9-be9b-5470cb382f71","Type":"ContainerStarted","Data":"284dcc27d6180d2b765d4c403f9316d91983bb1443aebd615b493a1a90941cc4"}
Sep 11 21:34:02.860791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:02.860412    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:02.876507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:02.876439    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89" podStartSLOduration=1.876417031 podStartE2EDuration="1.876417031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:34:02.875496676 +0000 UTC m=+1000.588156724" watchObservedRunningTime="2026-09-11 21:34:02.876417031 +0000 UTC m=+1000.589077087"
Sep 11 21:34:03.008360 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:03.008333    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"
Sep 11 21:34:03.113156 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:03.113066    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eed07a3-e224-46c7-a83c-5c6b27c5cfb0-maas-api-service-ca\") pod \"0eed07a3-e224-46c7-a83c-5c6b27c5cfb0\" (UID: \"0eed07a3-e224-46c7-a83c-5c6b27c5cfb0\") "
Sep 11 21:34:03.113481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:03.113457    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eed07a3-e224-46c7-a83c-5c6b27c5cfb0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0eed07a3-e224-46c7-a83c-5c6b27c5cfb0" (UID: "0eed07a3-e224-46c7-a83c-5c6b27c5cfb0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:03.214547 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:03.214509    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eed07a3-e224-46c7-a83c-5c6b27c5cfb0-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:03.867667 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:03.867635    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"
Sep 11 21:34:03.868072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:03.867674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn" event={"ID":"0eed07a3-e224-46c7-a83c-5c6b27c5cfb0","Type":"ContainerDied","Data":"60397382cbff80435fd11a63265b0dc7e49159bf06212f976555b79cfccdc7ca"}
Sep 11 21:34:03.868072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:03.867719    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60397382cbff80435fd11a63265b0dc7e49159bf06212f976555b79cfccdc7ca"
Sep 11 21:34:11.104209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:11.104177    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"]
Sep 11 21:34:11.107018 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:11.106993    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c0162b-49tfn"]
Sep 11 21:34:12.802684 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:12.802647    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eed07a3-e224-46c7-a83c-5c6b27c5cfb0" path="/var/lib/kubelet/pods/0eed07a3-e224-46c7-a83c-5c6b27c5cfb0/volumes"
Sep 11 21:34:13.869910 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:13.869874    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:18.768926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:18.768891    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"]
Sep 11 21:34:18.769359 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:18.769162    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy" containerID="cri-o://a58751f4e85ed561dd3f4d99326c03b6902751b59575cd1e1b87a8adf4bf19dd" gracePeriod=30
Sep 11 21:34:23.838089 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.838047    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"]
Sep 11 21:34:23.838676 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.838654    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eed07a3-e224-46c7-a83c-5c6b27c5cfb0" containerName="revoke-keys"
Sep 11 21:34:23.838765 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.838679    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eed07a3-e224-46c7-a83c-5c6b27c5cfb0" containerName="revoke-keys"
Sep 11 21:34:23.838842 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.838805    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eed07a3-e224-46c7-a83c-5c6b27c5cfb0" containerName="revoke-keys"
Sep 11 21:34:23.841740 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.841719    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"
Sep 11 21:34:23.844273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.844254    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:34:23.844369 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.844354    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:34:23.850318 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.850300    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"]
Sep 11 21:34:23.926886 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.926800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca3f748-370a-4a11-8e7b-96c3a4d9ad3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns\" (UID: \"fca3f748-370a-4a11-8e7b-96c3a4d9ad3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"
Sep 11 21:34:23.979867 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.979811    2560 generic.go:356] "Generic (PLEG): container finished" podID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerID="a58751f4e85ed561dd3f4d99326c03b6902751b59575cd1e1b87a8adf4bf19dd" exitCode=0
Sep 11 21:34:23.980049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.979895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" event={"ID":"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71","Type":"ContainerDied","Data":"a58751f4e85ed561dd3f4d99326c03b6902751b59575cd1e1b87a8adf4bf19dd"}
Sep 11 21:34:23.980049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:23.979968    2560 scope.go:117] "RemoveContainer" containerID="db01461b845705db9fcecec8501bc7bd78d4c642998f85c2c5553cf9d1b83c82"
Sep 11 21:34:24.027413 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.027393    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:34:24.027960 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.027942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca3f748-370a-4a11-8e7b-96c3a4d9ad3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns\" (UID: \"fca3f748-370a-4a11-8e7b-96c3a4d9ad3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"
Sep 11 21:34:24.028488 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.028470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca3f748-370a-4a11-8e7b-96c3a4d9ad3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns\" (UID: \"fca3f748-370a-4a11-8e7b-96c3a4d9ad3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"
Sep 11 21:34:24.128717 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.128690    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-credential-socket\") pod \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") "
Sep 11 21:34:24.128931 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.128729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istiod-ca-cert\") pod \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") "
Sep 11 21:34:24.128931 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.128761    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-podinfo\") pod \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") "
Sep 11 21:34:24.128931 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.128904    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz89n\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-kube-api-access-xz89n\") pod \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") "
Sep 11 21:34:24.129144 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.128944    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-envoy\") pod \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") "
Sep 11 21:34:24.129144 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.128978    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-data\") pod \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") "
Sep 11 21:34:24.129144 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129050    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" (UID: "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:24.129144 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-token\") pod \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") "
Sep 11 21:34:24.129345 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129154    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-certs\") pod \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") "
Sep 11 21:34:24.129345 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129209    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-socket\") pod \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\" (UID: \"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71\") "
Sep 11 21:34:24.129345 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129275    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" (UID: "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:24.129345 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129183    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" (UID: "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:24.129586 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129480    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" (UID: "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:24.129586 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129564    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" (UID: "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:24.129696 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129685    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:24.129751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129704    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:24.129751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129719    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:24.129751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129735    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:24.129929 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.129749    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:24.131618 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.131587    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" (UID: "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:24.131750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.131740    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" (UID: "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:34:24.131977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.131791    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" (UID: "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:24.131977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.131803    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-kube-api-access-xz89n" (OuterVolumeSpecName: "kube-api-access-xz89n") pod "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" (UID: "b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71"). InnerVolumeSpecName "kube-api-access-xz89n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:24.159931 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.159909    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"
Sep 11 21:34:24.230605 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.230566    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:24.230605 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.230601    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:24.230851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.230618    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz89n\" (UniqueName: \"kubernetes.io/projected/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-kube-api-access-xz89n\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:24.230851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.230635    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:24.436076 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.436054    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"]
Sep 11 21:34:24.438735 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:34:24.438709    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca3f748_370a_4a11_8e7b_96c3a4d9ad3b.slice/crio-f5c6f6969ebf1aae0735802367b61565f46d4fa3a785d6190a3519615e9dd6dd WatchSource:0}: Error finding container f5c6f6969ebf1aae0735802367b61565f46d4fa3a785d6190a3519615e9dd6dd: Status 404 returned error can't find the container with id f5c6f6969ebf1aae0735802367b61565f46d4fa3a785d6190a3519615e9dd6dd
Sep 11 21:34:24.995292 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.995257    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"
Sep 11 21:34:24.995733 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.995255    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv" event={"ID":"b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71","Type":"ContainerDied","Data":"49c16a02df447b7808cf41ad0c7928212f9f6ebec4005df8eed5aadf29c32cdd"}
Sep 11 21:34:24.995733 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.995440    2560 scope.go:117] "RemoveContainer" containerID="a58751f4e85ed561dd3f4d99326c03b6902751b59575cd1e1b87a8adf4bf19dd"
Sep 11 21:34:24.997387 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.997361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns" event={"ID":"fca3f748-370a-4a11-8e7b-96c3a4d9ad3b","Type":"ContainerStarted","Data":"6e565229284758293d05eb7c23e80ea5a194cd8b8e96cd22dfe20fc274805397"}
Sep 11 21:34:24.997508 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:24.997406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns" event={"ID":"fca3f748-370a-4a11-8e7b-96c3a4d9ad3b","Type":"ContainerStarted","Data":"f5c6f6969ebf1aae0735802367b61565f46d4fa3a785d6190a3519615e9dd6dd"}
Sep 11 21:34:25.019675 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:25.019620    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns" podStartSLOduration=2.019605481 podStartE2EDuration="2.019605481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:34:25.017130408 +0000 UTC m=+1022.729790458" watchObservedRunningTime="2026-09-11 21:34:25.019605481 +0000 UTC m=+1022.732265529"
Sep 11 21:34:25.036190 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:25.036151    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"]
Sep 11 21:34:25.040486 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:25.040425    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv"]
Sep 11 21:34:26.008639 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:26.008600    2560 generic.go:356] "Generic (PLEG): container finished" podID="fca3f748-370a-4a11-8e7b-96c3a4d9ad3b" containerID="6e565229284758293d05eb7c23e80ea5a194cd8b8e96cd22dfe20fc274805397" exitCode=0
Sep 11 21:34:26.009158 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:26.008675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns" event={"ID":"fca3f748-370a-4a11-8e7b-96c3a4d9ad3b","Type":"ContainerDied","Data":"6e565229284758293d05eb7c23e80ea5a194cd8b8e96cd22dfe20fc274805397"}
Sep 11 21:34:26.802612 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:26.802582    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" path="/var/lib/kubelet/pods/b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71/volumes"
Sep 11 21:34:27.015452 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.015374    2560 generic.go:356] "Generic (PLEG): container finished" podID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerID="630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93" exitCode=0
Sep 11 21:34:27.015814 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.015448    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" event={"ID":"bdbf7f09-7b8f-4639-8593-6a59f9adbb91","Type":"ContainerDied","Data":"630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93"}
Sep 11 21:34:27.016399 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.016001    2560 scope.go:117] "RemoveContainer" containerID="630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93"
Sep 11 21:34:27.017211 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.017178    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:34:27.017324 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.017253    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:34:27.017324 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.017285    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:34:27.173475 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.173450    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"
Sep 11 21:34:27.261818 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.261789    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca3f748-370a-4a11-8e7b-96c3a4d9ad3b-maas-api-service-ca\") pod \"fca3f748-370a-4a11-8e7b-96c3a4d9ad3b\" (UID: \"fca3f748-370a-4a11-8e7b-96c3a4d9ad3b\") "
Sep 11 21:34:27.262190 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.262164    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca3f748-370a-4a11-8e7b-96c3a4d9ad3b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fca3f748-370a-4a11-8e7b-96c3a4d9ad3b" (UID: "fca3f748-370a-4a11-8e7b-96c3a4d9ad3b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:27.363175 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:27.363139    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca3f748-370a-4a11-8e7b-96c3a4d9ad3b-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:28.023034 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:28.023000    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" event={"ID":"bdbf7f09-7b8f-4639-8593-6a59f9adbb91","Type":"ContainerStarted","Data":"bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5"}
Sep 11 21:34:28.024325 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:28.024303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns" event={"ID":"fca3f748-370a-4a11-8e7b-96c3a4d9ad3b","Type":"ContainerDied","Data":"f5c6f6969ebf1aae0735802367b61565f46d4fa3a785d6190a3519615e9dd6dd"}
Sep 11 21:34:28.024325 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:28.024322    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"
Sep 11 21:34:28.024470 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:28.024342    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5c6f6969ebf1aae0735802367b61565f46d4fa3a785d6190a3519615e9dd6dd"
Sep 11 21:34:28.548780 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:28.548741    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:34:28.548984 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:28.548968    2560 patch_prober.go:28] interesting pod/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 21:34:28.549033 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:28.549013    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 21:34:29.548507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:29.548472    2560 patch_prober.go:28] interesting pod/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 21:34:29.548916 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:29.548529    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 21:34:30.548501 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:30.548458    2560 patch_prober.go:28] interesting pod/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 21:34:30.548676 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:30.548530    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 21:34:31.548384 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:31.548347    2560 patch_prober.go:28] interesting pod/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 21:34:31.548564 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:31.548400    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 21:34:32.548601 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:32.548567    2560 patch_prober.go:28] interesting pod/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 21:34:32.548989 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:32.548625    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 21:34:33.552475 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:33.552447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:34:33.552947 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:33.552840    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:34:33.553555 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:33.553537    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:34:38.274350 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.274315    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"]
Sep 11 21:34:38.274802 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.274548    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89" podUID="63bde92c-6878-4fa9-be9b-5470cb382f71" containerName="payload-pre-processing" containerID="cri-o://7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11" gracePeriod=30
Sep 11 21:34:38.436744 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.436711    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"]
Sep 11 21:34:38.441364 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.441332    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0ddeac18-nvfns"]
Sep 11 21:34:38.547951 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.547924    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:38.586684 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.586648    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63bde92c-6878-4fa9-be9b-5470cb382f71-plugins-config-volume\") pod \"63bde92c-6878-4fa9-be9b-5470cb382f71\" (UID: \"63bde92c-6878-4fa9-be9b-5470cb382f71\") "
Sep 11 21:34:38.586877 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.586797    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dtnf\" (UniqueName: \"kubernetes.io/projected/63bde92c-6878-4fa9-be9b-5470cb382f71-kube-api-access-5dtnf\") pod \"63bde92c-6878-4fa9-be9b-5470cb382f71\" (UID: \"63bde92c-6878-4fa9-be9b-5470cb382f71\") "
Sep 11 21:34:38.587130 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.587100    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63bde92c-6878-4fa9-be9b-5470cb382f71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63bde92c-6878-4fa9-be9b-5470cb382f71" (UID: "63bde92c-6878-4fa9-be9b-5470cb382f71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:38.587200 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.587178    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63bde92c-6878-4fa9-be9b-5470cb382f71-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:38.589249 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.589223    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63bde92c-6878-4fa9-be9b-5470cb382f71-kube-api-access-5dtnf" (OuterVolumeSpecName: "kube-api-access-5dtnf") pod "63bde92c-6878-4fa9-be9b-5470cb382f71" (UID: "63bde92c-6878-4fa9-be9b-5470cb382f71"). InnerVolumeSpecName "kube-api-access-5dtnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:38.688665 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.688630    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dtnf\" (UniqueName: \"kubernetes.io/projected/63bde92c-6878-4fa9-be9b-5470cb382f71-kube-api-access-5dtnf\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:38.801860 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:38.801737    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fca3f748-370a-4a11-8e7b-96c3a4d9ad3b" path="/var/lib/kubelet/pods/fca3f748-370a-4a11-8e7b-96c3a4d9ad3b/volumes"
Sep 11 21:34:39.094981 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:39.094940    2560 generic.go:356] "Generic (PLEG): container finished" podID="63bde92c-6878-4fa9-be9b-5470cb382f71" containerID="7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11" exitCode=0
Sep 11 21:34:39.094981 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:39.094977    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"
Sep 11 21:34:39.095175 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:39.095027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89" event={"ID":"63bde92c-6878-4fa9-be9b-5470cb382f71","Type":"ContainerDied","Data":"7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11"}
Sep 11 21:34:39.095175 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:39.095073    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89" event={"ID":"63bde92c-6878-4fa9-be9b-5470cb382f71","Type":"ContainerDied","Data":"284dcc27d6180d2b765d4c403f9316d91983bb1443aebd615b493a1a90941cc4"}
Sep 11 21:34:39.095175 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:39.095095    2560 scope.go:117] "RemoveContainer" containerID="7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11"
Sep 11 21:34:39.104131 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:39.104115    2560 scope.go:117] "RemoveContainer" containerID="7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11"
Sep 11 21:34:39.104408 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:34:39.104390    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11\": container with ID starting with 7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11 not found: ID does not exist" containerID="7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11"
Sep 11 21:34:39.104462 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:39.104416    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11"} err="failed to get container status \"7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11\": rpc error: code = NotFound desc = could not find container \"7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11\": container with ID starting with 7a4922ec2816626584f4de14d480bc574d64a43f4d3fb774212d24aa12dccf11 not found: ID does not exist"
Sep 11 21:34:39.112152 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:39.112124    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"]
Sep 11 21:34:39.116092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:39.116070    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89"]
Sep 11 21:34:40.801105 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:40.801074    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63bde92c-6878-4fa9-be9b-5470cb382f71" path="/var/lib/kubelet/pods/63bde92c-6878-4fa9-be9b-5470cb382f71/volumes"
Sep 11 21:34:44.680243 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:44.680208    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"]
Sep 11 21:34:44.680730 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:44.680439    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy" containerID="cri-o://bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5" gracePeriod=30
Sep 11 21:34:48.555261 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:48.555218    2560 patch_prober.go:28] interesting pod/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 21:34:48.555696 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:48.555292    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:34:49.939139 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:49.939114    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:34:50.005547 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005478    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-certs\") pod \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") "
Sep 11 21:34:50.005547 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005519    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-podinfo\") pod \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") "
Sep 11 21:34:50.005730 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005557    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-socket\") pod \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") "
Sep 11 21:34:50.005730 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005611    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqfwp\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-kube-api-access-tqfwp\") pod \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") "
Sep 11 21:34:50.005730 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005635    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-envoy\") pod \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") "
Sep 11 21:34:50.005730 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005658    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-token\") pod \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") "
Sep 11 21:34:50.005730 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005728    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-data\") pod \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") "
Sep 11 21:34:50.006025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005785    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istiod-ca-cert\") pod \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") "
Sep 11 21:34:50.006025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005779    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bdbf7f09-7b8f-4639-8593-6a59f9adbb91" (UID: "bdbf7f09-7b8f-4639-8593-6a59f9adbb91"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:50.006025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.005857    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-credential-socket\") pod \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\" (UID: \"bdbf7f09-7b8f-4639-8593-6a59f9adbb91\") "
Sep 11 21:34:50.006200 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.006078    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-data" (OuterVolumeSpecName: "istio-data") pod "bdbf7f09-7b8f-4639-8593-6a59f9adbb91" (UID: "bdbf7f09-7b8f-4639-8593-6a59f9adbb91"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:50.006200 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.006093    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bdbf7f09-7b8f-4639-8593-6a59f9adbb91" (UID: "bdbf7f09-7b8f-4639-8593-6a59f9adbb91"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:50.006200 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.006168    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bdbf7f09-7b8f-4639-8593-6a59f9adbb91" (UID: "bdbf7f09-7b8f-4639-8593-6a59f9adbb91"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:50.006405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.006356    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:50.006405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.006381    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:50.006405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.006395    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:50.006405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.006410    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:50.006759 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.006448    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bdbf7f09-7b8f-4639-8593-6a59f9adbb91" (UID: "bdbf7f09-7b8f-4639-8593-6a59f9adbb91"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:50.007920 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.007886    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bdbf7f09-7b8f-4639-8593-6a59f9adbb91" (UID: "bdbf7f09-7b8f-4639-8593-6a59f9adbb91"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:50.008042 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.007926    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-kube-api-access-tqfwp" (OuterVolumeSpecName: "kube-api-access-tqfwp") pod "bdbf7f09-7b8f-4639-8593-6a59f9adbb91" (UID: "bdbf7f09-7b8f-4639-8593-6a59f9adbb91"). InnerVolumeSpecName "kube-api-access-tqfwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:50.008042 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.007985    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-token" (OuterVolumeSpecName: "istio-token") pod "bdbf7f09-7b8f-4639-8593-6a59f9adbb91" (UID: "bdbf7f09-7b8f-4639-8593-6a59f9adbb91"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:50.008128 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.008102    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bdbf7f09-7b8f-4639-8593-6a59f9adbb91" (UID: "bdbf7f09-7b8f-4639-8593-6a59f9adbb91"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:34:50.107173 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.107145    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:50.107173 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.107170    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqfwp\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-kube-api-access-tqfwp\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:50.107343 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.107181    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:50.107343 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.107189    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:50.107343 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.107197    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdbf7f09-7b8f-4639-8593-6a59f9adbb91-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:34:50.160004 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.159969    2560 generic.go:356] "Generic (PLEG): container finished" podID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerID="bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5" exitCode=0
Sep 11 21:34:50.160159 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.160015    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"
Sep 11 21:34:50.160159 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.160060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" event={"ID":"bdbf7f09-7b8f-4639-8593-6a59f9adbb91","Type":"ContainerDied","Data":"bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5"}
Sep 11 21:34:50.160159 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.160119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt" event={"ID":"bdbf7f09-7b8f-4639-8593-6a59f9adbb91","Type":"ContainerDied","Data":"6de52164fa0fa1813bfe3bef93a5bb6b4d74d6d5fc8157b3e1b7f3160f7fb765"}
Sep 11 21:34:50.160159 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.160151    2560 scope.go:117] "RemoveContainer" containerID="bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5"
Sep 11 21:34:50.170398 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.170379    2560 scope.go:117] "RemoveContainer" containerID="630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93"
Sep 11 21:34:50.178774 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.178755    2560 scope.go:117] "RemoveContainer" containerID="bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5"
Sep 11 21:34:50.179077 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:34:50.179055    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5\": container with ID starting with bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5 not found: ID does not exist" containerID="bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5"
Sep 11 21:34:50.179167 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.179090    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5"} err="failed to get container status \"bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5\": rpc error: code = NotFound desc = could not find container \"bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5\": container with ID starting with bf5ddf5bc763de8ba26113f5fc552d9bd98be131a398cad58c6d206f84f74ff5 not found: ID does not exist"
Sep 11 21:34:50.179167 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.179113    2560 scope.go:117] "RemoveContainer" containerID="630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93"
Sep 11 21:34:50.179380 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:34:50.179362    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93\": container with ID starting with 630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93 not found: ID does not exist" containerID="630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93"
Sep 11 21:34:50.179419 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.179388    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93"} err="failed to get container status \"630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93\": rpc error: code = NotFound desc = could not find container \"630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93\": container with ID starting with 630c745eaefbf49e3a42f706a58451a543056c9569c528d59c60467756166c93 not found: ID does not exist"
Sep 11 21:34:50.183251 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.183231    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"]
Sep 11 21:34:50.186881 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.186861    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt"]
Sep 11 21:34:50.802678 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:50.802646    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" path="/var/lib/kubelet/pods/bdbf7f09-7b8f-4639-8593-6a59f9adbb91/volumes"
Sep 11 21:34:58.582775 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.582743    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"]
Sep 11 21:34:58.583397 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583376    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63bde92c-6878-4fa9-be9b-5470cb382f71" containerName="payload-pre-processing"
Sep 11 21:34:58.583487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583401    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63bde92c-6878-4fa9-be9b-5470cb382f71" containerName="payload-pre-processing"
Sep 11 21:34:58.583487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583423    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca3f748-370a-4a11-8e7b-96c3a4d9ad3b" containerName="revoke-keys"
Sep 11 21:34:58.583487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583433    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca3f748-370a-4a11-8e7b-96c3a4d9ad3b" containerName="revoke-keys"
Sep 11 21:34:58.583487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583444    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy"
Sep 11 21:34:58.583487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583453    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy"
Sep 11 21:34:58.583487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583466    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy"
Sep 11 21:34:58.583487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583474    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583499    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583508    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583517    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583526    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583622    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583635    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583645    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ce16b3-a6f9-4ecd-9fe4-2841075ceb71" containerName="istio-proxy"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583653    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdbf7f09-7b8f-4639-8593-6a59f9adbb91" containerName="istio-proxy"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583662    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63bde92c-6878-4fa9-be9b-5470cb382f71" containerName="payload-pre-processing"
Sep 11 21:34:58.583849 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.583675    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca3f748-370a-4a11-8e7b-96c3a4d9ad3b" containerName="revoke-keys"
Sep 11 21:34:58.588308 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.588285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.590553 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.590534    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-ad5be0-openshift-default-dockercfg-rx8xs\""
Sep 11 21:34:58.598868 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.598843    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"]
Sep 11 21:34:58.696176 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.696139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-certs\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.696410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.696348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-credential-socket\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.696410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.696403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-data\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.696543 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.696450    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-istio-token\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.696543 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.696502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn9nk\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-kube-api-access-kn9nk\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.696655 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.696562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-socket\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.696655 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.696600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-envoy\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.696655 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.696624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4938ca-3311-42f8-a34c-18e20118f893-istiod-ca-cert\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.696904 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.696686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4938ca-3311-42f8-a34c-18e20118f893-istio-podinfo\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.797733 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.797695    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn9nk\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-kube-api-access-kn9nk\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.797943 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.797753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-socket\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.797943 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.797778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-envoy\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.797943 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.797804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4938ca-3311-42f8-a34c-18e20118f893-istiod-ca-cert\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.797943 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.797854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4938ca-3311-42f8-a34c-18e20118f893-istio-podinfo\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.797943 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.797883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-certs\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.798229 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.798091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-credential-socket\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.798229 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.798157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-data\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.798229 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.798203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-istio-token\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.798399 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.798238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-socket\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.798399 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.798263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-certs\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.798534 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.798507    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-data\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.798534 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.798521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-credential-socket\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.798647 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.798614    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4938ca-3311-42f8-a34c-18e20118f893-istiod-ca-cert\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.800475 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.800440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-envoy\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.800614 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.800591    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4938ca-3311-42f8-a34c-18e20118f893-istio-podinfo\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.805719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.805697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn9nk\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-kube-api-access-kn9nk\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.806677 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.806656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-istio-token\") pod \"e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") " pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:58.899165 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:58.899081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:34:59.180441 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:59.180413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"]
Sep 11 21:34:59.182507 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:34:59.182481    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4938ca_3311_42f8_a34c_18e20118f893.slice/crio-d5f3dce3154eb7f312c657fab2faa94aba145ff1de66e3658331d26839b5ac16 WatchSource:0}: Error finding container d5f3dce3154eb7f312c657fab2faa94aba145ff1de66e3658331d26839b5ac16: Status 404 returned error can't find the container with id d5f3dce3154eb7f312c657fab2faa94aba145ff1de66e3658331d26839b5ac16
Sep 11 21:34:59.185127 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:59.185088    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:34:59.185221 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:59.185179    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:34:59.185262 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:59.185220    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:34:59.218480 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:34:59.218438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" event={"ID":"0e4938ca-3311-42f8-a34c-18e20118f893","Type":"ContainerStarted","Data":"d5f3dce3154eb7f312c657fab2faa94aba145ff1de66e3658331d26839b5ac16"}
Sep 11 21:35:00.225774 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:00.225737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" event={"ID":"0e4938ca-3311-42f8-a34c-18e20118f893","Type":"ContainerStarted","Data":"4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802"}
Sep 11 21:35:00.250161 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:00.250110    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" podStartSLOduration=2.25009415 podStartE2EDuration="2.25009415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:34:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:00.248197961 +0000 UTC m=+1057.960858011" watchObservedRunningTime="2026-09-11 21:35:00.25009415 +0000 UTC m=+1057.962754198"
Sep 11 21:35:00.899834 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:00.899788    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:35:00.905058 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:00.905031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:35:01.231941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:01.231856    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:35:01.232779 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:01.232762    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:35:06.096945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.096914    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"]
Sep 11 21:35:06.100585 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.100568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:06.103068 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.103040    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-ad5be0-dockercfg-jbm27\""
Sep 11 21:35:06.103339 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.103324    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-ad5be0\""
Sep 11 21:35:06.111496 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.111472    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"]
Sep 11 21:35:06.141211 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.141185    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"]
Sep 11 21:35:06.144670 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.144655    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:06.153983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.153953    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"]
Sep 11 21:35:06.270245 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.270212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spxgx\" (UniqueName: \"kubernetes.io/projected/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-kube-api-access-spxgx\") pod \"payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47\" (UID: \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:06.270454 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.270256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7745d1e-9d1c-48e0-ad9c-a921141d6861-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd\" (UID: \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:06.270454 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.270359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5lpr\" (UniqueName: \"kubernetes.io/projected/b7745d1e-9d1c-48e0-ad9c-a921141d6861-kube-api-access-x5lpr\") pod \"payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd\" (UID: \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:06.270454 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.270413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47\" (UID: \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:06.371456 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.371362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spxgx\" (UniqueName: \"kubernetes.io/projected/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-kube-api-access-spxgx\") pod \"payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47\" (UID: \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:06.371456 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.371415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7745d1e-9d1c-48e0-ad9c-a921141d6861-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd\" (UID: \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:06.371664 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.371474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5lpr\" (UniqueName: \"kubernetes.io/projected/b7745d1e-9d1c-48e0-ad9c-a921141d6861-kube-api-access-x5lpr\") pod \"payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd\" (UID: \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:06.371664 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.371514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47\" (UID: \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:06.372160 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.372140    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7745d1e-9d1c-48e0-ad9c-a921141d6861-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd\" (UID: \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:06.372228 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.372209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47\" (UID: \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:06.379369 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.379346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spxgx\" (UniqueName: \"kubernetes.io/projected/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-kube-api-access-spxgx\") pod \"payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47\" (UID: \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:06.379369 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.379362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5lpr\" (UniqueName: \"kubernetes.io/projected/b7745d1e-9d1c-48e0-ad9c-a921141d6861-kube-api-access-x5lpr\") pod \"payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd\" (UID: \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:06.412231 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.412209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:06.455348 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.455318    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:06.688626 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.688597    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"]
Sep 11 21:35:06.690040 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:35:06.690014    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7745d1e_9d1c_48e0_ad9c_a921141d6861.slice/crio-27c04c1519ab3dbd99ce51cff4947db57c65e6bd2e9c40d5b8d904bd9f58d349 WatchSource:0}: Error finding container 27c04c1519ab3dbd99ce51cff4947db57c65e6bd2e9c40d5b8d904bd9f58d349: Status 404 returned error can't find the container with id 27c04c1519ab3dbd99ce51cff4947db57c65e6bd2e9c40d5b8d904bd9f58d349
Sep 11 21:35:06.750375 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:06.750350    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"]
Sep 11 21:35:06.752140 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:35:06.752112    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fbb889_6b7d_43f0_be88_2d59db9da3c9.slice/crio-a2f32814f70435f8463a4cac3d6d6f95760067f22a8039d9c1bfdcc22221bd70 WatchSource:0}: Error finding container a2f32814f70435f8463a4cac3d6d6f95760067f22a8039d9c1bfdcc22221bd70: Status 404 returned error can't find the container with id a2f32814f70435f8463a4cac3d6d6f95760067f22a8039d9c1bfdcc22221bd70
Sep 11 21:35:07.269306 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:07.269269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd" event={"ID":"b7745d1e-9d1c-48e0-ad9c-a921141d6861","Type":"ContainerStarted","Data":"f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f"}
Sep 11 21:35:07.269779 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:07.269335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd" event={"ID":"b7745d1e-9d1c-48e0-ad9c-a921141d6861","Type":"ContainerStarted","Data":"27c04c1519ab3dbd99ce51cff4947db57c65e6bd2e9c40d5b8d904bd9f58d349"}
Sep 11 21:35:07.269779 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:07.269478    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:07.271180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:07.271147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47" event={"ID":"a8fbb889-6b7d-43f0-be88-2d59db9da3c9","Type":"ContainerStarted","Data":"17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242"}
Sep 11 21:35:07.271297 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:07.271184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47" event={"ID":"a8fbb889-6b7d-43f0-be88-2d59db9da3c9","Type":"ContainerStarted","Data":"a2f32814f70435f8463a4cac3d6d6f95760067f22a8039d9c1bfdcc22221bd70"}
Sep 11 21:35:07.271347 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:07.271294    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:07.286317 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:07.286273    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd" podStartSLOduration=1.286262093 podStartE2EDuration="1.286262093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:07.285173171 +0000 UTC m=+1064.997833221" watchObservedRunningTime="2026-09-11 21:35:07.286262093 +0000 UTC m=+1064.998922139"
Sep 11 21:35:07.301361 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:07.301320    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47" podStartSLOduration=1.3013029139999999 podStartE2EDuration="1.301302914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:07.300130088 +0000 UTC m=+1065.012790141" watchObservedRunningTime="2026-09-11 21:35:07.301302914 +0000 UTC m=+1065.013962964"
Sep 11 21:35:18.286261 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:18.286173    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:35:18.286697 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:18.286438    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:35:35.660214 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:35.660177    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"]
Sep 11 21:35:35.664040 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:35.664021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"
Sep 11 21:35:35.666393 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:35.666372    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:35:35.666498 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:35.666446    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:35:35.670858 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:35.670804    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"]
Sep 11 21:35:35.761978 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:35.761941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c88c311d-6247-4631-a12d-f226f7750b06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh\" (UID: \"c88c311d-6247-4631-a12d-f226f7750b06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"
Sep 11 21:35:35.863312 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:35.863275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c88c311d-6247-4631-a12d-f226f7750b06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh\" (UID: \"c88c311d-6247-4631-a12d-f226f7750b06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"
Sep 11 21:35:35.863938 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:35.863920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c88c311d-6247-4631-a12d-f226f7750b06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh\" (UID: \"c88c311d-6247-4631-a12d-f226f7750b06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"
Sep 11 21:35:35.978338 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:35.978251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"
Sep 11 21:35:36.251739 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:36.251671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"]
Sep 11 21:35:36.255039 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:35:36.255013    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88c311d_6247_4631_a12d_f226f7750b06.slice/crio-78992dad126ffe1e29b667ad0f55e1377b80e4bfa99d83f1acfec64f89ff9af3 WatchSource:0}: Error finding container 78992dad126ffe1e29b667ad0f55e1377b80e4bfa99d83f1acfec64f89ff9af3: Status 404 returned error can't find the container with id 78992dad126ffe1e29b667ad0f55e1377b80e4bfa99d83f1acfec64f89ff9af3
Sep 11 21:35:36.450646 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:36.450618    2560 generic.go:356] "Generic (PLEG): container finished" podID="0e4938ca-3311-42f8-a34c-18e20118f893" containerID="4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802" exitCode=0
Sep 11 21:35:36.450783 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:36.450684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" event={"ID":"0e4938ca-3311-42f8-a34c-18e20118f893","Type":"ContainerDied","Data":"4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802"}
Sep 11 21:35:36.451198 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:36.451170    2560 scope.go:117] "RemoveContainer" containerID="4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802"
Sep 11 21:35:36.452120 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:36.452091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh" event={"ID":"c88c311d-6247-4631-a12d-f226f7750b06","Type":"ContainerStarted","Data":"78992dad126ffe1e29b667ad0f55e1377b80e4bfa99d83f1acfec64f89ff9af3"}
Sep 11 21:35:36.452390 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:36.452363    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:35:36.452444 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:36.452431    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:35:36.452483 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:36.452464    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:35:37.459256 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:37.459219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" event={"ID":"0e4938ca-3311-42f8-a34c-18e20118f893","Type":"ContainerStarted","Data":"3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca"}
Sep 11 21:35:37.460838 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:37.460794    2560 generic.go:356] "Generic (PLEG): container finished" podID="c88c311d-6247-4631-a12d-f226f7750b06" containerID="00ab4bdc635da8a991b8d24f7aba2a7a4ec88d35011ae6614c8035782db21593" exitCode=0
Sep 11 21:35:37.460995 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:37.460883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh" event={"ID":"c88c311d-6247-4631-a12d-f226f7750b06","Type":"ContainerDied","Data":"00ab4bdc635da8a991b8d24f7aba2a7a4ec88d35011ae6614c8035782db21593"}
Sep 11 21:35:37.900491 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:37.900457    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:35:37.901544 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:37.901461    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 21:35:37.901720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:37.901696    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 21:35:38.638879 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:38.638809    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"
Sep 11 21:35:38.806400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:38.806311    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c88c311d-6247-4631-a12d-f226f7750b06-maas-api-service-ca\") pod \"c88c311d-6247-4631-a12d-f226f7750b06\" (UID: \"c88c311d-6247-4631-a12d-f226f7750b06\") "
Sep 11 21:35:38.806944 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:38.806902    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c88c311d-6247-4631-a12d-f226f7750b06-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c88c311d-6247-4631-a12d-f226f7750b06" (UID: "c88c311d-6247-4631-a12d-f226f7750b06"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:35:38.900535 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:38.900490    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 21:35:38.900724 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:38.900564    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 21:35:38.907355 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:38.907330    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c88c311d-6247-4631-a12d-f226f7750b06-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:35:39.475894 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:39.475764    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"
Sep 11 21:35:39.475894 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:39.475765    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh" event={"ID":"c88c311d-6247-4631-a12d-f226f7750b06","Type":"ContainerDied","Data":"78992dad126ffe1e29b667ad0f55e1377b80e4bfa99d83f1acfec64f89ff9af3"}
Sep 11 21:35:39.476147 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:39.475930    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78992dad126ffe1e29b667ad0f55e1377b80e4bfa99d83f1acfec64f89ff9af3"
Sep 11 21:35:39.900569 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:39.900523    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 21:35:39.901109 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:39.900593    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 21:35:40.144929 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.144894    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"]
Sep 11 21:35:40.145327 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.145315    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c88c311d-6247-4631-a12d-f226f7750b06" containerName="revoke-keys"
Sep 11 21:35:40.145371 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.145329    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c88c311d-6247-4631-a12d-f226f7750b06" containerName="revoke-keys"
Sep 11 21:35:40.145423 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.145414    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c88c311d-6247-4631-a12d-f226f7750b06" containerName="revoke-keys"
Sep 11 21:35:40.147812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.147765    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:35:40.150772 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.150719    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-408219\""
Sep 11 21:35:40.157969 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.157943    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"]
Sep 11 21:35:40.206277 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.206243    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"]
Sep 11 21:35:40.209726 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.209702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:40.210426 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.210399    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"]
Sep 11 21:35:40.212301 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.212282    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-408219-dockercfg-cvqd6\""
Sep 11 21:35:40.321401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.321364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jhwh\" (UniqueName: \"kubernetes.io/projected/227af85e-1733-4033-a842-961d85eb22bc-kube-api-access-4jhwh\") pod \"payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x\" (UID: \"227af85e-1733-4033-a842-961d85eb22bc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:40.321589 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.321412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv4fc\" (UniqueName: \"kubernetes.io/projected/b02f3448-0d05-4df9-aa98-3a8469799705-kube-api-access-hv4fc\") pod \"payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln\" (UID: \"b02f3448-0d05-4df9-aa98-3a8469799705\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:35:40.321589 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.321524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/227af85e-1733-4033-a842-961d85eb22bc-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x\" (UID: \"227af85e-1733-4033-a842-961d85eb22bc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:40.321589 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.321567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b02f3448-0d05-4df9-aa98-3a8469799705-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln\" (UID: \"b02f3448-0d05-4df9-aa98-3a8469799705\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:35:40.422521 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.422428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv4fc\" (UniqueName: \"kubernetes.io/projected/b02f3448-0d05-4df9-aa98-3a8469799705-kube-api-access-hv4fc\") pod \"payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln\" (UID: \"b02f3448-0d05-4df9-aa98-3a8469799705\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:35:40.422521 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.422511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/227af85e-1733-4033-a842-961d85eb22bc-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x\" (UID: \"227af85e-1733-4033-a842-961d85eb22bc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:40.422778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.422557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b02f3448-0d05-4df9-aa98-3a8469799705-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln\" (UID: \"b02f3448-0d05-4df9-aa98-3a8469799705\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:35:40.422778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.422627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jhwh\" (UniqueName: \"kubernetes.io/projected/227af85e-1733-4033-a842-961d85eb22bc-kube-api-access-4jhwh\") pod \"payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x\" (UID: \"227af85e-1733-4033-a842-961d85eb22bc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:40.423279 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.423253    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/227af85e-1733-4033-a842-961d85eb22bc-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x\" (UID: \"227af85e-1733-4033-a842-961d85eb22bc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:40.423398 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.423348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b02f3448-0d05-4df9-aa98-3a8469799705-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln\" (UID: \"b02f3448-0d05-4df9-aa98-3a8469799705\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:35:40.431272 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.431247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv4fc\" (UniqueName: \"kubernetes.io/projected/b02f3448-0d05-4df9-aa98-3a8469799705-kube-api-access-hv4fc\") pod \"payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln\" (UID: \"b02f3448-0d05-4df9-aa98-3a8469799705\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:35:40.431518 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.431500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jhwh\" (UniqueName: \"kubernetes.io/projected/227af85e-1733-4033-a842-961d85eb22bc-kube-api-access-4jhwh\") pod \"payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x\" (UID: \"227af85e-1733-4033-a842-961d85eb22bc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:40.459042 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.459018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:35:40.523151 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.523040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:40.767460 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.767436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"]
Sep 11 21:35:40.769607 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:35:40.769579    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02f3448_0d05_4df9_aa98_3a8469799705.slice/crio-33f270b62dd91106da3c0eeb40c34f381319531bedae9444efda886519f89d12 WatchSource:0}: Error finding container 33f270b62dd91106da3c0eeb40c34f381319531bedae9444efda886519f89d12: Status 404 returned error can't find the container with id 33f270b62dd91106da3c0eeb40c34f381319531bedae9444efda886519f89d12
Sep 11 21:35:40.849173 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.849144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"]
Sep 11 21:35:40.851970 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:35:40.851938    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod227af85e_1733_4033_a842_961d85eb22bc.slice/crio-260853a9317b3413972e40ce6dd3865409fd93b464ef9b2d2be3355216812d24 WatchSource:0}: Error finding container 260853a9317b3413972e40ce6dd3865409fd93b464ef9b2d2be3355216812d24: Status 404 returned error can't find the container with id 260853a9317b3413972e40ce6dd3865409fd93b464ef9b2d2be3355216812d24
Sep 11 21:35:40.907872 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.906938    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 21:35:40.907872 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:40.907006    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 21:35:41.493514 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.493473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x" event={"ID":"227af85e-1733-4033-a842-961d85eb22bc","Type":"ContainerStarted","Data":"af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e"}
Sep 11 21:35:41.493842 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.493798    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x" event={"ID":"227af85e-1733-4033-a842-961d85eb22bc","Type":"ContainerStarted","Data":"260853a9317b3413972e40ce6dd3865409fd93b464ef9b2d2be3355216812d24"}
Sep 11 21:35:41.494898 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.494875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:41.497173 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.497142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln" event={"ID":"b02f3448-0d05-4df9-aa98-3a8469799705","Type":"ContainerStarted","Data":"1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c"}
Sep 11 21:35:41.497292 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.497195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln" event={"ID":"b02f3448-0d05-4df9-aa98-3a8469799705","Type":"ContainerStarted","Data":"33f270b62dd91106da3c0eeb40c34f381319531bedae9444efda886519f89d12"}
Sep 11 21:35:41.497719 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.497694    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:35:41.516627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.516568    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x" podStartSLOduration=1.516548499 podStartE2EDuration="1.516548499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:41.513231413 +0000 UTC m=+1099.225891463" watchObservedRunningTime="2026-09-11 21:35:41.516548499 +0000 UTC m=+1099.229208549"
Sep 11 21:35:41.532156 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.532108    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln" podStartSLOduration=1.532095069 podStartE2EDuration="1.532095069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:41.529930454 +0000 UTC m=+1099.242590495" watchObservedRunningTime="2026-09-11 21:35:41.532095069 +0000 UTC m=+1099.244755117"
Sep 11 21:35:41.900510 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.900464    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 11 21:35:41.900703 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:41.900543    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 11 21:35:42.926393 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:42.926358    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:35:42.926959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:42.926938    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:35:42.928499 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:42.928475    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:35:46.383636 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.383597    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp"]
Sep 11 21:35:46.385879 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.385849    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-1a1e3a-29819370-wk6wp"]
Sep 11 21:35:46.420303 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.420271    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"]
Sep 11 21:35:46.420601 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.420569    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt" podUID="9bfa6d79-e0f0-4dc7-add3-16b451bbed5d" containerName="payload-pre-processing" containerID="cri-o://b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d" gracePeriod=30
Sep 11 21:35:46.575660 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.575624    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"]
Sep 11 21:35:46.578876 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.578846    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1a1e3a-tvflh"]
Sep 11 21:35:46.699319 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.699286    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:35:46.782176 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.782141    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqt7r\" (UniqueName: \"kubernetes.io/projected/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-kube-api-access-lqt7r\") pod \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\" (UID: \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\") "
Sep 11 21:35:46.782348 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.782192    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-plugins-config-volume\") pod \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\" (UID: \"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d\") "
Sep 11 21:35:46.782600 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.782564    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9bfa6d79-e0f0-4dc7-add3-16b451bbed5d" (UID: "9bfa6d79-e0f0-4dc7-add3-16b451bbed5d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:35:46.784489 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.784464    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-kube-api-access-lqt7r" (OuterVolumeSpecName: "kube-api-access-lqt7r") pod "9bfa6d79-e0f0-4dc7-add3-16b451bbed5d" (UID: "9bfa6d79-e0f0-4dc7-add3-16b451bbed5d"). InnerVolumeSpecName "kube-api-access-lqt7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:46.804447 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.804417    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d72908-c56b-48bd-958f-4c73e63b8b52" path="/var/lib/kubelet/pods/06d72908-c56b-48bd-958f-4c73e63b8b52/volumes"
Sep 11 21:35:46.804818 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.804798    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c88c311d-6247-4631-a12d-f226f7750b06" path="/var/lib/kubelet/pods/c88c311d-6247-4631-a12d-f226f7750b06/volumes"
Sep 11 21:35:46.883170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.883139    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqt7r\" (UniqueName: \"kubernetes.io/projected/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-kube-api-access-lqt7r\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:35:46.883170 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:46.883163    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:35:47.537766 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:47.537728    2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfa6d79-e0f0-4dc7-add3-16b451bbed5d" containerID="b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d" exitCode=0
Sep 11 21:35:47.538230 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:47.537773    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"
Sep 11 21:35:47.538230 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:47.537810    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt" event={"ID":"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d","Type":"ContainerDied","Data":"b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d"}
Sep 11 21:35:47.538230 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:47.537891    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt" event={"ID":"9bfa6d79-e0f0-4dc7-add3-16b451bbed5d","Type":"ContainerDied","Data":"c522c67b53324497e5898d96ed1f69cfde62e52f325fd7f83f1c74bde0b2f281"}
Sep 11 21:35:47.538230 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:47.537915    2560 scope.go:117] "RemoveContainer" containerID="b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d"
Sep 11 21:35:47.549141 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:47.549123    2560 scope.go:117] "RemoveContainer" containerID="b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d"
Sep 11 21:35:47.549447 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:35:47.549424    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d\": container with ID starting with b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d not found: ID does not exist" containerID="b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d"
Sep 11 21:35:47.549524 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:47.549459    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d"} err="failed to get container status \"b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d\": rpc error: code = NotFound desc = could not find container \"b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d\": container with ID starting with b74274055f0063a8660b92fad39996c2ffaf660675d91f453412f7b9f159e24d not found: ID does not exist"
Sep 11 21:35:47.554231 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:47.554193    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"]
Sep 11 21:35:47.559182 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:47.559162    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt"]
Sep 11 21:35:48.801633 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:48.801603    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bfa6d79-e0f0-4dc7-add3-16b451bbed5d" path="/var/lib/kubelet/pods/9bfa6d79-e0f0-4dc7-add3-16b451bbed5d/volumes"
Sep 11 21:35:53.513586 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:53.513559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:35:53.514090 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:35:53.513628    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:36:07.205663 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.205624    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k"]
Sep 11 21:36:07.208702 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.208677    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-02c60f-29819370-zg77k"]
Sep 11 21:36:07.235978 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.235948    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"]
Sep 11 21:36:07.236203 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.236154    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g" podUID="d34a17ab-c0ae-481e-909d-d151e3d10b53" containerName="payload-processing" containerID="cri-o://6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd" gracePeriod=30
Sep 11 21:36:07.247591 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.246620    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"]
Sep 11 21:36:07.248504 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.247880    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw" podUID="44d18f0d-37d8-4e63-8a71-c5d783a234fd" containerName="payload-pre-processing" containerID="cri-o://273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2" gracePeriod=30
Sep 11 21:36:07.527901 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.527872    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:36:07.566020 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.565995    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:36:07.594709 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.594683    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbvkx\" (UniqueName: \"kubernetes.io/projected/d34a17ab-c0ae-481e-909d-d151e3d10b53-kube-api-access-rbvkx\") pod \"d34a17ab-c0ae-481e-909d-d151e3d10b53\" (UID: \"d34a17ab-c0ae-481e-909d-d151e3d10b53\") "
Sep 11 21:36:07.594890 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.594839    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d34a17ab-c0ae-481e-909d-d151e3d10b53-plugins-config-volume\") pod \"d34a17ab-c0ae-481e-909d-d151e3d10b53\" (UID: \"d34a17ab-c0ae-481e-909d-d151e3d10b53\") "
Sep 11 21:36:07.595368 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.595303    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34a17ab-c0ae-481e-909d-d151e3d10b53-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d34a17ab-c0ae-481e-909d-d151e3d10b53" (UID: "d34a17ab-c0ae-481e-909d-d151e3d10b53"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:36:07.597513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.597488    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34a17ab-c0ae-481e-909d-d151e3d10b53-kube-api-access-rbvkx" (OuterVolumeSpecName: "kube-api-access-rbvkx") pod "d34a17ab-c0ae-481e-909d-d151e3d10b53" (UID: "d34a17ab-c0ae-481e-909d-d151e3d10b53"). InnerVolumeSpecName "kube-api-access-rbvkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:36:07.661483 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.661451    2560 generic.go:356] "Generic (PLEG): container finished" podID="d34a17ab-c0ae-481e-909d-d151e3d10b53" containerID="6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd" exitCode=0
Sep 11 21:36:07.661659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.661493    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"
Sep 11 21:36:07.661659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.661541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g" event={"ID":"d34a17ab-c0ae-481e-909d-d151e3d10b53","Type":"ContainerDied","Data":"6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd"}
Sep 11 21:36:07.661659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.661608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g" event={"ID":"d34a17ab-c0ae-481e-909d-d151e3d10b53","Type":"ContainerDied","Data":"49a905aaab69c1ec5700f0ac9f258ed3b91dcaedbb6891aab306a03d47c7a476"}
Sep 11 21:36:07.661659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.661643    2560 scope.go:117] "RemoveContainer" containerID="6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd"
Sep 11 21:36:07.663079 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.663057    2560 generic.go:356] "Generic (PLEG): container finished" podID="44d18f0d-37d8-4e63-8a71-c5d783a234fd" containerID="273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2" exitCode=0
Sep 11 21:36:07.663212 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.663102    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"
Sep 11 21:36:07.663212 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.663133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw" event={"ID":"44d18f0d-37d8-4e63-8a71-c5d783a234fd","Type":"ContainerDied","Data":"273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2"}
Sep 11 21:36:07.663212 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.663168    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw" event={"ID":"44d18f0d-37d8-4e63-8a71-c5d783a234fd","Type":"ContainerDied","Data":"aad3f7dc96eb0484c38b9fb2b2f164c44bbd04ba75f12a8901b36d2df63599a1"}
Sep 11 21:36:07.671698 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.671682    2560 scope.go:117] "RemoveContainer" containerID="6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd"
Sep 11 21:36:07.671980 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:36:07.671962    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd\": container with ID starting with 6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd not found: ID does not exist" containerID="6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd"
Sep 11 21:36:07.672038 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.671991    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd"} err="failed to get container status \"6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd\": rpc error: code = NotFound desc = could not find container \"6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd\": container with ID starting with 6aa13912881f3b991f7eaf84f1a00391186d8a9e2dcf66520f9c7c61bf5fb9bd not found: ID does not exist"
Sep 11 21:36:07.672038 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.672009    2560 scope.go:117] "RemoveContainer" containerID="273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2"
Sep 11 21:36:07.680860 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.680760    2560 scope.go:117] "RemoveContainer" containerID="273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2"
Sep 11 21:36:07.681193 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:36:07.681171    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2\": container with ID starting with 273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2 not found: ID does not exist" containerID="273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2"
Sep 11 21:36:07.681283 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.681199    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2"} err="failed to get container status \"273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2\": rpc error: code = NotFound desc = could not find container \"273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2\": container with ID starting with 273e081490c3e751f4aca42b3763884f9afd24aebcc9a77fd004573cbdf6f9f2 not found: ID does not exist"
Sep 11 21:36:07.684015 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.683995    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"]
Sep 11 21:36:07.686137 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.686105    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g"]
Sep 11 21:36:07.695985 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.695967    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44d18f0d-37d8-4e63-8a71-c5d783a234fd-plugins-config-volume\") pod \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\" (UID: \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\") "
Sep 11 21:36:07.696104 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.696092    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgwv4\" (UniqueName: \"kubernetes.io/projected/44d18f0d-37d8-4e63-8a71-c5d783a234fd-kube-api-access-tgwv4\") pod \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\" (UID: \"44d18f0d-37d8-4e63-8a71-c5d783a234fd\") "
Sep 11 21:36:07.696321 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.696301    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44d18f0d-37d8-4e63-8a71-c5d783a234fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44d18f0d-37d8-4e63-8a71-c5d783a234fd" (UID: "44d18f0d-37d8-4e63-8a71-c5d783a234fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:36:07.696442 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.696428    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44d18f0d-37d8-4e63-8a71-c5d783a234fd-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:36:07.696479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.696445    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d34a17ab-c0ae-481e-909d-d151e3d10b53-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:36:07.696479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.696454    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbvkx\" (UniqueName: \"kubernetes.io/projected/d34a17ab-c0ae-481e-909d-d151e3d10b53-kube-api-access-rbvkx\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:36:07.698248 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.698230    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44d18f0d-37d8-4e63-8a71-c5d783a234fd-kube-api-access-tgwv4" (OuterVolumeSpecName: "kube-api-access-tgwv4") pod "44d18f0d-37d8-4e63-8a71-c5d783a234fd" (UID: "44d18f0d-37d8-4e63-8a71-c5d783a234fd"). InnerVolumeSpecName "kube-api-access-tgwv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:36:07.797943 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.797853    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgwv4\" (UniqueName: \"kubernetes.io/projected/44d18f0d-37d8-4e63-8a71-c5d783a234fd-kube-api-access-tgwv4\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:36:07.987188 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.987156    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"]
Sep 11 21:36:07.991472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:07.991450    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw"]
Sep 11 21:36:08.801776 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:08.801732    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44d18f0d-37d8-4e63-8a71-c5d783a234fd" path="/var/lib/kubelet/pods/44d18f0d-37d8-4e63-8a71-c5d783a234fd/volumes"
Sep 11 21:36:08.802315 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:08.802293    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d34a17ab-c0ae-481e-909d-d151e3d10b53" path="/var/lib/kubelet/pods/d34a17ab-c0ae-481e-909d-d151e3d10b53/volumes"
Sep 11 21:36:08.802599 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:08.802582    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f786a3ef-a06b-409b-aee1-08b5028340b9" path="/var/lib/kubelet/pods/f786a3ef-a06b-409b-aee1-08b5028340b9/volumes"
Sep 11 21:36:15.085085 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085049    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"]
Sep 11 21:36:15.085674 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085659    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44d18f0d-37d8-4e63-8a71-c5d783a234fd" containerName="payload-pre-processing"
Sep 11 21:36:15.085729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085678    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="44d18f0d-37d8-4e63-8a71-c5d783a234fd" containerName="payload-pre-processing"
Sep 11 21:36:15.085729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085696    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfa6d79-e0f0-4dc7-add3-16b451bbed5d" containerName="payload-pre-processing"
Sep 11 21:36:15.085729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085705    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfa6d79-e0f0-4dc7-add3-16b451bbed5d" containerName="payload-pre-processing"
Sep 11 21:36:15.085845 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085739    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34a17ab-c0ae-481e-909d-d151e3d10b53" containerName="payload-processing"
Sep 11 21:36:15.085845 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085748    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34a17ab-c0ae-481e-909d-d151e3d10b53" containerName="payload-processing"
Sep 11 21:36:15.085940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085853    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="44d18f0d-37d8-4e63-8a71-c5d783a234fd" containerName="payload-pre-processing"
Sep 11 21:36:15.085940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085870    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34a17ab-c0ae-481e-909d-d151e3d10b53" containerName="payload-processing"
Sep 11 21:36:15.085940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.085880    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfa6d79-e0f0-4dc7-add3-16b451bbed5d" containerName="payload-pre-processing"
Sep 11 21:36:15.091057 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.091035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.093595 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.093576    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-c97420-openshift-default-dockercfg-p6jkf\""
Sep 11 21:36:15.101502 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.101479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"]
Sep 11 21:36:15.270499 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.270457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-token\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.270699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.270611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-socket\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.270699 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.270665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-certs\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.270851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.270730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-credential-socket\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.270851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.270763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5dbt\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-kube-api-access-c5dbt\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.270936 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.270878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-podinfo\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.270936 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.270917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-envoy\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.271020 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.270978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-data\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.271020 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.271014    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istiod-ca-cert\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.372733 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.372639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-credential-socket\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.372733 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.372696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5dbt\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-kube-api-access-c5dbt\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373001 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.372755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-podinfo\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373001 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.372790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-envoy\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373001 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.372862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-data\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373001 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.372900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istiod-ca-cert\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373001 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.372942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-token\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.373029    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-socket\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.373067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-certs\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.373076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-credential-socket\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.373446    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-certs\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373617 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.373557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-socket\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373802 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.373660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istiod-ca-cert\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.373802 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.373738    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-data\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.375479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.375454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-podinfo\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.375580 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.375559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-envoy\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.380432 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.380410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-token\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.380693 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.380675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5dbt\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-kube-api-access-c5dbt\") pod \"e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") " pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.403622 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.403596    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:15.682133 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.682111    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"]
Sep 11 21:36:15.684180 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:36:15.684150    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ae4a4c_5ea8_45ca_881f_30a6e5f38cc9.slice/crio-8c940159e84890285695947270d3cac13e8d7c399f3ff553e95a960125c93b80 WatchSource:0}: Error finding container 8c940159e84890285695947270d3cac13e8d7c399f3ff553e95a960125c93b80: Status 404 returned error can't find the container with id 8c940159e84890285695947270d3cac13e8d7c399f3ff553e95a960125c93b80
Sep 11 21:36:15.686595 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.686563    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:36:15.686662 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.686649    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:36:15.686700 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.686677    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:36:15.712352 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:15.712326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" event={"ID":"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9","Type":"ContainerStarted","Data":"8c940159e84890285695947270d3cac13e8d7c399f3ff553e95a960125c93b80"}
Sep 11 21:36:16.719858 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:16.719804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" event={"ID":"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9","Type":"ContainerStarted","Data":"2d3f997b71e9514c14ab74ec0161ace3da0f669ed2e28e86a2ef7864ab50bfe1"}
Sep 11 21:36:16.740735 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:16.740685    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" podStartSLOduration=1.740670041 podStartE2EDuration="1.740670041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:16.74024432 +0000 UTC m=+1134.452904381" watchObservedRunningTime="2026-09-11 21:36:16.740670041 +0000 UTC m=+1134.453330089"
Sep 11 21:36:17.404804 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:17.404776    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:17.409705 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:17.409681    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:17.725501 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:17.725418    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:17.726415 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:17.726397    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:22.852061 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:22.852031    2560 scope.go:117] "RemoveContainer" containerID="85ef3411b550626710b853104a2406add298d017c970ff8d28966b5f14d05501"
Sep 11 21:36:22.860361 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:22.860341    2560 scope.go:117] "RemoveContainer" containerID="ef099cbfc4de5c94c1cd23e097099e0f6c0ab92a78cf1aa881825eb6d4ded831"
Sep 11 21:36:22.868464 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:22.868448    2560 scope.go:117] "RemoveContainer" containerID="d0e08f2b2f6ac36a0ee08e8d6d33377b47aa833996e8d9cbdf69c08ddca8dcf7"
Sep 11 21:36:22.876055 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:22.876039    2560 scope.go:117] "RemoveContainer" containerID="822a0b1b149af4e7526cd08b372ff8e454b3b471d3cb3217310bbf9351fd0b0c"
Sep 11 21:36:22.883334 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:22.883314    2560 scope.go:117] "RemoveContainer" containerID="24da2276d798e4fafae213c0e969957f2d07f45cd5a2c08e94e1c16393ff9a40"
Sep 11 21:36:24.686014 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.685977    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"]
Sep 11 21:36:24.691293 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.691275    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:24.694026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.694003    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-c97420\""
Sep 11 21:36:24.694282 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.694268    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-c97420-dockercfg-vkzkj\""
Sep 11 21:36:24.701936 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.701909    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"]
Sep 11 21:36:24.771734 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.771695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks9pj\" (UniqueName: \"kubernetes.io/projected/82a2412d-8774-4ef0-aa1a-fceaa13bc368-kube-api-access-ks9pj\") pod \"payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr\" (UID: \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:24.771964 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.771858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82a2412d-8774-4ef0-aa1a-fceaa13bc368-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr\" (UID: \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:24.872517 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.872484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks9pj\" (UniqueName: \"kubernetes.io/projected/82a2412d-8774-4ef0-aa1a-fceaa13bc368-kube-api-access-ks9pj\") pod \"payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr\" (UID: \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:24.872692 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.872571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82a2412d-8774-4ef0-aa1a-fceaa13bc368-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr\" (UID: \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:24.873326 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.873306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82a2412d-8774-4ef0-aa1a-fceaa13bc368-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr\" (UID: \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:24.882132 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:24.882108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks9pj\" (UniqueName: \"kubernetes.io/projected/82a2412d-8774-4ef0-aa1a-fceaa13bc368-kube-api-access-ks9pj\") pod \"payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr\" (UID: \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:25.003755 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:25.003666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:25.283761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:25.283737    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"]
Sep 11 21:36:25.285703 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:36:25.285677    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a2412d_8774_4ef0_aa1a_fceaa13bc368.slice/crio-9e503aa2471f943e775937c9d7f788cd32591232df19c98aecb73b031d6d3ac1 WatchSource:0}: Error finding container 9e503aa2471f943e775937c9d7f788cd32591232df19c98aecb73b031d6d3ac1: Status 404 returned error can't find the container with id 9e503aa2471f943e775937c9d7f788cd32591232df19c98aecb73b031d6d3ac1
Sep 11 21:36:25.777680 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:25.777649    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr" event={"ID":"82a2412d-8774-4ef0-aa1a-fceaa13bc368","Type":"ContainerStarted","Data":"5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334"}
Sep 11 21:36:25.778081 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:25.777699    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr" event={"ID":"82a2412d-8774-4ef0-aa1a-fceaa13bc368","Type":"ContainerStarted","Data":"9e503aa2471f943e775937c9d7f788cd32591232df19c98aecb73b031d6d3ac1"}
Sep 11 21:36:25.778081 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:25.777731    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:25.795971 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:25.795921    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr" podStartSLOduration=1.795906468 podStartE2EDuration="1.795906468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:25.794815068 +0000 UTC m=+1143.507475117" watchObservedRunningTime="2026-09-11 21:36:25.795906468 +0000 UTC m=+1143.508566517"
Sep 11 21:36:36.786618 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:36.786578    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:36:49.415599 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.413026    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"]
Sep 11 21:36:49.417748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.417722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.420522 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.420501    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-e0c211-openshift-default-dockercfg-8d2cm\""
Sep 11 21:36:49.431428 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.431294    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"]
Sep 11 21:36:49.524257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.523527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x858b\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-kube-api-access-x858b\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.524257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.523584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-data\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.524257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.523630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449085b-6e33-492c-b439-c4a4c592ef56-istio-podinfo\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.524257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.523666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-socket\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.524257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.523695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-certs\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.524257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.523784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-envoy\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.524257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.523888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-credential-socket\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.524257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.523968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449085b-6e33-492c-b439-c4a4c592ef56-istiod-ca-cert\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.524257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.524125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-istio-token\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625011 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.624970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-istio-token\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625011 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x858b\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-kube-api-access-x858b\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-data\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449085b-6e33-492c-b439-c4a4c592ef56-istio-podinfo\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-socket\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625096    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-certs\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-envoy\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-credential-socket\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625246 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449085b-6e33-492c-b439-c4a4c592ef56-istiod-ca-cert\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625592 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-socket\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.625813 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.625786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449085b-6e33-492c-b439-c4a4c592ef56-istiod-ca-cert\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.626038 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.626015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-credential-socket\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.626136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.626088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-certs\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.626202 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.626135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-data\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.628040 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.628018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-envoy\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.628136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.628105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449085b-6e33-492c-b439-c4a4c592ef56-istio-podinfo\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.641123 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.641095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-istio-token\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.644622 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.644600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x858b\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-kube-api-access-x858b\") pod \"e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") " pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:49.733968 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:49.733859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:50.037715 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:50.037691    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"]
Sep 11 21:36:50.039334 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:36:50.039308    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf449085b_6e33_492c_b439_c4a4c592ef56.slice/crio-1c0eeee25b5712454f9a255e1fee2b55ed6eced1b53ac96f8c590c17301feccd WatchSource:0}: Error finding container 1c0eeee25b5712454f9a255e1fee2b55ed6eced1b53ac96f8c590c17301feccd: Status 404 returned error can't find the container with id 1c0eeee25b5712454f9a255e1fee2b55ed6eced1b53ac96f8c590c17301feccd
Sep 11 21:36:50.041571 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:50.041535    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:36:50.041694 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:50.041616    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:36:50.041694 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:50.041662    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:36:50.924238 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:50.924201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" event={"ID":"f449085b-6e33-492c-b439-c4a4c592ef56","Type":"ContainerStarted","Data":"e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86"}
Sep 11 21:36:50.924614 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:50.924261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" event={"ID":"f449085b-6e33-492c-b439-c4a4c592ef56","Type":"ContainerStarted","Data":"1c0eeee25b5712454f9a255e1fee2b55ed6eced1b53ac96f8c590c17301feccd"}
Sep 11 21:36:50.968895 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:50.968841    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" podStartSLOduration=1.9688046190000001 podStartE2EDuration="1.968804619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:50.967912484 +0000 UTC m=+1168.680572533" watchObservedRunningTime="2026-09-11 21:36:50.968804619 +0000 UTC m=+1168.681464744"
Sep 11 21:36:51.734300 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:51.734260    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:51.739209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:51.739188    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:51.930971 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:51.930936    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:51.932217 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:51.932194    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:36:56.959229 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:56.959193    2560 generic.go:356] "Generic (PLEG): container finished" podID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerID="2d3f997b71e9514c14ab74ec0161ace3da0f669ed2e28e86a2ef7864ab50bfe1" exitCode=0
Sep 11 21:36:56.959640 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:56.959268    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" event={"ID":"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9","Type":"ContainerDied","Data":"2d3f997b71e9514c14ab74ec0161ace3da0f669ed2e28e86a2ef7864ab50bfe1"}
Sep 11 21:36:56.959733 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:56.959704    2560 scope.go:117] "RemoveContainer" containerID="2d3f997b71e9514c14ab74ec0161ace3da0f669ed2e28e86a2ef7864ab50bfe1"
Sep 11 21:36:56.961032 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:56.961004    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:36:56.961095 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:56.961072    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:36:56.961130 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:56.961104    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:36:57.966952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:57.966920    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" event={"ID":"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9","Type":"ContainerStarted","Data":"f68be4b4fca6f69de17e3c1bee761525e6823ef3d2e42a89a7a175500f730e8a"}
Sep 11 21:36:58.404571 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:58.404521    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:36:58.406280 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:58.406250    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 21:36:58.406433 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:58.406315    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 21:36:59.404358 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:59.404309    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 21:36:59.404881 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:36:59.404384    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 21:37:00.404776 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:00.404729    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 21:37:00.405296 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:00.404798    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 21:37:01.404338 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:01.404224    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 21:37:01.404338 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:01.404297    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 21:37:02.405006 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:02.404968    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 21:37:02.405632 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:02.405598    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 21:37:02.726198 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:02.726105    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:37:03.408921 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:03.408882    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:37:03.410063 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:03.410038    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:37:17.085458 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:17.085425    2560 generic.go:356] "Generic (PLEG): container finished" podID="f449085b-6e33-492c-b439-c4a4c592ef56" containerID="e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86" exitCode=0
Sep 11 21:37:17.085910 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:17.085507    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" event={"ID":"f449085b-6e33-492c-b439-c4a4c592ef56","Type":"ContainerDied","Data":"e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86"}
Sep 11 21:37:17.085985 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:17.085971    2560 scope.go:117] "RemoveContainer" containerID="e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86"
Sep 11 21:37:17.087298 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:17.087270    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:37:17.087365 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:17.087339    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:37:17.087402 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:17.087386    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:37:18.113608 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:18.113578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" event={"ID":"f449085b-6e33-492c-b439-c4a4c592ef56","Type":"ContainerStarted","Data":"8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a"}
Sep 11 21:37:18.734455 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:18.734416    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:37:18.735743 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:18.735717    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:37:18.735874 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:18.735768    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 21:37:19.734316 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:19.734280    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:37:19.734757 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:19.734339    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 21:37:20.734793 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:20.734753    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:37:20.735318 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:20.734809    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 21:37:21.735106 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:21.735074    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:37:21.735530 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:21.735132    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 21:37:21.931682 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:21.931650    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:37:22.734192 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:22.734150    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:37:22.734401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:22.734212    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 21:37:22.931434 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:22.931398    2560 scope.go:117] "RemoveContainer" containerID="5a3bb20b6a9e729b3d43b484e0b34e741969aa0389d90b0a5d959b684689bfe0"
Sep 11 21:37:23.738495 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:23.738463    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:37:23.739547 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:37:23.739522    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:38:15.654173 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:15.654091    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"]
Sep 11 21:38:15.657910 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:15.657890    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"
Sep 11 21:38:15.660093 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:15.660068    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:38:15.660217 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:15.660185    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:38:15.664945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:15.664921    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"]
Sep 11 21:38:15.703593 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:15.703566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/021c6574-bf9d-4ad6-9735-ee8a920a0302-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7\" (UID: \"021c6574-bf9d-4ad6-9735-ee8a920a0302\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"
Sep 11 21:38:15.804991 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:15.804963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/021c6574-bf9d-4ad6-9735-ee8a920a0302-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7\" (UID: \"021c6574-bf9d-4ad6-9735-ee8a920a0302\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"
Sep 11 21:38:15.805583 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:15.805562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/021c6574-bf9d-4ad6-9735-ee8a920a0302-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7\" (UID: \"021c6574-bf9d-4ad6-9735-ee8a920a0302\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"
Sep 11 21:38:15.969784 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:15.969697    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"
Sep 11 21:38:16.240751 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:16.240725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"]
Sep 11 21:38:16.242883 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:38:16.242852    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021c6574_bf9d_4ad6_9735_ee8a920a0302.slice/crio-737e43f687768ec3322999b42f7e682ad21d4162df05177fce02cf4eda9e55e8 WatchSource:0}: Error finding container 737e43f687768ec3322999b42f7e682ad21d4162df05177fce02cf4eda9e55e8: Status 404 returned error can't find the container with id 737e43f687768ec3322999b42f7e682ad21d4162df05177fce02cf4eda9e55e8
Sep 11 21:38:16.433065 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:16.433025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7" event={"ID":"021c6574-bf9d-4ad6-9735-ee8a920a0302","Type":"ContainerStarted","Data":"737e43f687768ec3322999b42f7e682ad21d4162df05177fce02cf4eda9e55e8"}
Sep 11 21:38:17.440637 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:17.440605    2560 generic.go:356] "Generic (PLEG): container finished" podID="021c6574-bf9d-4ad6-9735-ee8a920a0302" containerID="d9606a873cc7ce6aa65dbd81ecfe5b53518ce191b88f45e395e1bd7b7e99abac" exitCode=0
Sep 11 21:38:17.441045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:17.440689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7" event={"ID":"021c6574-bf9d-4ad6-9735-ee8a920a0302","Type":"ContainerDied","Data":"d9606a873cc7ce6aa65dbd81ecfe5b53518ce191b88f45e395e1bd7b7e99abac"}
Sep 11 21:38:18.582917 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:18.582892    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"
Sep 11 21:38:18.636449 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:18.636419    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/021c6574-bf9d-4ad6-9735-ee8a920a0302-maas-api-service-ca\") pod \"021c6574-bf9d-4ad6-9735-ee8a920a0302\" (UID: \"021c6574-bf9d-4ad6-9735-ee8a920a0302\") "
Sep 11 21:38:18.636784 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:18.636760    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/021c6574-bf9d-4ad6-9735-ee8a920a0302-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "021c6574-bf9d-4ad6-9735-ee8a920a0302" (UID: "021c6574-bf9d-4ad6-9735-ee8a920a0302"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:38:18.737357 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:18.737277    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/021c6574-bf9d-4ad6-9735-ee8a920a0302-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:38:19.452702 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:19.452665    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7" event={"ID":"021c6574-bf9d-4ad6-9735-ee8a920a0302","Type":"ContainerDied","Data":"737e43f687768ec3322999b42f7e682ad21d4162df05177fce02cf4eda9e55e8"}
Sep 11 21:38:19.452926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:19.452718    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="737e43f687768ec3322999b42f7e682ad21d4162df05177fce02cf4eda9e55e8"
Sep 11 21:38:19.452926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:19.452674    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"
Sep 11 21:38:22.953032 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:22.953001    2560 scope.go:117] "RemoveContainer" containerID="1bfd6fdc799175f69a70bc869a9b32e5e67b6782c5d177ee5dbe2f3d54dc3a62"
Sep 11 21:38:22.963802 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:22.963781    2560 scope.go:117] "RemoveContainer" containerID="3ac679b57b278ee566f4a379d9f08dd7aefa8c6f446b29f2322c28381dcc0b1e"
Sep 11 21:38:31.752729 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:31.752698    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"]
Sep 11 21:38:31.757653 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:31.757630    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bc0b206e-w7rc7"]
Sep 11 21:38:32.801993 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:38:32.801950    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="021c6574-bf9d-4ad6-9735-ee8a920a0302" path="/var/lib/kubelet/pods/021c6574-bf9d-4ad6-9735-ee8a920a0302/volumes"
Sep 11 21:40:22.997968 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:22.997921    2560 scope.go:117] "RemoveContainer" containerID="4f7e20ee91b2edb28b0cc3eaecd4515b72c4c737a86b63aa3d0b1ec0c154a8e3"
Sep 11 21:40:28.370722 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.370686    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"]
Sep 11 21:40:28.371180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.371165    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021c6574-bf9d-4ad6-9735-ee8a920a0302" containerName="revoke-keys"
Sep 11 21:40:28.371180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.371181    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="021c6574-bf9d-4ad6-9735-ee8a920a0302" containerName="revoke-keys"
Sep 11 21:40:28.371260 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.371248    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="021c6574-bf9d-4ad6-9735-ee8a920a0302" containerName="revoke-keys"
Sep 11 21:40:28.375816 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.375799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:40:28.378473 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.378450    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-78e0f8\""
Sep 11 21:40:28.378473 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.378451    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-78e0f8-dockercfg-wkdd6\""
Sep 11 21:40:28.383946 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.383918    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"]
Sep 11 21:40:28.543708 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.543668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79dm\" (UniqueName: \"kubernetes.io/projected/bca79b04-1920-4763-897b-8cabf8f15a14-kube-api-access-d79dm\") pod \"payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl\" (UID: \"bca79b04-1920-4763-897b-8cabf8f15a14\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:40:28.543913 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.543791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bca79b04-1920-4763-897b-8cabf8f15a14-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl\" (UID: \"bca79b04-1920-4763-897b-8cabf8f15a14\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:40:28.644456 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.644370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bca79b04-1920-4763-897b-8cabf8f15a14-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl\" (UID: \"bca79b04-1920-4763-897b-8cabf8f15a14\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:40:28.644615 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.644486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d79dm\" (UniqueName: \"kubernetes.io/projected/bca79b04-1920-4763-897b-8cabf8f15a14-kube-api-access-d79dm\") pod \"payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl\" (UID: \"bca79b04-1920-4763-897b-8cabf8f15a14\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:40:28.645125 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.645104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bca79b04-1920-4763-897b-8cabf8f15a14-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl\" (UID: \"bca79b04-1920-4763-897b-8cabf8f15a14\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:40:28.652613 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.652584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79dm\" (UniqueName: \"kubernetes.io/projected/bca79b04-1920-4763-897b-8cabf8f15a14-kube-api-access-d79dm\") pod \"payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl\" (UID: \"bca79b04-1920-4763-897b-8cabf8f15a14\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:40:28.687293 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.687262    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:40:28.962611 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:28.962580    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"]
Sep 11 21:40:28.964275 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:40:28.964247    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca79b04_1920_4763_897b_8cabf8f15a14.slice/crio-b4549a980d9bb9584b20555c08c1d74f411110637908c6bf1d70fa57d8e93c8d WatchSource:0}: Error finding container b4549a980d9bb9584b20555c08c1d74f411110637908c6bf1d70fa57d8e93c8d: Status 404 returned error can't find the container with id b4549a980d9bb9584b20555c08c1d74f411110637908c6bf1d70fa57d8e93c8d
Sep 11 21:40:29.185013 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:29.184975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl" event={"ID":"bca79b04-1920-4763-897b-8cabf8f15a14","Type":"ContainerStarted","Data":"c5f08120fefac0443d66bad6350e5af578d9fc383ef491a69bc9008282334afc"}
Sep 11 21:40:29.185195 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:29.185026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl" event={"ID":"bca79b04-1920-4763-897b-8cabf8f15a14","Type":"ContainerStarted","Data":"b4549a980d9bb9584b20555c08c1d74f411110637908c6bf1d70fa57d8e93c8d"}
Sep 11 21:40:29.185195 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:29.185076    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:40:29.206421 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:29.206367    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl" podStartSLOduration=1.206349161 podStartE2EDuration="1.206349161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:40:29.203345169 +0000 UTC m=+1386.916005219" watchObservedRunningTime="2026-09-11 21:40:29.206349161 +0000 UTC m=+1386.919009216"
Sep 11 21:40:40.194010 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:40:40.193972    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:41:02.578526 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.578484    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"]
Sep 11 21:41:02.582696 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.582672    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:02.585082 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.585058    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-d2170a\""
Sep 11 21:41:02.585222 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.585199    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-d2170a-dockercfg-t9t99\""
Sep 11 21:41:02.592863 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.592836    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"]
Sep 11 21:41:02.615145 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.615109    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"]
Sep 11 21:41:02.619588 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.619564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:02.631866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.631802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"]
Sep 11 21:41:02.687399 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.687294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4\" (UID: \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\") " pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:02.687843 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.687799    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xltq\" (UniqueName: \"kubernetes.io/projected/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-kube-api-access-7xltq\") pod \"payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4\" (UID: \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\") " pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:02.688078 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.688050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81963b3d-73c3-4f01-b47d-c114b00af9e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn\" (UID: \"81963b3d-73c3-4f01-b47d-c114b00af9e0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:02.688215 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.688113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqd5m\" (UniqueName: \"kubernetes.io/projected/81963b3d-73c3-4f01-b47d-c114b00af9e0-kube-api-access-zqd5m\") pod \"payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn\" (UID: \"81963b3d-73c3-4f01-b47d-c114b00af9e0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:02.789390 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.789354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81963b3d-73c3-4f01-b47d-c114b00af9e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn\" (UID: \"81963b3d-73c3-4f01-b47d-c114b00af9e0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:02.789390 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.789402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqd5m\" (UniqueName: \"kubernetes.io/projected/81963b3d-73c3-4f01-b47d-c114b00af9e0-kube-api-access-zqd5m\") pod \"payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn\" (UID: \"81963b3d-73c3-4f01-b47d-c114b00af9e0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:02.789643 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.789462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4\" (UID: \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\") " pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:02.789643 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.789549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xltq\" (UniqueName: \"kubernetes.io/projected/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-kube-api-access-7xltq\") pod \"payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4\" (UID: \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\") " pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:02.790146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.790125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81963b3d-73c3-4f01-b47d-c114b00af9e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn\" (UID: \"81963b3d-73c3-4f01-b47d-c114b00af9e0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:02.790306 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.790289    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4\" (UID: \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\") " pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:02.798023 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.797991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xltq\" (UniqueName: \"kubernetes.io/projected/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-kube-api-access-7xltq\") pod \"payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4\" (UID: \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\") " pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:02.798185 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.798165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqd5m\" (UniqueName: \"kubernetes.io/projected/81963b3d-73c3-4f01-b47d-c114b00af9e0-kube-api-access-zqd5m\") pod \"payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn\" (UID: \"81963b3d-73c3-4f01-b47d-c114b00af9e0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:02.894474 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.894384    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:02.931989 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:02.931955    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:03.172302 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.172275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"]
Sep 11 21:41:03.174421 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:41:03.174398    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81963b3d_73c3_4f01_b47d_c114b00af9e0.slice/crio-799d43ac2044b1c524bbb353fac03aebe33aa06b9dad968a2ab147dd087b7c7c WatchSource:0}: Error finding container 799d43ac2044b1c524bbb353fac03aebe33aa06b9dad968a2ab147dd087b7c7c: Status 404 returned error can't find the container with id 799d43ac2044b1c524bbb353fac03aebe33aa06b9dad968a2ab147dd087b7c7c
Sep 11 21:41:03.225774 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.225747    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"]
Sep 11 21:41:03.229045 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:41:03.229016    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6b21fb_da6b_4f25_9dd9_58ec5756e9df.slice/crio-e9b3fea51c4083da07fff4dbd9f8254a53fbcb8a505e42ae353be01774f8b8b2 WatchSource:0}: Error finding container e9b3fea51c4083da07fff4dbd9f8254a53fbcb8a505e42ae353be01774f8b8b2: Status 404 returned error can't find the container with id e9b3fea51c4083da07fff4dbd9f8254a53fbcb8a505e42ae353be01774f8b8b2
Sep 11 21:41:03.375254 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.375216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn" event={"ID":"81963b3d-73c3-4f01-b47d-c114b00af9e0","Type":"ContainerStarted","Data":"0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a"}
Sep 11 21:41:03.375478 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.375329    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:03.375478 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.375357    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn" event={"ID":"81963b3d-73c3-4f01-b47d-c114b00af9e0","Type":"ContainerStarted","Data":"799d43ac2044b1c524bbb353fac03aebe33aa06b9dad968a2ab147dd087b7c7c"}
Sep 11 21:41:03.377286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.377251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4" event={"ID":"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df","Type":"ContainerStarted","Data":"0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7"}
Sep 11 21:41:03.377426 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.377304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4" event={"ID":"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df","Type":"ContainerStarted","Data":"e9b3fea51c4083da07fff4dbd9f8254a53fbcb8a505e42ae353be01774f8b8b2"}
Sep 11 21:41:03.377426 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.377348    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:03.398251 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.398183    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn" podStartSLOduration=1.398160667 podStartE2EDuration="1.398160667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:41:03.395771238 +0000 UTC m=+1421.108431288" watchObservedRunningTime="2026-09-11 21:41:03.398160667 +0000 UTC m=+1421.110820720"
Sep 11 21:41:03.420091 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:03.420029    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4" podStartSLOduration=1.420010534 podStartE2EDuration="1.420010534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:41:03.419112039 +0000 UTC m=+1421.131772086" watchObservedRunningTime="2026-09-11 21:41:03.420010534 +0000 UTC m=+1421.132670583"
Sep 11 21:41:14.385668 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:14.385587    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:41:14.386189 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:14.385673    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:41:23.019859 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:23.019803    2560 scope.go:117] "RemoveContainer" containerID="6e565229284758293d05eb7c23e80ea5a194cd8b8e96cd22dfe20fc274805397"
Sep 11 21:41:29.606507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:29.606472    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"]
Sep 11 21:41:29.611536 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:29.611512    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"
Sep 11 21:41:29.613956 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:29.613933    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:41:29.614064 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:29.613957    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:41:29.619987 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:29.619962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"]
Sep 11 21:41:29.673335 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:29.673298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91c3fbf1-eb12-4b2e-81f9-f311e6eac889-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm\" (UID: \"91c3fbf1-eb12-4b2e-81f9-f311e6eac889\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"
Sep 11 21:41:29.773984 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:29.773945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91c3fbf1-eb12-4b2e-81f9-f311e6eac889-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm\" (UID: \"91c3fbf1-eb12-4b2e-81f9-f311e6eac889\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"
Sep 11 21:41:29.774595 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:29.774568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91c3fbf1-eb12-4b2e-81f9-f311e6eac889-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm\" (UID: \"91c3fbf1-eb12-4b2e-81f9-f311e6eac889\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"
Sep 11 21:41:29.923452 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:29.923340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"
Sep 11 21:41:30.197879 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:30.197855    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"]
Sep 11 21:41:30.200055 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:41:30.200023    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c3fbf1_eb12_4b2e_81f9_f311e6eac889.slice/crio-db5f30b897118ac4eefc5d88552719cb9e02e72d91ed289b9c55039253c4b8ad WatchSource:0}: Error finding container db5f30b897118ac4eefc5d88552719cb9e02e72d91ed289b9c55039253c4b8ad: Status 404 returned error can't find the container with id db5f30b897118ac4eefc5d88552719cb9e02e72d91ed289b9c55039253c4b8ad
Sep 11 21:41:30.541025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:30.540990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm" event={"ID":"91c3fbf1-eb12-4b2e-81f9-f311e6eac889","Type":"ContainerStarted","Data":"65396c352c55f6f6f80b05e2d503776a26bf3ba1084fc55c6f6afd4ed482cd00"}
Sep 11 21:41:30.541215 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:30.541049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm" event={"ID":"91c3fbf1-eb12-4b2e-81f9-f311e6eac889","Type":"ContainerStarted","Data":"db5f30b897118ac4eefc5d88552719cb9e02e72d91ed289b9c55039253c4b8ad"}
Sep 11 21:41:30.558034 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:30.557980    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm" podStartSLOduration=1.55796344 podStartE2EDuration="1.55796344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:41:30.556807974 +0000 UTC m=+1448.269468026" watchObservedRunningTime="2026-09-11 21:41:30.55796344 +0000 UTC m=+1448.270623530"
Sep 11 21:41:31.548257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:31.548217    2560 generic.go:356] "Generic (PLEG): container finished" podID="91c3fbf1-eb12-4b2e-81f9-f311e6eac889" containerID="65396c352c55f6f6f80b05e2d503776a26bf3ba1084fc55c6f6afd4ed482cd00" exitCode=0
Sep 11 21:41:31.548641 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:31.548297    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm" event={"ID":"91c3fbf1-eb12-4b2e-81f9-f311e6eac889","Type":"ContainerDied","Data":"65396c352c55f6f6f80b05e2d503776a26bf3ba1084fc55c6f6afd4ed482cd00"}
Sep 11 21:41:32.703735 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:32.703713    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"
Sep 11 21:41:32.806553 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:32.806477    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91c3fbf1-eb12-4b2e-81f9-f311e6eac889-maas-api-service-ca\") pod \"91c3fbf1-eb12-4b2e-81f9-f311e6eac889\" (UID: \"91c3fbf1-eb12-4b2e-81f9-f311e6eac889\") "
Sep 11 21:41:32.806914 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:32.806887    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91c3fbf1-eb12-4b2e-81f9-f311e6eac889-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "91c3fbf1-eb12-4b2e-81f9-f311e6eac889" (UID: "91c3fbf1-eb12-4b2e-81f9-f311e6eac889"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:41:32.807023 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:32.807010    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91c3fbf1-eb12-4b2e-81f9-f311e6eac889-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:41:33.560901 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:33.560856    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"
Sep 11 21:41:33.561098 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:33.560863    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm" event={"ID":"91c3fbf1-eb12-4b2e-81f9-f311e6eac889","Type":"ContainerDied","Data":"db5f30b897118ac4eefc5d88552719cb9e02e72d91ed289b9c55039253c4b8ad"}
Sep 11 21:41:33.561098 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:33.561005    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db5f30b897118ac4eefc5d88552719cb9e02e72d91ed289b9c55039253c4b8ad"
Sep 11 21:41:45.471335 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.471296    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"]
Sep 11 21:41:45.471972 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.471573    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl" podUID="bca79b04-1920-4763-897b-8cabf8f15a14" containerName="payload-pre-processing" containerID="cri-o://c5f08120fefac0443d66bad6350e5af578d9fc383ef491a69bc9008282334afc" gracePeriod=30
Sep 11 21:41:45.633541 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.633502    2560 generic.go:356] "Generic (PLEG): container finished" podID="bca79b04-1920-4763-897b-8cabf8f15a14" containerID="c5f08120fefac0443d66bad6350e5af578d9fc383ef491a69bc9008282334afc" exitCode=0
Sep 11 21:41:45.633701 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.633569    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl" event={"ID":"bca79b04-1920-4763-897b-8cabf8f15a14","Type":"ContainerDied","Data":"c5f08120fefac0443d66bad6350e5af578d9fc383ef491a69bc9008282334afc"}
Sep 11 21:41:45.748120 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.748038    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"]
Sep 11 21:41:45.752599 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.752567    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-78e0f8-5r5qm"]
Sep 11 21:41:45.779977 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.779946    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:41:45.849473 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.849438    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d79dm\" (UniqueName: \"kubernetes.io/projected/bca79b04-1920-4763-897b-8cabf8f15a14-kube-api-access-d79dm\") pod \"bca79b04-1920-4763-897b-8cabf8f15a14\" (UID: \"bca79b04-1920-4763-897b-8cabf8f15a14\") "
Sep 11 21:41:45.849653 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.849496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bca79b04-1920-4763-897b-8cabf8f15a14-plugins-config-volume\") pod \"bca79b04-1920-4763-897b-8cabf8f15a14\" (UID: \"bca79b04-1920-4763-897b-8cabf8f15a14\") "
Sep 11 21:41:45.849938 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.849893    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bca79b04-1920-4763-897b-8cabf8f15a14-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bca79b04-1920-4763-897b-8cabf8f15a14" (UID: "bca79b04-1920-4763-897b-8cabf8f15a14"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:41:45.850343 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.850319    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bca79b04-1920-4763-897b-8cabf8f15a14-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:41:45.851961 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.851942    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca79b04-1920-4763-897b-8cabf8f15a14-kube-api-access-d79dm" (OuterVolumeSpecName: "kube-api-access-d79dm") pod "bca79b04-1920-4763-897b-8cabf8f15a14" (UID: "bca79b04-1920-4763-897b-8cabf8f15a14"). InnerVolumeSpecName "kube-api-access-d79dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:41:45.951087 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:45.951048    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d79dm\" (UniqueName: \"kubernetes.io/projected/bca79b04-1920-4763-897b-8cabf8f15a14-kube-api-access-d79dm\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:41:46.642006 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:46.641971    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"
Sep 11 21:41:46.642472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:46.641985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl" event={"ID":"bca79b04-1920-4763-897b-8cabf8f15a14","Type":"ContainerDied","Data":"b4549a980d9bb9584b20555c08c1d74f411110637908c6bf1d70fa57d8e93c8d"}
Sep 11 21:41:46.642472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:46.642116    2560 scope.go:117] "RemoveContainer" containerID="c5f08120fefac0443d66bad6350e5af578d9fc383ef491a69bc9008282334afc"
Sep 11 21:41:46.671779 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:46.671739    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"]
Sep 11 21:41:46.678513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:46.678487    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl"]
Sep 11 21:41:46.802501 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:46.802453    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91c3fbf1-eb12-4b2e-81f9-f311e6eac889" path="/var/lib/kubelet/pods/91c3fbf1-eb12-4b2e-81f9-f311e6eac889/volumes"
Sep 11 21:41:46.802998 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:46.802975    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca79b04-1920-4763-897b-8cabf8f15a14" path="/var/lib/kubelet/pods/bca79b04-1920-4763-897b-8cabf8f15a14/volumes"
Sep 11 21:41:49.435102 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.435068    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"]
Sep 11 21:41:49.435545 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.435531    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca79b04-1920-4763-897b-8cabf8f15a14" containerName="payload-pre-processing"
Sep 11 21:41:49.435545 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.435546    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca79b04-1920-4763-897b-8cabf8f15a14" containerName="payload-pre-processing"
Sep 11 21:41:49.435626 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.435578    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c3fbf1-eb12-4b2e-81f9-f311e6eac889" containerName="revoke-keys"
Sep 11 21:41:49.435626 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.435584    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c3fbf1-eb12-4b2e-81f9-f311e6eac889" containerName="revoke-keys"
Sep 11 21:41:49.435690 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.435665    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91c3fbf1-eb12-4b2e-81f9-f311e6eac889" containerName="revoke-keys"
Sep 11 21:41:49.435690 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.435675    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca79b04-1920-4763-897b-8cabf8f15a14" containerName="payload-pre-processing"
Sep 11 21:41:49.440386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.440366    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"
Sep 11 21:41:49.443253 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.443231    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:41:49.443390 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.443231    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:41:49.450799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.450772    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"]
Sep 11 21:41:49.487601 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.487566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef8d929a-09a2-4849-8e6b-f4d841424707-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz\" (UID: \"ef8d929a-09a2-4849-8e6b-f4d841424707\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"
Sep 11 21:41:49.589416 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.589355    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef8d929a-09a2-4849-8e6b-f4d841424707-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz\" (UID: \"ef8d929a-09a2-4849-8e6b-f4d841424707\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"
Sep 11 21:41:49.590077 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.590054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef8d929a-09a2-4849-8e6b-f4d841424707-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz\" (UID: \"ef8d929a-09a2-4849-8e6b-f4d841424707\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"
Sep 11 21:41:49.753726 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:49.753635    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"
Sep 11 21:41:50.031910 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:50.031809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"]
Sep 11 21:41:50.035482 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:41:50.035452    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8d929a_09a2_4849_8e6b_f4d841424707.slice/crio-5e4a9d70440d4e01f66077d0968a7a3c760365adb6ac765132ed0c2a7ecb9d36 WatchSource:0}: Error finding container 5e4a9d70440d4e01f66077d0968a7a3c760365adb6ac765132ed0c2a7ecb9d36: Status 404 returned error can't find the container with id 5e4a9d70440d4e01f66077d0968a7a3c760365adb6ac765132ed0c2a7ecb9d36
Sep 11 21:41:50.670411 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:50.670372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz" event={"ID":"ef8d929a-09a2-4849-8e6b-f4d841424707","Type":"ContainerStarted","Data":"23102094009b0da29e643d73a79688443d8f2fb688c5d776d47106542fb6037d"}
Sep 11 21:41:50.670898 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:50.670472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz" event={"ID":"ef8d929a-09a2-4849-8e6b-f4d841424707","Type":"ContainerStarted","Data":"5e4a9d70440d4e01f66077d0968a7a3c760365adb6ac765132ed0c2a7ecb9d36"}
Sep 11 21:41:50.686967 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:50.686910    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz" podStartSLOduration=1.686888584 podStartE2EDuration="1.686888584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:41:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:41:50.686340178 +0000 UTC m=+1468.399000228" watchObservedRunningTime="2026-09-11 21:41:50.686888584 +0000 UTC m=+1468.399548632"
Sep 11 21:41:51.677261 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:51.677222    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef8d929a-09a2-4849-8e6b-f4d841424707" containerID="23102094009b0da29e643d73a79688443d8f2fb688c5d776d47106542fb6037d" exitCode=0
Sep 11 21:41:51.677693 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:51.677278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz" event={"ID":"ef8d929a-09a2-4849-8e6b-f4d841424707","Type":"ContainerDied","Data":"23102094009b0da29e643d73a79688443d8f2fb688c5d776d47106542fb6037d"}
Sep 11 21:41:52.856803 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:52.856776    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"
Sep 11 21:41:52.925008 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:52.924975    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef8d929a-09a2-4849-8e6b-f4d841424707-maas-api-service-ca\") pod \"ef8d929a-09a2-4849-8e6b-f4d841424707\" (UID: \"ef8d929a-09a2-4849-8e6b-f4d841424707\") "
Sep 11 21:41:52.925344 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:52.925322    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8d929a-09a2-4849-8e6b-f4d841424707-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef8d929a-09a2-4849-8e6b-f4d841424707" (UID: "ef8d929a-09a2-4849-8e6b-f4d841424707"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:41:52.961184 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:52.961093    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"]
Sep 11 21:41:52.961893 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:52.961868    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8d929a-09a2-4849-8e6b-f4d841424707" containerName="revoke-keys"
Sep 11 21:41:52.961893 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:52.961892    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8d929a-09a2-4849-8e6b-f4d841424707" containerName="revoke-keys"
Sep 11 21:41:52.962105 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:52.961978    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8d929a-09a2-4849-8e6b-f4d841424707" containerName="revoke-keys"
Sep 11 21:41:52.965130 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:52.965113    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"
Sep 11 21:41:52.973005 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:52.972922    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"]
Sep 11 21:41:53.025992 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.025959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ab17cc-9713-45e5-9921-94775fd224a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj\" (UID: \"a6ab17cc-9713-45e5-9921-94775fd224a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"
Sep 11 21:41:53.026196 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.026149    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef8d929a-09a2-4849-8e6b-f4d841424707-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:41:53.126754 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.126723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ab17cc-9713-45e5-9921-94775fd224a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj\" (UID: \"a6ab17cc-9713-45e5-9921-94775fd224a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"
Sep 11 21:41:53.127530 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.127494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ab17cc-9713-45e5-9921-94775fd224a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj\" (UID: \"a6ab17cc-9713-45e5-9921-94775fd224a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"
Sep 11 21:41:53.277389 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.277302    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"
Sep 11 21:41:53.551200 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.551173    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"]
Sep 11 21:41:53.553536 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:41:53.553499    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ab17cc_9713_45e5_9921_94775fd224a4.slice/crio-536a8e197d735b9d29d3d6f44c07ac4b9ea44b46f4ee9a42c175f02fb822e8e7 WatchSource:0}: Error finding container 536a8e197d735b9d29d3d6f44c07ac4b9ea44b46f4ee9a42c175f02fb822e8e7: Status 404 returned error can't find the container with id 536a8e197d735b9d29d3d6f44c07ac4b9ea44b46f4ee9a42c175f02fb822e8e7
Sep 11 21:41:53.690837 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.690792    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"
Sep 11 21:41:53.691016 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.690846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz" event={"ID":"ef8d929a-09a2-4849-8e6b-f4d841424707","Type":"ContainerDied","Data":"5e4a9d70440d4e01f66077d0968a7a3c760365adb6ac765132ed0c2a7ecb9d36"}
Sep 11 21:41:53.691016 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.690907    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e4a9d70440d4e01f66077d0968a7a3c760365adb6ac765132ed0c2a7ecb9d36"
Sep 11 21:41:53.692115 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:53.692092    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj" event={"ID":"a6ab17cc-9713-45e5-9921-94775fd224a4","Type":"ContainerStarted","Data":"536a8e197d735b9d29d3d6f44c07ac4b9ea44b46f4ee9a42c175f02fb822e8e7"}
Sep 11 21:41:54.699314 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:54.699274    2560 generic.go:356] "Generic (PLEG): container finished" podID="a6ab17cc-9713-45e5-9921-94775fd224a4" containerID="7172ebfdd395502c7bdbc5343da61257e313fe81b43afdab27d290073d561128" exitCode=0
Sep 11 21:41:54.699776 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:54.699365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj" event={"ID":"a6ab17cc-9713-45e5-9921-94775fd224a4","Type":"ContainerDied","Data":"7172ebfdd395502c7bdbc5343da61257e313fe81b43afdab27d290073d561128"}
Sep 11 21:41:55.847696 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:55.847674    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"
Sep 11 21:41:55.956649 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:55.956551    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ab17cc-9713-45e5-9921-94775fd224a4-maas-api-service-ca\") pod \"a6ab17cc-9713-45e5-9921-94775fd224a4\" (UID: \"a6ab17cc-9713-45e5-9921-94775fd224a4\") "
Sep 11 21:41:55.956975 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:55.956950    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6ab17cc-9713-45e5-9921-94775fd224a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a6ab17cc-9713-45e5-9921-94775fd224a4" (UID: "a6ab17cc-9713-45e5-9921-94775fd224a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:41:56.058142 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:56.058098    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ab17cc-9713-45e5-9921-94775fd224a4-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:41:56.712521 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:56.712483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj" event={"ID":"a6ab17cc-9713-45e5-9921-94775fd224a4","Type":"ContainerDied","Data":"536a8e197d735b9d29d3d6f44c07ac4b9ea44b46f4ee9a42c175f02fb822e8e7"}
Sep 11 21:41:56.712521 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:56.712509    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"
Sep 11 21:41:56.712746 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:41:56.712538    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="536a8e197d735b9d29d3d6f44c07ac4b9ea44b46f4ee9a42c175f02fb822e8e7"
Sep 11 21:42:05.645627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.645577    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"]
Sep 11 21:42:05.646559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.646495    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq" podUID="088b6dcb-6b88-450e-86fd-64d84a526273" containerName="payload-processing" containerID="cri-o://9598838e4fac9d956b23909f4a0bd2ed64414694fc6c2c861feb6a854424c994" gracePeriod=30
Sep 11 21:42:05.652861 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.652736    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"]
Sep 11 21:42:05.653062 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.652993    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q" podUID="88bde9df-56d4-488f-9ac3-dc80cb611ac9" containerName="payload-pre-processing" containerID="cri-o://00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25" gracePeriod=30
Sep 11 21:42:05.769906 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.769868    2560 generic.go:356] "Generic (PLEG): container finished" podID="088b6dcb-6b88-450e-86fd-64d84a526273" containerID="9598838e4fac9d956b23909f4a0bd2ed64414694fc6c2c861feb6a854424c994" exitCode=0
Sep 11 21:42:05.770065 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.769947    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq" event={"ID":"088b6dcb-6b88-450e-86fd-64d84a526273","Type":"ContainerDied","Data":"9598838e4fac9d956b23909f4a0bd2ed64414694fc6c2c861feb6a854424c994"}
Sep 11 21:42:05.835844 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.835795    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"]
Sep 11 21:42:05.839654 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.839607    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-db06d6-qjdvz"]
Sep 11 21:42:05.916297 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.916273    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:42:05.950791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:05.950760    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:42:06.069142 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.069111    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms98d\" (UniqueName: \"kubernetes.io/projected/088b6dcb-6b88-450e-86fd-64d84a526273-kube-api-access-ms98d\") pod \"088b6dcb-6b88-450e-86fd-64d84a526273\" (UID: \"088b6dcb-6b88-450e-86fd-64d84a526273\") "
Sep 11 21:42:06.069142 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.069148    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088b6dcb-6b88-450e-86fd-64d84a526273-plugins-config-volume\") pod \"088b6dcb-6b88-450e-86fd-64d84a526273\" (UID: \"088b6dcb-6b88-450e-86fd-64d84a526273\") "
Sep 11 21:42:06.069354 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.069169    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88bde9df-56d4-488f-9ac3-dc80cb611ac9-plugins-config-volume\") pod \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\" (UID: \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\") "
Sep 11 21:42:06.069354 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.069236    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nsjk\" (UniqueName: \"kubernetes.io/projected/88bde9df-56d4-488f-9ac3-dc80cb611ac9-kube-api-access-5nsjk\") pod \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\" (UID: \"88bde9df-56d4-488f-9ac3-dc80cb611ac9\") "
Sep 11 21:42:06.069559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.069537    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/088b6dcb-6b88-450e-86fd-64d84a526273-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "088b6dcb-6b88-450e-86fd-64d84a526273" (UID: "088b6dcb-6b88-450e-86fd-64d84a526273"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:06.069614 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.069554    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88bde9df-56d4-488f-9ac3-dc80cb611ac9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88bde9df-56d4-488f-9ac3-dc80cb611ac9" (UID: "88bde9df-56d4-488f-9ac3-dc80cb611ac9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:06.071447 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.071427    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/088b6dcb-6b88-450e-86fd-64d84a526273-kube-api-access-ms98d" (OuterVolumeSpecName: "kube-api-access-ms98d") pod "088b6dcb-6b88-450e-86fd-64d84a526273" (UID: "088b6dcb-6b88-450e-86fd-64d84a526273"). InnerVolumeSpecName "kube-api-access-ms98d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:06.071532 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.071510    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88bde9df-56d4-488f-9ac3-dc80cb611ac9-kube-api-access-5nsjk" (OuterVolumeSpecName: "kube-api-access-5nsjk") pod "88bde9df-56d4-488f-9ac3-dc80cb611ac9" (UID: "88bde9df-56d4-488f-9ac3-dc80cb611ac9"). InnerVolumeSpecName "kube-api-access-5nsjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:06.170557 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.170478    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nsjk\" (UniqueName: \"kubernetes.io/projected/88bde9df-56d4-488f-9ac3-dc80cb611ac9-kube-api-access-5nsjk\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:06.170557 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.170506    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms98d\" (UniqueName: \"kubernetes.io/projected/088b6dcb-6b88-450e-86fd-64d84a526273-kube-api-access-ms98d\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:06.170557 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.170516    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088b6dcb-6b88-450e-86fd-64d84a526273-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:06.170557 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.170525    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88bde9df-56d4-488f-9ac3-dc80cb611ac9-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:06.777643 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.777610    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"
Sep 11 21:42:06.778164 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.777655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq" event={"ID":"088b6dcb-6b88-450e-86fd-64d84a526273","Type":"ContainerDied","Data":"f57ecb87144b1f862a15ee7ba93c9a788fbc4e66e177285e898f306b8b33a831"}
Sep 11 21:42:06.778164 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.777715    2560 scope.go:117] "RemoveContainer" containerID="9598838e4fac9d956b23909f4a0bd2ed64414694fc6c2c861feb6a854424c994"
Sep 11 21:42:06.779255 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.779228    2560 generic.go:356] "Generic (PLEG): container finished" podID="88bde9df-56d4-488f-9ac3-dc80cb611ac9" containerID="00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25" exitCode=0
Sep 11 21:42:06.779345 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.779280    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"
Sep 11 21:42:06.779345 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.779314    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q" event={"ID":"88bde9df-56d4-488f-9ac3-dc80cb611ac9","Type":"ContainerDied","Data":"00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25"}
Sep 11 21:42:06.779439 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.779357    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q" event={"ID":"88bde9df-56d4-488f-9ac3-dc80cb611ac9","Type":"ContainerDied","Data":"019281bc2d49adac60072c7ec544b7dd7e313555a5a9755ceac2fc7f7591ac82"}
Sep 11 21:42:06.787487 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.787471    2560 scope.go:117] "RemoveContainer" containerID="00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25"
Sep 11 21:42:06.796613 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.796592    2560 scope.go:117] "RemoveContainer" containerID="00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25"
Sep 11 21:42:06.796941 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:06.796921    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25\": container with ID starting with 00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25 not found: ID does not exist" containerID="00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25"
Sep 11 21:42:06.797006 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.796950    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25"} err="failed to get container status \"00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25\": rpc error: code = NotFound desc = could not find container \"00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25\": container with ID starting with 00ecf7a85a12da9a64f6e844c14ea7e1904cb86b45b12dd725aa4cd78073dc25 not found: ID does not exist"
Sep 11 21:42:06.800961 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.800936    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef8d929a-09a2-4849-8e6b-f4d841424707" path="/var/lib/kubelet/pods/ef8d929a-09a2-4849-8e6b-f4d841424707/volumes"
Sep 11 21:42:06.804040 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.804017    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"]
Sep 11 21:42:06.807857 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.807837    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq"]
Sep 11 21:42:06.818656 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.818628    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"]
Sep 11 21:42:06.823328 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:06.823302    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q"]
Sep 11 21:42:08.800798 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:08.800761    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="088b6dcb-6b88-450e-86fd-64d84a526273" path="/var/lib/kubelet/pods/088b6dcb-6b88-450e-86fd-64d84a526273/volumes"
Sep 11 21:42:08.801193 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:08.801146    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88bde9df-56d4-488f-9ac3-dc80cb611ac9" path="/var/lib/kubelet/pods/88bde9df-56d4-488f-9ac3-dc80cb611ac9/volumes"
Sep 11 21:42:11.340410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.340375    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"]
Sep 11 21:42:11.340893 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.340634    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4" podUID="2a6b21fb-da6b-4f25-9dd9-58ec5756e9df" containerName="payload-processing" containerID="cri-o://0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7" gracePeriod=30
Sep 11 21:42:11.352538 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.352501    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"]
Sep 11 21:42:11.353044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.352976    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn" podUID="81963b3d-73c3-4f01-b47d-c114b00af9e0" containerName="payload-pre-processing" containerID="cri-o://0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a" gracePeriod=30
Sep 11 21:42:11.526845 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.526552    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"]
Sep 11 21:42:11.530761 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.530709    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d2170a-rk4qj"]
Sep 11 21:42:11.643863 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.643816    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:42:11.647133 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.647108    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:42:11.812071 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.812037    2560 generic.go:356] "Generic (PLEG): container finished" podID="81963b3d-73c3-4f01-b47d-c114b00af9e0" containerID="0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a" exitCode=0
Sep 11 21:42:11.812273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.812076    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"
Sep 11 21:42:11.812273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.812127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn" event={"ID":"81963b3d-73c3-4f01-b47d-c114b00af9e0","Type":"ContainerDied","Data":"0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a"}
Sep 11 21:42:11.812273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.812180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn" event={"ID":"81963b3d-73c3-4f01-b47d-c114b00af9e0","Type":"ContainerDied","Data":"799d43ac2044b1c524bbb353fac03aebe33aa06b9dad968a2ab147dd087b7c7c"}
Sep 11 21:42:11.812273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.812211    2560 scope.go:117] "RemoveContainer" containerID="0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a"
Sep 11 21:42:11.813589 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.813566    2560 generic.go:356] "Generic (PLEG): container finished" podID="2a6b21fb-da6b-4f25-9dd9-58ec5756e9df" containerID="0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7" exitCode=0
Sep 11 21:42:11.813679 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.813604    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"
Sep 11 21:42:11.813679 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.813645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4" event={"ID":"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df","Type":"ContainerDied","Data":"0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7"}
Sep 11 21:42:11.814018 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.813690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4" event={"ID":"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df","Type":"ContainerDied","Data":"e9b3fea51c4083da07fff4dbd9f8254a53fbcb8a505e42ae353be01774f8b8b2"}
Sep 11 21:42:11.822797 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.822727    2560 scope.go:117] "RemoveContainer" containerID="0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a"
Sep 11 21:42:11.823067 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:11.823047    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a\": container with ID starting with 0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a not found: ID does not exist" containerID="0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a"
Sep 11 21:42:11.823127 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.823079    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a"} err="failed to get container status \"0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a\": rpc error: code = NotFound desc = could not find container \"0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a\": container with ID starting with 0d8485ff20283c702e82a4432a2ccec07eeaf3782470bc0285ebe210bcc7682a not found: ID does not exist"
Sep 11 21:42:11.823127 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.823096    2560 scope.go:117] "RemoveContainer" containerID="0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7"
Sep 11 21:42:11.831635 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.831614    2560 scope.go:117] "RemoveContainer" containerID="0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7"
Sep 11 21:42:11.831921 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:11.831900    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7\": container with ID starting with 0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7 not found: ID does not exist" containerID="0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7"
Sep 11 21:42:11.831999 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.831927    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7"} err="failed to get container status \"0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7\": rpc error: code = NotFound desc = could not find container \"0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7\": container with ID starting with 0b1aec1f9f6a78cfac6ef15bc35a31925d6ba591ea7ea10a6f8a40bf4f97cdc7 not found: ID does not exist"
Sep 11 21:42:11.834296 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.834278    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xltq\" (UniqueName: \"kubernetes.io/projected/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-kube-api-access-7xltq\") pod \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\" (UID: \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\") "
Sep 11 21:42:11.834373 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.834306    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqd5m\" (UniqueName: \"kubernetes.io/projected/81963b3d-73c3-4f01-b47d-c114b00af9e0-kube-api-access-zqd5m\") pod \"81963b3d-73c3-4f01-b47d-c114b00af9e0\" (UID: \"81963b3d-73c3-4f01-b47d-c114b00af9e0\") "
Sep 11 21:42:11.834373 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.834337    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81963b3d-73c3-4f01-b47d-c114b00af9e0-plugins-config-volume\") pod \"81963b3d-73c3-4f01-b47d-c114b00af9e0\" (UID: \"81963b3d-73c3-4f01-b47d-c114b00af9e0\") "
Sep 11 21:42:11.834479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.834463    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-plugins-config-volume\") pod \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\" (UID: \"2a6b21fb-da6b-4f25-9dd9-58ec5756e9df\") "
Sep 11 21:42:11.834786 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.834764    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81963b3d-73c3-4f01-b47d-c114b00af9e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "81963b3d-73c3-4f01-b47d-c114b00af9e0" (UID: "81963b3d-73c3-4f01-b47d-c114b00af9e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:11.834897 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.834778    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2a6b21fb-da6b-4f25-9dd9-58ec5756e9df" (UID: "2a6b21fb-da6b-4f25-9dd9-58ec5756e9df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:11.834940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.834915    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81963b3d-73c3-4f01-b47d-c114b00af9e0-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:11.834940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.834929    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:11.836587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.836566    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81963b3d-73c3-4f01-b47d-c114b00af9e0-kube-api-access-zqd5m" (OuterVolumeSpecName: "kube-api-access-zqd5m") pod "81963b3d-73c3-4f01-b47d-c114b00af9e0" (UID: "81963b3d-73c3-4f01-b47d-c114b00af9e0"). InnerVolumeSpecName "kube-api-access-zqd5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:11.836797 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.836778    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-kube-api-access-7xltq" (OuterVolumeSpecName: "kube-api-access-7xltq") pod "2a6b21fb-da6b-4f25-9dd9-58ec5756e9df" (UID: "2a6b21fb-da6b-4f25-9dd9-58ec5756e9df"). InnerVolumeSpecName "kube-api-access-7xltq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:11.936145 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.936041    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xltq\" (UniqueName: \"kubernetes.io/projected/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df-kube-api-access-7xltq\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:11.936145 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:11.936075    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqd5m\" (UniqueName: \"kubernetes.io/projected/81963b3d-73c3-4f01-b47d-c114b00af9e0-kube-api-access-zqd5m\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:12.138164 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:12.138114    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"]
Sep 11 21:42:12.141023 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:12.140999    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4"]
Sep 11 21:42:12.151104 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:12.151072    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"]
Sep 11 21:42:12.155750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:12.155724    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn"]
Sep 11 21:42:12.802758 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:12.802683    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a6b21fb-da6b-4f25-9dd9-58ec5756e9df" path="/var/lib/kubelet/pods/2a6b21fb-da6b-4f25-9dd9-58ec5756e9df/volumes"
Sep 11 21:42:12.803150 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:12.803078    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81963b3d-73c3-4f01-b47d-c114b00af9e0" path="/var/lib/kubelet/pods/81963b3d-73c3-4f01-b47d-c114b00af9e0/volumes"
Sep 11 21:42:12.803364 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:12.803351    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6ab17cc-9713-45e5-9921-94775fd224a4" path="/var/lib/kubelet/pods/a6ab17cc-9713-45e5-9921-94775fd224a4/volumes"
Sep 11 21:42:13.125163 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:13.125122    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"]
Sep 11 21:42:13.125438 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:13.125372    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy" containerID="cri-o://e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d" gracePeriod=30
Sep 11 21:42:18.389320 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.389288    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:42:18.403712 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403623    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-data\") pod \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") "
Sep 11 21:42:18.403712 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403660    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-podinfo\") pod \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") "
Sep 11 21:42:18.403712 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-credential-socket\") pod \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") "
Sep 11 21:42:18.404017 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403765    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-envoy\") pod \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") "
Sep 11 21:42:18.404017 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403789    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h85z\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-kube-api-access-4h85z\") pod \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") "
Sep 11 21:42:18.404017 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403838    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-socket\") pod \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") "
Sep 11 21:42:18.404017 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403869    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-token\") pod \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") "
Sep 11 21:42:18.404017 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403917    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" (UID: "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:18.404017 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403955    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istiod-ca-cert\") pod \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") "
Sep 11 21:42:18.404017 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.403971    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-certs\") pod \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\" (UID: \"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0\") "
Sep 11 21:42:18.404372 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.404154    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" (UID: "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:18.404372 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.404328    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:18.404372 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.404350    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:18.404372 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.404356    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" (UID: "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:18.404923 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.404383    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" (UID: "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:18.404923 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.404409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" (UID: "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:18.406203 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.406176    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" (UID: "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:18.406405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.406376    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" (UID: "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:18.406503 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.406420    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" (UID: "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:42:18.406503 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.406443    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-kube-api-access-4h85z" (OuterVolumeSpecName: "kube-api-access-4h85z") pod "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" (UID: "dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0"). InnerVolumeSpecName "kube-api-access-4h85z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:18.505513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.505469    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:18.505513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.505502    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:18.505513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.505511    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:18.505513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.505518    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:18.505791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.505528    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:18.505791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.505538    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h85z\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-kube-api-access-4h85z\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:18.505791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.505547    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:18.549455 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.549411    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"]
Sep 11 21:42:18.549936 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.549911    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6ab17cc-9713-45e5-9921-94775fd224a4" containerName="revoke-keys"
Sep 11 21:42:18.550049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.549938    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6ab17cc-9713-45e5-9921-94775fd224a4" containerName="revoke-keys"
Sep 11 21:42:18.550049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.549954    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy"
Sep 11 21:42:18.550049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.549962    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy"
Sep 11 21:42:18.550049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.549991    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="088b6dcb-6b88-450e-86fd-64d84a526273" containerName="payload-processing"
Sep 11 21:42:18.550049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550000    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="088b6dcb-6b88-450e-86fd-64d84a526273" containerName="payload-processing"
Sep 11 21:42:18.550049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550015    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy"
Sep 11 21:42:18.550049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550022    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy"
Sep 11 21:42:18.550049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550032    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88bde9df-56d4-488f-9ac3-dc80cb611ac9" containerName="payload-pre-processing"
Sep 11 21:42:18.550049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550041    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88bde9df-56d4-488f-9ac3-dc80cb611ac9" containerName="payload-pre-processing"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550053    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81963b3d-73c3-4f01-b47d-c114b00af9e0" containerName="payload-pre-processing"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550061    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="81963b3d-73c3-4f01-b47d-c114b00af9e0" containerName="payload-pre-processing"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550078    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a6b21fb-da6b-4f25-9dd9-58ec5756e9df" containerName="payload-processing"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550087    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a6b21fb-da6b-4f25-9dd9-58ec5756e9df" containerName="payload-processing"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550186    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550197    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="088b6dcb-6b88-450e-86fd-64d84a526273" containerName="payload-processing"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550209    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="88bde9df-56d4-488f-9ac3-dc80cb611ac9" containerName="payload-pre-processing"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550222    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="81963b3d-73c3-4f01-b47d-c114b00af9e0" containerName="payload-pre-processing"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550231    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerName="istio-proxy"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550240    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a6b21fb-da6b-4f25-9dd9-58ec5756e9df" containerName="payload-processing"
Sep 11 21:42:18.550481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.550248    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6ab17cc-9713-45e5-9921-94775fd224a4" containerName="revoke-keys"
Sep 11 21:42:18.562076 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.562035    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"]
Sep 11 21:42:18.562232 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.562133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"
Sep 11 21:42:18.564497 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.564471    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:42:18.564877 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.564855    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:42:18.606952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.606919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/661140ee-d5ca-40b6-80dd-ae76ffbd755d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj\" (UID: \"661140ee-d5ca-40b6-80dd-ae76ffbd755d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"
Sep 11 21:42:18.708147 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.708052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/661140ee-d5ca-40b6-80dd-ae76ffbd755d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj\" (UID: \"661140ee-d5ca-40b6-80dd-ae76ffbd755d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"
Sep 11 21:42:18.708670 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.708650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/661140ee-d5ca-40b6-80dd-ae76ffbd755d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj\" (UID: \"661140ee-d5ca-40b6-80dd-ae76ffbd755d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"
Sep 11 21:42:18.855639 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.855600    2560 generic.go:356] "Generic (PLEG): container finished" podID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" containerID="e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d" exitCode=0
Sep 11 21:42:18.855847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.855673    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"
Sep 11 21:42:18.855847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.855680    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" event={"ID":"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0","Type":"ContainerDied","Data":"e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d"}
Sep 11 21:42:18.855847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.855738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd" event={"ID":"dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0","Type":"ContainerDied","Data":"9b18411ff63b5919b019aaf47a45371c2729a27b9fd4e9cbbd67da4bfb8d7339"}
Sep 11 21:42:18.855847 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.855761    2560 scope.go:117] "RemoveContainer" containerID="e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d"
Sep 11 21:42:18.865438 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.865421    2560 scope.go:117] "RemoveContainer" containerID="9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5"
Sep 11 21:42:18.872441 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.872411    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"]
Sep 11 21:42:18.874616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.874601    2560 scope.go:117] "RemoveContainer" containerID="e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d"
Sep 11 21:42:18.874709 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.874691    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"
Sep 11 21:42:18.874969 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:18.874950    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d\": container with ID starting with e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d not found: ID does not exist" containerID="e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d"
Sep 11 21:42:18.875065 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.874976    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d"} err="failed to get container status \"e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d\": rpc error: code = NotFound desc = could not find container \"e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d\": container with ID starting with e79d2155e786115367f1f09f6ebc67afd000a37e679cdda66dd0a4e5d469862d not found: ID does not exist"
Sep 11 21:42:18.875065 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.874992    2560 scope.go:117] "RemoveContainer" containerID="9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5"
Sep 11 21:42:18.875287 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:18.875266    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5\": container with ID starting with 9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5 not found: ID does not exist" containerID="9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5"
Sep 11 21:42:18.875355 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.875294    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5"} err="failed to get container status \"9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5\": rpc error: code = NotFound desc = could not find container \"9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5\": container with ID starting with 9f6975e3671ec3cdfcd8ff2ec0955f3a12acbd70e159ee83f96b169e40a3deb5 not found: ID does not exist"
Sep 11 21:42:18.878612 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:18.878589    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd"]
Sep 11 21:42:19.152388 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:19.152346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"]
Sep 11 21:42:19.152930 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:42:19.152903    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod661140ee_d5ca_40b6_80dd_ae76ffbd755d.slice/crio-80c53be9f8d1b147c812c29fa10137374de995523c83adf7af8b0ffa5621afc0 WatchSource:0}: Error finding container 80c53be9f8d1b147c812c29fa10137374de995523c83adf7af8b0ffa5621afc0: Status 404 returned error can't find the container with id 80c53be9f8d1b147c812c29fa10137374de995523c83adf7af8b0ffa5621afc0
Sep 11 21:42:19.863559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:19.863523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj" event={"ID":"661140ee-d5ca-40b6-80dd-ae76ffbd755d","Type":"ContainerStarted","Data":"f8b03628d7d727c1644c61fb190313892060c4dc6b9d370a1d5d0e5bab36d1e8"}
Sep 11 21:42:19.863559 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:19.863577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj" event={"ID":"661140ee-d5ca-40b6-80dd-ae76ffbd755d","Type":"ContainerStarted","Data":"80c53be9f8d1b147c812c29fa10137374de995523c83adf7af8b0ffa5621afc0"}
Sep 11 21:42:19.878181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:19.878118    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj" podStartSLOduration=1.878097693 podStartE2EDuration="1.878097693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:42:19.877664742 +0000 UTC m=+1497.590324782" watchObservedRunningTime="2026-09-11 21:42:19.878097693 +0000 UTC m=+1497.590757743"
Sep 11 21:42:20.801876 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:20.801815    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0" path="/var/lib/kubelet/pods/dfc8a6d7-e220-47c1-a03c-bcf84e14e9c0/volumes"
Sep 11 21:42:20.871851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:20.871802    2560 generic.go:356] "Generic (PLEG): container finished" podID="661140ee-d5ca-40b6-80dd-ae76ffbd755d" containerID="f8b03628d7d727c1644c61fb190313892060c4dc6b9d370a1d5d0e5bab36d1e8" exitCode=0
Sep 11 21:42:20.872234 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:20.871868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj" event={"ID":"661140ee-d5ca-40b6-80dd-ae76ffbd755d","Type":"ContainerDied","Data":"f8b03628d7d727c1644c61fb190313892060c4dc6b9d370a1d5d0e5bab36d1e8"}
Sep 11 21:42:22.022100 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:22.022071    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"
Sep 11 21:42:22.043771 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:22.043739    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/661140ee-d5ca-40b6-80dd-ae76ffbd755d-maas-api-service-ca\") pod \"661140ee-d5ca-40b6-80dd-ae76ffbd755d\" (UID: \"661140ee-d5ca-40b6-80dd-ae76ffbd755d\") "
Sep 11 21:42:22.044166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:22.044129    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/661140ee-d5ca-40b6-80dd-ae76ffbd755d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "661140ee-d5ca-40b6-80dd-ae76ffbd755d" (UID: "661140ee-d5ca-40b6-80dd-ae76ffbd755d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:22.144985 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:22.144895    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/661140ee-d5ca-40b6-80dd-ae76ffbd755d-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:22.884713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:22.884678    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"
Sep 11 21:42:22.884924 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:22.884715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj" event={"ID":"661140ee-d5ca-40b6-80dd-ae76ffbd755d","Type":"ContainerDied","Data":"80c53be9f8d1b147c812c29fa10137374de995523c83adf7af8b0ffa5621afc0"}
Sep 11 21:42:22.884924 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:22.884774    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80c53be9f8d1b147c812c29fa10137374de995523c83adf7af8b0ffa5621afc0"
Sep 11 21:42:23.043656 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:23.043629    2560 scope.go:117] "RemoveContainer" containerID="00ab4bdc635da8a991b8d24f7aba2a7a4ec88d35011ae6614c8035782db21593"
Sep 11 21:42:29.165851 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.165799    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"]
Sep 11 21:42:29.166628 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.166054    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47" podUID="a8fbb889-6b7d-43f0-be88-2d59db9da3c9" containerName="payload-processing" containerID="cri-o://17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242" gracePeriod=30
Sep 11 21:42:29.169804 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.169779    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"]
Sep 11 21:42:29.170041 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.170016    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd" podUID="b7745d1e-9d1c-48e0-ad9c-a921141d6861" containerName="payload-pre-processing" containerID="cri-o://f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f" gracePeriod=30
Sep 11 21:42:29.340709 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.340651    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"]
Sep 11 21:42:29.343191 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.343163    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad5be0-g8fnj"]
Sep 11 21:42:29.470058 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.470035    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:42:29.473066 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.473048    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:42:29.526580 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.526512    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5lpr\" (UniqueName: \"kubernetes.io/projected/b7745d1e-9d1c-48e0-ad9c-a921141d6861-kube-api-access-x5lpr\") pod \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\" (UID: \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\") "
Sep 11 21:42:29.526799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.526589    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7745d1e-9d1c-48e0-ad9c-a921141d6861-plugins-config-volume\") pod \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\" (UID: \"b7745d1e-9d1c-48e0-ad9c-a921141d6861\") "
Sep 11 21:42:29.526799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.526677    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-plugins-config-volume\") pod \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\" (UID: \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\") "
Sep 11 21:42:29.526799 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.526756    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spxgx\" (UniqueName: \"kubernetes.io/projected/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-kube-api-access-spxgx\") pod \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\" (UID: \"a8fbb889-6b7d-43f0-be88-2d59db9da3c9\") "
Sep 11 21:42:29.527512 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.527463    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7745d1e-9d1c-48e0-ad9c-a921141d6861-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7745d1e-9d1c-48e0-ad9c-a921141d6861" (UID: "b7745d1e-9d1c-48e0-ad9c-a921141d6861"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:29.527741 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.527708    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a8fbb889-6b7d-43f0-be88-2d59db9da3c9" (UID: "a8fbb889-6b7d-43f0-be88-2d59db9da3c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:29.530143 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.530102    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-kube-api-access-spxgx" (OuterVolumeSpecName: "kube-api-access-spxgx") pod "a8fbb889-6b7d-43f0-be88-2d59db9da3c9" (UID: "a8fbb889-6b7d-43f0-be88-2d59db9da3c9"). InnerVolumeSpecName "kube-api-access-spxgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:29.530803 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.530771    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7745d1e-9d1c-48e0-ad9c-a921141d6861-kube-api-access-x5lpr" (OuterVolumeSpecName: "kube-api-access-x5lpr") pod "b7745d1e-9d1c-48e0-ad9c-a921141d6861" (UID: "b7745d1e-9d1c-48e0-ad9c-a921141d6861"). InnerVolumeSpecName "kube-api-access-x5lpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:29.628187 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.628152    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5lpr\" (UniqueName: \"kubernetes.io/projected/b7745d1e-9d1c-48e0-ad9c-a921141d6861-kube-api-access-x5lpr\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:29.628187 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.628184    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7745d1e-9d1c-48e0-ad9c-a921141d6861-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:29.628187 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.628194    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:29.628459 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.628202    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spxgx\" (UniqueName: \"kubernetes.io/projected/a8fbb889-6b7d-43f0-be88-2d59db9da3c9-kube-api-access-spxgx\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:29.924506 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.924473    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8fbb889-6b7d-43f0-be88-2d59db9da3c9" containerID="17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242" exitCode=0
Sep 11 21:42:29.924720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.924516    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"
Sep 11 21:42:29.924720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.924564    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47" event={"ID":"a8fbb889-6b7d-43f0-be88-2d59db9da3c9","Type":"ContainerDied","Data":"17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242"}
Sep 11 21:42:29.924720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.924620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47" event={"ID":"a8fbb889-6b7d-43f0-be88-2d59db9da3c9","Type":"ContainerDied","Data":"a2f32814f70435f8463a4cac3d6d6f95760067f22a8039d9c1bfdcc22221bd70"}
Sep 11 21:42:29.924720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.924647    2560 scope.go:117] "RemoveContainer" containerID="17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242"
Sep 11 21:42:29.926078 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.926053    2560 generic.go:356] "Generic (PLEG): container finished" podID="b7745d1e-9d1c-48e0-ad9c-a921141d6861" containerID="f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f" exitCode=0
Sep 11 21:42:29.926205 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.926091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd" event={"ID":"b7745d1e-9d1c-48e0-ad9c-a921141d6861","Type":"ContainerDied","Data":"f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f"}
Sep 11 21:42:29.926205 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.926105    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"
Sep 11 21:42:29.926205 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.926145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd" event={"ID":"b7745d1e-9d1c-48e0-ad9c-a921141d6861","Type":"ContainerDied","Data":"27c04c1519ab3dbd99ce51cff4947db57c65e6bd2e9c40d5b8d904bd9f58d349"}
Sep 11 21:42:29.936329 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.936260    2560 scope.go:117] "RemoveContainer" containerID="17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242"
Sep 11 21:42:29.936674 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:29.936647    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242\": container with ID starting with 17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242 not found: ID does not exist" containerID="17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242"
Sep 11 21:42:29.936770 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.936680    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242"} err="failed to get container status \"17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242\": rpc error: code = NotFound desc = could not find container \"17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242\": container with ID starting with 17a055e20b0fff2837d69fc231c5af0aae8070d78f947c9e4f910a9c78d4c242 not found: ID does not exist"
Sep 11 21:42:29.936770 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.936701    2560 scope.go:117] "RemoveContainer" containerID="f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f"
Sep 11 21:42:29.946355 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.946333    2560 scope.go:117] "RemoveContainer" containerID="f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f"
Sep 11 21:42:29.946690 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:29.946668    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f\": container with ID starting with f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f not found: ID does not exist" containerID="f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f"
Sep 11 21:42:29.946764 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.946699    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f"} err="failed to get container status \"f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f\": rpc error: code = NotFound desc = could not find container \"f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f\": container with ID starting with f71afe8577486568fd15f7d1a54b6183870622e5f330240fc99d584a5b547c6f not found: ID does not exist"
Sep 11 21:42:29.947920 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.947897    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"]
Sep 11 21:42:29.951385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.951354    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47"]
Sep 11 21:42:29.961385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.961361    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"]
Sep 11 21:42:29.963350 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:29.963330    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd"]
Sep 11 21:42:30.154344 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154303    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"]
Sep 11 21:42:30.154713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154701    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fbb889-6b7d-43f0-be88-2d59db9da3c9" containerName="payload-processing"
Sep 11 21:42:30.154767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154715    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fbb889-6b7d-43f0-be88-2d59db9da3c9" containerName="payload-processing"
Sep 11 21:42:30.154767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154750    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="661140ee-d5ca-40b6-80dd-ae76ffbd755d" containerName="revoke-keys"
Sep 11 21:42:30.154767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154756    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="661140ee-d5ca-40b6-80dd-ae76ffbd755d" containerName="revoke-keys"
Sep 11 21:42:30.154767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154765    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7745d1e-9d1c-48e0-ad9c-a921141d6861" containerName="payload-pre-processing"
Sep 11 21:42:30.154951 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154773    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7745d1e-9d1c-48e0-ad9c-a921141d6861" containerName="payload-pre-processing"
Sep 11 21:42:30.154951 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154860    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8fbb889-6b7d-43f0-be88-2d59db9da3c9" containerName="payload-processing"
Sep 11 21:42:30.154951 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154873    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7745d1e-9d1c-48e0-ad9c-a921141d6861" containerName="payload-pre-processing"
Sep 11 21:42:30.154951 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.154882    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="661140ee-d5ca-40b6-80dd-ae76ffbd755d" containerName="revoke-keys"
Sep 11 21:42:30.157951 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.157916    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"
Sep 11 21:42:30.160449 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.160424    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:42:30.160574 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.160424    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:42:30.167230 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.167200    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"]
Sep 11 21:42:30.233954 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.233910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0325f83f-1123-45fa-b165-eab5678ad779-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6\" (UID: \"0325f83f-1123-45fa-b165-eab5678ad779\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"
Sep 11 21:42:30.334516 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.334479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0325f83f-1123-45fa-b165-eab5678ad779-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6\" (UID: \"0325f83f-1123-45fa-b165-eab5678ad779\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"
Sep 11 21:42:30.335212 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.335190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0325f83f-1123-45fa-b165-eab5678ad779-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6\" (UID: \"0325f83f-1123-45fa-b165-eab5678ad779\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"
Sep 11 21:42:30.470259 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.470161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"
Sep 11 21:42:30.760705 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.760678    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"]
Sep 11 21:42:30.762942 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:42:30.762916    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0325f83f_1123_45fa_b165_eab5678ad779.slice/crio-41c278889acd1042253ff25cb671dd5a9959e28ed8fe66176e3f712b190ff7af WatchSource:0}: Error finding container 41c278889acd1042253ff25cb671dd5a9959e28ed8fe66176e3f712b190ff7af: Status 404 returned error can't find the container with id 41c278889acd1042253ff25cb671dd5a9959e28ed8fe66176e3f712b190ff7af
Sep 11 21:42:30.808405 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.808374    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="661140ee-d5ca-40b6-80dd-ae76ffbd755d" path="/var/lib/kubelet/pods/661140ee-d5ca-40b6-80dd-ae76ffbd755d/volumes"
Sep 11 21:42:30.808748 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.808735    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8fbb889-6b7d-43f0-be88-2d59db9da3c9" path="/var/lib/kubelet/pods/a8fbb889-6b7d-43f0-be88-2d59db9da3c9/volumes"
Sep 11 21:42:30.809086 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.809072    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7745d1e-9d1c-48e0-ad9c-a921141d6861" path="/var/lib/kubelet/pods/b7745d1e-9d1c-48e0-ad9c-a921141d6861/volumes"
Sep 11 21:42:30.935052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:30.935011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6" event={"ID":"0325f83f-1123-45fa-b165-eab5678ad779","Type":"ContainerStarted","Data":"41c278889acd1042253ff25cb671dd5a9959e28ed8fe66176e3f712b190ff7af"}
Sep 11 21:42:31.941413 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:31.941373    2560 generic.go:356] "Generic (PLEG): container finished" podID="0325f83f-1123-45fa-b165-eab5678ad779" containerID="5191ed8c84a322788e35b4a018c02418e56d412fef47df83552ae93a5ce46f3e" exitCode=0
Sep 11 21:42:31.941793 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:31.941458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6" event={"ID":"0325f83f-1123-45fa-b165-eab5678ad779","Type":"ContainerDied","Data":"5191ed8c84a322788e35b4a018c02418e56d412fef47df83552ae93a5ce46f3e"}
Sep 11 21:42:33.086711 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:33.086682    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"
Sep 11 21:42:33.162818 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:33.162791    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0325f83f-1123-45fa-b165-eab5678ad779-maas-api-service-ca\") pod \"0325f83f-1123-45fa-b165-eab5678ad779\" (UID: \"0325f83f-1123-45fa-b165-eab5678ad779\") "
Sep 11 21:42:33.163152 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:33.163132    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0325f83f-1123-45fa-b165-eab5678ad779-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0325f83f-1123-45fa-b165-eab5678ad779" (UID: "0325f83f-1123-45fa-b165-eab5678ad779"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:33.264164 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:33.264083    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0325f83f-1123-45fa-b165-eab5678ad779-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:33.952983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:33.952952    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"
Sep 11 21:42:33.953139 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:33.952946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6" event={"ID":"0325f83f-1123-45fa-b165-eab5678ad779","Type":"ContainerDied","Data":"41c278889acd1042253ff25cb671dd5a9959e28ed8fe66176e3f712b190ff7af"}
Sep 11 21:42:33.953139 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:33.953084    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41c278889acd1042253ff25cb671dd5a9959e28ed8fe66176e3f712b190ff7af"
Sep 11 21:42:36.306693 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.306656    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"]
Sep 11 21:42:36.307210 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.306885    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy" containerID="cri-o://3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca" gracePeriod=30
Sep 11 21:42:36.645157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.645115    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"]
Sep 11 21:42:36.645564 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.645550    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0325f83f-1123-45fa-b165-eab5678ad779" containerName="revoke-keys"
Sep 11 21:42:36.645611 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.645565    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0325f83f-1123-45fa-b165-eab5678ad779" containerName="revoke-keys"
Sep 11 21:42:36.645646 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.645637    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0325f83f-1123-45fa-b165-eab5678ad779" containerName="revoke-keys"
Sep 11 21:42:36.648973 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.648955    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"
Sep 11 21:42:36.651489 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.651462    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:42:36.651616 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.651492    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:42:36.657452 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.657428    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"]
Sep 11 21:42:36.802580 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.802548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42d0b453-4781-4a42-9bad-e4db1f676ffa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6\" (UID: \"42d0b453-4781-4a42-9bad-e4db1f676ffa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"
Sep 11 21:42:36.903459 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.903366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42d0b453-4781-4a42-9bad-e4db1f676ffa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6\" (UID: \"42d0b453-4781-4a42-9bad-e4db1f676ffa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"
Sep 11 21:42:36.904078 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.904057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42d0b453-4781-4a42-9bad-e4db1f676ffa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6\" (UID: \"42d0b453-4781-4a42-9bad-e4db1f676ffa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"
Sep 11 21:42:36.962929 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:36.962893    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"
Sep 11 21:42:37.242607 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:37.242581    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"]
Sep 11 21:42:37.244934 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:42:37.244903    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d0b453_4781_4a42_9bad_e4db1f676ffa.slice/crio-5c8131d9d633524af3f3803f544dc9221bb7045fca72e9e30062a79ab976b6e8 WatchSource:0}: Error finding container 5c8131d9d633524af3f3803f544dc9221bb7045fca72e9e30062a79ab976b6e8: Status 404 returned error can't find the container with id 5c8131d9d633524af3f3803f544dc9221bb7045fca72e9e30062a79ab976b6e8
Sep 11 21:42:37.976210 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:37.976175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6" event={"ID":"42d0b453-4781-4a42-9bad-e4db1f676ffa","Type":"ContainerStarted","Data":"cab1012ca42620d52ad8d0ab0949ad93b3d9570957a4113d4b1681fe79f4aeeb"}
Sep 11 21:42:37.976623 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:37.976231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6" event={"ID":"42d0b453-4781-4a42-9bad-e4db1f676ffa","Type":"ContainerStarted","Data":"5c8131d9d633524af3f3803f544dc9221bb7045fca72e9e30062a79ab976b6e8"}
Sep 11 21:42:37.993232 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:37.993185    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6" podStartSLOduration=1.993168479 podStartE2EDuration="1.993168479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:42:37.992244819 +0000 UTC m=+1515.704904868" watchObservedRunningTime="2026-09-11 21:42:37.993168479 +0000 UTC m=+1515.705828528"
Sep 11 21:42:38.982765 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:38.982730    2560 generic.go:356] "Generic (PLEG): container finished" podID="42d0b453-4781-4a42-9bad-e4db1f676ffa" containerID="cab1012ca42620d52ad8d0ab0949ad93b3d9570957a4113d4b1681fe79f4aeeb" exitCode=0
Sep 11 21:42:38.983188 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:38.982807    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6" event={"ID":"42d0b453-4781-4a42-9bad-e4db1f676ffa","Type":"ContainerDied","Data":"cab1012ca42620d52ad8d0ab0949ad93b3d9570957a4113d4b1681fe79f4aeeb"}
Sep 11 21:42:40.151777 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:40.151752    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"
Sep 11 21:42:40.238642 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:40.238541    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42d0b453-4781-4a42-9bad-e4db1f676ffa-maas-api-service-ca\") pod \"42d0b453-4781-4a42-9bad-e4db1f676ffa\" (UID: \"42d0b453-4781-4a42-9bad-e4db1f676ffa\") "
Sep 11 21:42:40.239012 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:40.238991    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42d0b453-4781-4a42-9bad-e4db1f676ffa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42d0b453-4781-4a42-9bad-e4db1f676ffa" (UID: "42d0b453-4781-4a42-9bad-e4db1f676ffa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:40.340232 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:40.340194    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42d0b453-4781-4a42-9bad-e4db1f676ffa-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:40.994309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:40.994282    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"
Sep 11 21:42:40.994491 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:40.994281    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6" event={"ID":"42d0b453-4781-4a42-9bad-e4db1f676ffa","Type":"ContainerDied","Data":"5c8131d9d633524af3f3803f544dc9221bb7045fca72e9e30062a79ab976b6e8"}
Sep 11 21:42:40.994491 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:40.994403    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c8131d9d633524af3f3803f544dc9221bb7045fca72e9e30062a79ab976b6e8"
Sep 11 21:42:41.573231 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.573153    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:42:41.654986 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.654949    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-certs\") pod \"0e4938ca-3311-42f8-a34c-18e20118f893\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") "
Sep 11 21:42:41.655166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655018    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-credential-socket\") pod \"0e4938ca-3311-42f8-a34c-18e20118f893\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") "
Sep 11 21:42:41.655166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655051    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-envoy\") pod \"0e4938ca-3311-42f8-a34c-18e20118f893\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") "
Sep 11 21:42:41.655166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655072    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4938ca-3311-42f8-a34c-18e20118f893-istiod-ca-cert\") pod \"0e4938ca-3311-42f8-a34c-18e20118f893\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") "
Sep 11 21:42:41.655166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655102    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-data\") pod \"0e4938ca-3311-42f8-a34c-18e20118f893\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") "
Sep 11 21:42:41.655391 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4938ca-3311-42f8-a34c-18e20118f893-istio-podinfo\") pod \"0e4938ca-3311-42f8-a34c-18e20118f893\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") "
Sep 11 21:42:41.655391 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655201    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-istio-token\") pod \"0e4938ca-3311-42f8-a34c-18e20118f893\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") "
Sep 11 21:42:41.655391 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655236    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn9nk\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-kube-api-access-kn9nk\") pod \"0e4938ca-3311-42f8-a34c-18e20118f893\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") "
Sep 11 21:42:41.655391 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655263    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-socket\") pod \"0e4938ca-3311-42f8-a34c-18e20118f893\" (UID: \"0e4938ca-3311-42f8-a34c-18e20118f893\") "
Sep 11 21:42:41.655391 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655312    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e4938ca-3311-42f8-a34c-18e20118f893" (UID: "0e4938ca-3311-42f8-a34c-18e20118f893"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:41.655687 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655388    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e4938ca-3311-42f8-a34c-18e20118f893" (UID: "0e4938ca-3311-42f8-a34c-18e20118f893"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:41.655687 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e4938ca-3311-42f8-a34c-18e20118f893" (UID: "0e4938ca-3311-42f8-a34c-18e20118f893"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:41.655687 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655655    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4938ca-3311-42f8-a34c-18e20118f893-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e4938ca-3311-42f8-a34c-18e20118f893" (UID: "0e4938ca-3311-42f8-a34c-18e20118f893"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:41.655876 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655746    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:41.655876 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655767    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:41.655876 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655769    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e4938ca-3311-42f8-a34c-18e20118f893" (UID: "0e4938ca-3311-42f8-a34c-18e20118f893"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:41.655876 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.655782    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:41.657623 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.657601    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-kube-api-access-kn9nk" (OuterVolumeSpecName: "kube-api-access-kn9nk") pod "0e4938ca-3311-42f8-a34c-18e20118f893" (UID: "0e4938ca-3311-42f8-a34c-18e20118f893"). InnerVolumeSpecName "kube-api-access-kn9nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:41.657739 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.657713    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e4938ca-3311-42f8-a34c-18e20118f893" (UID: "0e4938ca-3311-42f8-a34c-18e20118f893"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:41.658038 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.658017    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e4938ca-3311-42f8-a34c-18e20118f893-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e4938ca-3311-42f8-a34c-18e20118f893" (UID: "0e4938ca-3311-42f8-a34c-18e20118f893"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:42:41.658136 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.658035    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e4938ca-3311-42f8-a34c-18e20118f893" (UID: "0e4938ca-3311-42f8-a34c-18e20118f893"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:41.756948 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.756905    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:41.756948 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.756939    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e4938ca-3311-42f8-a34c-18e20118f893-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:41.756948 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.756949    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e4938ca-3311-42f8-a34c-18e20118f893-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:41.756948 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.756957    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e4938ca-3311-42f8-a34c-18e20118f893-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:41.757216 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.756967    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:41.757216 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:41.756975    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn9nk\" (UniqueName: \"kubernetes.io/projected/0e4938ca-3311-42f8-a34c-18e20118f893-kube-api-access-kn9nk\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:42.001678 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.001586    2560 generic.go:356] "Generic (PLEG): container finished" podID="0e4938ca-3311-42f8-a34c-18e20118f893" containerID="3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca" exitCode=0
Sep 11 21:42:42.001678 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.001633    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"
Sep 11 21:42:42.001932 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.001674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" event={"ID":"0e4938ca-3311-42f8-a34c-18e20118f893","Type":"ContainerDied","Data":"3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca"}
Sep 11 21:42:42.001932 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.001735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997" event={"ID":"0e4938ca-3311-42f8-a34c-18e20118f893","Type":"ContainerDied","Data":"d5f3dce3154eb7f312c657fab2faa94aba145ff1de66e3658331d26839b5ac16"}
Sep 11 21:42:42.001932 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.001758    2560 scope.go:117] "RemoveContainer" containerID="3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca"
Sep 11 21:42:42.011565 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.011547    2560 scope.go:117] "RemoveContainer" containerID="4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802"
Sep 11 21:42:42.020401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.020380    2560 scope.go:117] "RemoveContainer" containerID="3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca"
Sep 11 21:42:42.021180 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:42.020920    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca\": container with ID starting with 3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca not found: ID does not exist" containerID="3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca"
Sep 11 21:42:42.021180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.020958    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca"} err="failed to get container status \"3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca\": rpc error: code = NotFound desc = could not find container \"3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca\": container with ID starting with 3463d4611a24a964e8399b51a047cd549fa2b57630206824784f23b288c168ca not found: ID does not exist"
Sep 11 21:42:42.021180 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.020982    2560 scope.go:117] "RemoveContainer" containerID="4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802"
Sep 11 21:42:42.021368 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:42.021338    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802\": container with ID starting with 4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802 not found: ID does not exist" containerID="4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802"
Sep 11 21:42:42.021408 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.021370    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802"} err="failed to get container status \"4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802\": rpc error: code = NotFound desc = could not find container \"4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802\": container with ID starting with 4ac991c417a544fd79942836e18ff0f6f7f9dea6a5f4cf50d1b8a5c16ec91802 not found: ID does not exist"
Sep 11 21:42:42.023301 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.023281    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"]
Sep 11 21:42:42.027550 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.027528    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997"]
Sep 11 21:42:42.801604 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:42.801571    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" path="/var/lib/kubelet/pods/0e4938ca-3311-42f8-a34c-18e20118f893/volumes"
Sep 11 21:42:46.456143 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.456056    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd"]
Sep 11 21:42:46.460054 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.460020    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-83ba87-29819370-76cmd"]
Sep 11 21:42:46.491935 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.491839    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"]
Sep 11 21:42:46.492181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.492122    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5" podUID="1f7f4ea1-e126-4582-bb0b-54c608a1d290" containerName="payload-processing" containerID="cri-o://1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13" gracePeriod=30
Sep 11 21:42:46.498507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.498465    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"]
Sep 11 21:42:46.498887 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.498810    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr" podUID="4ac91e27-7d6b-47be-9d6a-77b47044a61e" containerName="payload-pre-processing" containerID="cri-o://824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded" gracePeriod=30
Sep 11 21:42:46.683057 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.683001    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"]
Sep 11 21:42:46.696653 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.696467    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-83ba87-cwzz6"]
Sep 11 21:42:46.769801 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.769778    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:42:46.796044 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.796018    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:42:46.801468 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.801432    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0325f83f-1123-45fa-b165-eab5678ad779" path="/var/lib/kubelet/pods/0325f83f-1123-45fa-b165-eab5678ad779/volumes"
Sep 11 21:42:46.801741 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.801728    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7" path="/var/lib/kubelet/pods/aa0a3ac5-9904-4f11-8eb5-2722e3f1fbc7/volumes"
Sep 11 21:42:46.821201 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.821164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac91e27-7d6b-47be-9d6a-77b47044a61e-plugins-config-volume\") pod \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\" (UID: \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\") "
Sep 11 21:42:46.821386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.821268    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsqbg\" (UniqueName: \"kubernetes.io/projected/1f7f4ea1-e126-4582-bb0b-54c608a1d290-kube-api-access-nsqbg\") pod \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\" (UID: \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\") "
Sep 11 21:42:46.821386 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.821317    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgxn5\" (UniqueName: \"kubernetes.io/projected/4ac91e27-7d6b-47be-9d6a-77b47044a61e-kube-api-access-tgxn5\") pod \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\" (UID: \"4ac91e27-7d6b-47be-9d6a-77b47044a61e\") "
Sep 11 21:42:46.821545 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.821389    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f4ea1-e126-4582-bb0b-54c608a1d290-plugins-config-volume\") pod \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\" (UID: \"1f7f4ea1-e126-4582-bb0b-54c608a1d290\") "
Sep 11 21:42:46.822197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.822166    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f7f4ea1-e126-4582-bb0b-54c608a1d290-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f7f4ea1-e126-4582-bb0b-54c608a1d290" (UID: "1f7f4ea1-e126-4582-bb0b-54c608a1d290"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:46.822366 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.822171    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ac91e27-7d6b-47be-9d6a-77b47044a61e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ac91e27-7d6b-47be-9d6a-77b47044a61e" (UID: "4ac91e27-7d6b-47be-9d6a-77b47044a61e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:46.826141 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.826079    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7f4ea1-e126-4582-bb0b-54c608a1d290-kube-api-access-nsqbg" (OuterVolumeSpecName: "kube-api-access-nsqbg") pod "1f7f4ea1-e126-4582-bb0b-54c608a1d290" (UID: "1f7f4ea1-e126-4582-bb0b-54c608a1d290"). InnerVolumeSpecName "kube-api-access-nsqbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:46.827182 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.827158    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac91e27-7d6b-47be-9d6a-77b47044a61e-kube-api-access-tgxn5" (OuterVolumeSpecName: "kube-api-access-tgxn5") pod "4ac91e27-7d6b-47be-9d6a-77b47044a61e" (UID: "4ac91e27-7d6b-47be-9d6a-77b47044a61e"). InnerVolumeSpecName "kube-api-access-tgxn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:46.923190 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.923151    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f4ea1-e126-4582-bb0b-54c608a1d290-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:46.923190 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.923186    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac91e27-7d6b-47be-9d6a-77b47044a61e-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:46.923190 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.923195    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsqbg\" (UniqueName: \"kubernetes.io/projected/1f7f4ea1-e126-4582-bb0b-54c608a1d290-kube-api-access-nsqbg\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:46.923466 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:46.923206    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgxn5\" (UniqueName: \"kubernetes.io/projected/4ac91e27-7d6b-47be-9d6a-77b47044a61e-kube-api-access-tgxn5\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:47.030665 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.030578    2560 generic.go:356] "Generic (PLEG): container finished" podID="4ac91e27-7d6b-47be-9d6a-77b47044a61e" containerID="824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded" exitCode=0
Sep 11 21:42:47.030665 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.030617    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"
Sep 11 21:42:47.030912 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.030675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr" event={"ID":"4ac91e27-7d6b-47be-9d6a-77b47044a61e","Type":"ContainerDied","Data":"824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded"}
Sep 11 21:42:47.030912 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.030723    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr" event={"ID":"4ac91e27-7d6b-47be-9d6a-77b47044a61e","Type":"ContainerDied","Data":"c9e7ef2dad0a024de363b41911b9f4c09ab30f77ba68396c35387cfc2e5522a8"}
Sep 11 21:42:47.030912 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.030753    2560 scope.go:117] "RemoveContainer" containerID="824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded"
Sep 11 21:42:47.032166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.032137    2560 generic.go:356] "Generic (PLEG): container finished" podID="1f7f4ea1-e126-4582-bb0b-54c608a1d290" containerID="1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13" exitCode=0
Sep 11 21:42:47.032296 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.032187    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"
Sep 11 21:42:47.032296 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.032234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5" event={"ID":"1f7f4ea1-e126-4582-bb0b-54c608a1d290","Type":"ContainerDied","Data":"1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13"}
Sep 11 21:42:47.032296 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.032286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5" event={"ID":"1f7f4ea1-e126-4582-bb0b-54c608a1d290","Type":"ContainerDied","Data":"5f9370216ec25d8e89b33b7d156bc31cb0f11cb4b4f2bb262aeae68cff9a15ff"}
Sep 11 21:42:47.040233 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.040208    2560 scope.go:117] "RemoveContainer" containerID="824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded"
Sep 11 21:42:47.040627 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:47.040605    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded\": container with ID starting with 824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded not found: ID does not exist" containerID="824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded"
Sep 11 21:42:47.040720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.040636    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded"} err="failed to get container status \"824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded\": rpc error: code = NotFound desc = could not find container \"824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded\": container with ID starting with 824cd355982a46b681605ac1637ffbbe4c38803468e4eeb2e88c368f4e9b5ded not found: ID does not exist"
Sep 11 21:42:47.040720 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.040659    2560 scope.go:117] "RemoveContainer" containerID="1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13"
Sep 11 21:42:47.049553 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.049532    2560 scope.go:117] "RemoveContainer" containerID="1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13"
Sep 11 21:42:47.049910 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:47.049888    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13\": container with ID starting with 1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13 not found: ID does not exist" containerID="1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13"
Sep 11 21:42:47.049983 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.049928    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13"} err="failed to get container status \"1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13\": rpc error: code = NotFound desc = could not find container \"1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13\": container with ID starting with 1c52f0397fac74905983ee7dc1a4e9ca61fef00509b34f924ce052f2bcd4ce13 not found: ID does not exist"
Sep 11 21:42:47.066898 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.066866    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"]
Sep 11 21:42:47.076688 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.076658    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr"]
Sep 11 21:42:47.091233 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.091202    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"]
Sep 11 21:42:47.103439 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:47.103410    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5"]
Sep 11 21:42:48.801837 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:48.801787    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7f4ea1-e126-4582-bb0b-54c608a1d290" path="/var/lib/kubelet/pods/1f7f4ea1-e126-4582-bb0b-54c608a1d290/volumes"
Sep 11 21:42:48.802327 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:48.802237    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ac91e27-7d6b-47be-9d6a-77b47044a61e" path="/var/lib/kubelet/pods/4ac91e27-7d6b-47be-9d6a-77b47044a61e/volumes"
Sep 11 21:42:50.405422 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.405390    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"]
Sep 11 21:42:50.405933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.405652    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x" podUID="227af85e-1733-4033-a842-961d85eb22bc" containerName="payload-processing" containerID="cri-o://af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e" gracePeriod=30
Sep 11 21:42:50.413134 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.413104    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"]
Sep 11 21:42:50.413385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.413355    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln" podUID="b02f3448-0d05-4df9-aa98-3a8469799705" containerName="payload-pre-processing" containerID="cri-o://1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c" gracePeriod=30
Sep 11 21:42:50.590897 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.590559    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"]
Sep 11 21:42:50.593913 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.593887    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-408219-djbr6"]
Sep 11 21:42:50.698985 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.698954    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:42:50.706198 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.706176    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:42:50.761809 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.761773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/227af85e-1733-4033-a842-961d85eb22bc-plugins-config-volume\") pod \"227af85e-1733-4033-a842-961d85eb22bc\" (UID: \"227af85e-1733-4033-a842-961d85eb22bc\") "
Sep 11 21:42:50.762053 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.761859    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b02f3448-0d05-4df9-aa98-3a8469799705-plugins-config-volume\") pod \"b02f3448-0d05-4df9-aa98-3a8469799705\" (UID: \"b02f3448-0d05-4df9-aa98-3a8469799705\") "
Sep 11 21:42:50.762053 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.761929    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jhwh\" (UniqueName: \"kubernetes.io/projected/227af85e-1733-4033-a842-961d85eb22bc-kube-api-access-4jhwh\") pod \"227af85e-1733-4033-a842-961d85eb22bc\" (UID: \"227af85e-1733-4033-a842-961d85eb22bc\") "
Sep 11 21:42:50.762053 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.761963    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv4fc\" (UniqueName: \"kubernetes.io/projected/b02f3448-0d05-4df9-aa98-3a8469799705-kube-api-access-hv4fc\") pod \"b02f3448-0d05-4df9-aa98-3a8469799705\" (UID: \"b02f3448-0d05-4df9-aa98-3a8469799705\") "
Sep 11 21:42:50.762315 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.762272    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/227af85e-1733-4033-a842-961d85eb22bc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "227af85e-1733-4033-a842-961d85eb22bc" (UID: "227af85e-1733-4033-a842-961d85eb22bc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:50.762400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.762378    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/227af85e-1733-4033-a842-961d85eb22bc-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:50.762626 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.762600    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b02f3448-0d05-4df9-aa98-3a8469799705-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b02f3448-0d05-4df9-aa98-3a8469799705" (UID: "b02f3448-0d05-4df9-aa98-3a8469799705"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:50.765186 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.765001    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02f3448-0d05-4df9-aa98-3a8469799705-kube-api-access-hv4fc" (OuterVolumeSpecName: "kube-api-access-hv4fc") pod "b02f3448-0d05-4df9-aa98-3a8469799705" (UID: "b02f3448-0d05-4df9-aa98-3a8469799705"). InnerVolumeSpecName "kube-api-access-hv4fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:50.765448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.765375    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/227af85e-1733-4033-a842-961d85eb22bc-kube-api-access-4jhwh" (OuterVolumeSpecName: "kube-api-access-4jhwh") pod "227af85e-1733-4033-a842-961d85eb22bc" (UID: "227af85e-1733-4033-a842-961d85eb22bc"). InnerVolumeSpecName "kube-api-access-4jhwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:50.802116 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.802078    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42d0b453-4781-4a42-9bad-e4db1f676ffa" path="/var/lib/kubelet/pods/42d0b453-4781-4a42-9bad-e4db1f676ffa/volumes"
Sep 11 21:42:50.863732 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.863695    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b02f3448-0d05-4df9-aa98-3a8469799705-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:50.863732 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.863725    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jhwh\" (UniqueName: \"kubernetes.io/projected/227af85e-1733-4033-a842-961d85eb22bc-kube-api-access-4jhwh\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:50.863732 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:50.863735    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv4fc\" (UniqueName: \"kubernetes.io/projected/b02f3448-0d05-4df9-aa98-3a8469799705-kube-api-access-hv4fc\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:42:51.056836 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.056736    2560 generic.go:356] "Generic (PLEG): container finished" podID="b02f3448-0d05-4df9-aa98-3a8469799705" containerID="1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c" exitCode=0
Sep 11 21:42:51.056836 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.056786    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"
Sep 11 21:42:51.057086 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.056838    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln" event={"ID":"b02f3448-0d05-4df9-aa98-3a8469799705","Type":"ContainerDied","Data":"1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c"}
Sep 11 21:42:51.057086 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.056897    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln" event={"ID":"b02f3448-0d05-4df9-aa98-3a8469799705","Type":"ContainerDied","Data":"33f270b62dd91106da3c0eeb40c34f381319531bedae9444efda886519f89d12"}
Sep 11 21:42:51.057086 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.056927    2560 scope.go:117] "RemoveContainer" containerID="1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c"
Sep 11 21:42:51.058350 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.058322    2560 generic.go:356] "Generic (PLEG): container finished" podID="227af85e-1733-4033-a842-961d85eb22bc" containerID="af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e" exitCode=0
Sep 11 21:42:51.058458 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.058362    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"
Sep 11 21:42:51.058593 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.058481    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x" event={"ID":"227af85e-1733-4033-a842-961d85eb22bc","Type":"ContainerDied","Data":"af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e"}
Sep 11 21:42:51.058660 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.058623    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x" event={"ID":"227af85e-1733-4033-a842-961d85eb22bc","Type":"ContainerDied","Data":"260853a9317b3413972e40ce6dd3865409fd93b464ef9b2d2be3355216812d24"}
Sep 11 21:42:51.066030 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.065965    2560 scope.go:117] "RemoveContainer" containerID="1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c"
Sep 11 21:42:51.066284 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:51.066264    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c\": container with ID starting with 1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c not found: ID does not exist" containerID="1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c"
Sep 11 21:42:51.066389 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.066292    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c"} err="failed to get container status \"1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c\": rpc error: code = NotFound desc = could not find container \"1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c\": container with ID starting with 1b080bcbd59c967ba51f85cebfe2a6195487cf9ee0e04d29d72695301efcf32c not found: ID does not exist"
Sep 11 21:42:51.066389 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.066308    2560 scope.go:117] "RemoveContainer" containerID="af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e"
Sep 11 21:42:51.075196 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.075174    2560 scope.go:117] "RemoveContainer" containerID="af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e"
Sep 11 21:42:51.075559 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:42:51.075531    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e\": container with ID starting with af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e not found: ID does not exist" containerID="af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e"
Sep 11 21:42:51.075641 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.075570    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e"} err="failed to get container status \"af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e\": rpc error: code = NotFound desc = could not find container \"af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e\": container with ID starting with af770e86a826a20672690b471b2fee5b5c10e95906137d8b14cff53bc91b4c4e not found: ID does not exist"
Sep 11 21:42:51.076599 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.076579    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"]
Sep 11 21:42:51.080347 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.080324    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x"]
Sep 11 21:42:51.094869 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.093333    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"]
Sep 11 21:42:51.098804 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:51.098772    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln"]
Sep 11 21:42:52.801081 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:52.801042    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="227af85e-1733-4033-a842-961d85eb22bc" path="/var/lib/kubelet/pods/227af85e-1733-4033-a842-961d85eb22bc/volumes"
Sep 11 21:42:52.801479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:42:52.801463    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b02f3448-0d05-4df9-aa98-3a8469799705" path="/var/lib/kubelet/pods/b02f3448-0d05-4df9-aa98-3a8469799705/volumes"
Sep 11 21:43:23.091415 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:43:23.091375    2560 scope.go:117] "RemoveContainer" containerID="58fc079f83fbf9bf0926d676a03200d647a760323c05e940891fea8f75968736"
Sep 11 21:44:23.137320 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:44:23.137239    2560 scope.go:117] "RemoveContainer" containerID="d9606a873cc7ce6aa65dbd81ecfe5b53518ce191b88f45e395e1bd7b7e99abac"
Sep 11 21:45:00.129174 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129143    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g"]
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129486    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="227af85e-1733-4033-a842-961d85eb22bc" containerName="payload-processing"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129496    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="227af85e-1733-4033-a842-961d85eb22bc" containerName="payload-processing"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129514    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129519    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129528    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f7f4ea1-e126-4582-bb0b-54c608a1d290" containerName="payload-processing"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129533    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f7f4ea1-e126-4582-bb0b-54c608a1d290" containerName="payload-processing"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129539    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02f3448-0d05-4df9-aa98-3a8469799705" containerName="payload-pre-processing"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129544    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02f3448-0d05-4df9-aa98-3a8469799705" containerName="payload-pre-processing"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129553    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac91e27-7d6b-47be-9d6a-77b47044a61e" containerName="payload-pre-processing"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129558    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac91e27-7d6b-47be-9d6a-77b47044a61e" containerName="payload-pre-processing"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129564    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129569    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129577    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d0b453-4781-4a42-9bad-e4db1f676ffa" containerName="revoke-keys"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129582    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d0b453-4781-4a42-9bad-e4db1f676ffa" containerName="revoke-keys"
Sep 11 21:45:00.129627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129627    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ac91e27-7d6b-47be-9d6a-77b47044a61e" containerName="payload-pre-processing"
Sep 11 21:45:00.130197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129638    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7f4ea1-e126-4582-bb0b-54c608a1d290" containerName="payload-processing"
Sep 11 21:45:00.130197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129644    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy"
Sep 11 21:45:00.130197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129650    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02f3448-0d05-4df9-aa98-3a8469799705" containerName="payload-pre-processing"
Sep 11 21:45:00.130197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129655    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="227af85e-1733-4033-a842-961d85eb22bc" containerName="payload-processing"
Sep 11 21:45:00.130197 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.129662    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d0b453-4781-4a42-9bad-e4db1f676ffa" containerName="revoke-keys"
Sep 11 21:45:00.132745 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.132724    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk"]
Sep 11 21:45:00.132882 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.132866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g"
Sep 11 21:45:00.133133 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.133118    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4938ca-3311-42f8-a34c-18e20118f893" containerName="istio-proxy"
Sep 11 21:45:00.135178 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.135162    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:45:00.135964 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.135951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk"
Sep 11 21:45:00.142749 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.142723    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g"]
Sep 11 21:45:00.153614 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.153581    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk"]
Sep 11 21:45:00.156439 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.156403    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk"
Sep 11 21:45:00.158814 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.158796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g"
Sep 11 21:45:00.437626 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.437597    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk"]
Sep 11 21:45:00.439979 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:45:00.439956    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0375a2ae_5826_4733_8767_cc290068f5ba.slice/crio-7dd9c5c132524c389f0e2a047eba9445a61a9e923bfbf06aca03588db09cbdfc WatchSource:0}: Error finding container 7dd9c5c132524c389f0e2a047eba9445a61a9e923bfbf06aca03588db09cbdfc: Status 404 returned error can't find the container with id 7dd9c5c132524c389f0e2a047eba9445a61a9e923bfbf06aca03588db09cbdfc
Sep 11 21:45:00.445092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.445072    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g"]
Sep 11 21:45:00.447019 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:45:00.446992    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd4ec68_34bf_4a96_bd5d_9c8d7bdf0641.slice/crio-59e2dc14bfe8bf5c645b1bb38ddcc292ddc3698e99dc5bec4189cc83696dce3e WatchSource:0}: Error finding container 59e2dc14bfe8bf5c645b1bb38ddcc292ddc3698e99dc5bec4189cc83696dce3e: Status 404 returned error can't find the container with id 59e2dc14bfe8bf5c645b1bb38ddcc292ddc3698e99dc5bec4189cc83696dce3e
Sep 11 21:45:00.728173 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.728138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk" event={"ID":"0375a2ae-5826-4733-8767-cc290068f5ba","Type":"ContainerStarted","Data":"e82d34643b53fe453fb789c7251f2e63c55a41b7f08ff7079326138791e18624"}
Sep 11 21:45:00.728291 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.728200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk" event={"ID":"0375a2ae-5826-4733-8767-cc290068f5ba","Type":"ContainerStarted","Data":"7dd9c5c132524c389f0e2a047eba9445a61a9e923bfbf06aca03588db09cbdfc"}
Sep 11 21:45:00.729721 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.729693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g" event={"ID":"6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641","Type":"ContainerStarted","Data":"ad1208bf2cc5655c6e4842a70abefb1b0e7184685e0bc1a60dbb548ecb562a47"}
Sep 11 21:45:00.729803 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.729748    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g" event={"ID":"6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641","Type":"ContainerStarted","Data":"59e2dc14bfe8bf5c645b1bb38ddcc292ddc3698e99dc5bec4189cc83696dce3e"}
Sep 11 21:45:00.761682 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.761636    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk" podStartSLOduration=0.761621162 podStartE2EDuration="761.621162ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:45:00.760250875 +0000 UTC m=+1658.472910925" watchObservedRunningTime="2026-09-11 21:45:00.761621162 +0000 UTC m=+1658.474281211"
Sep 11 21:45:00.800948 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:00.800890    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g" podStartSLOduration=0.800867802 podStartE2EDuration="800.867802ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:45:00.799028034 +0000 UTC m=+1658.511688084" watchObservedRunningTime="2026-09-11 21:45:00.800867802 +0000 UTC m=+1658.513527911"
Sep 11 21:45:01.736517 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:01.736419    2560 generic.go:356] "Generic (PLEG): container finished" podID="0375a2ae-5826-4733-8767-cc290068f5ba" containerID="e82d34643b53fe453fb789c7251f2e63c55a41b7f08ff7079326138791e18624" exitCode=0
Sep 11 21:45:01.736517 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:01.736505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk" event={"ID":"0375a2ae-5826-4733-8767-cc290068f5ba","Type":"ContainerDied","Data":"e82d34643b53fe453fb789c7251f2e63c55a41b7f08ff7079326138791e18624"}
Sep 11 21:45:01.738384 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:01.738351    2560 generic.go:356] "Generic (PLEG): container finished" podID="6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641" containerID="ad1208bf2cc5655c6e4842a70abefb1b0e7184685e0bc1a60dbb548ecb562a47" exitCode=0
Sep 11 21:45:01.738518 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:01.738468    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g" event={"ID":"6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641","Type":"ContainerDied","Data":"ad1208bf2cc5655c6e4842a70abefb1b0e7184685e0bc1a60dbb548ecb562a47"}
Sep 11 21:45:02.892839 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:02.892806    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g"
Sep 11 21:45:02.895690 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:02.895671    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk"
Sep 11 21:45:03.750016 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:03.749980    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk"
Sep 11 21:45:03.750183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:03.749986    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk" event={"ID":"0375a2ae-5826-4733-8767-cc290068f5ba","Type":"ContainerDied","Data":"7dd9c5c132524c389f0e2a047eba9445a61a9e923bfbf06aca03588db09cbdfc"}
Sep 11 21:45:03.750183 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:03.750127    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dd9c5c132524c389f0e2a047eba9445a61a9e923bfbf06aca03588db09cbdfc"
Sep 11 21:45:03.751274 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:03.751252    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g"
Sep 11 21:45:03.751392 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:03.751285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g" event={"ID":"6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641","Type":"ContainerDied","Data":"59e2dc14bfe8bf5c645b1bb38ddcc292ddc3698e99dc5bec4189cc83696dce3e"}
Sep 11 21:45:03.751392 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:03.751321    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59e2dc14bfe8bf5c645b1bb38ddcc292ddc3698e99dc5bec4189cc83696dce3e"
Sep 11 21:45:31.344910 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.344870    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"]
Sep 11 21:45:31.345410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.345218    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641" containerName="cleanup"
Sep 11 21:45:31.345410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.345229    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641" containerName="cleanup"
Sep 11 21:45:31.345410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.345270    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0375a2ae-5826-4733-8767-cc290068f5ba" containerName="cleanup"
Sep 11 21:45:31.345410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.345279    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0375a2ae-5826-4733-8767-cc290068f5ba" containerName="cleanup"
Sep 11 21:45:31.345410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.345339    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641" containerName="cleanup"
Sep 11 21:45:31.345410 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.345347    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0375a2ae-5826-4733-8767-cc290068f5ba" containerName="cleanup"
Sep 11 21:45:31.348277 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.348248    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.350757 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.350735    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-9a6078-openshift-default-dockercfg-hrzxv\""
Sep 11 21:45:31.359240 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.359213    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"]
Sep 11 21:45:31.496596 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.496558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-envoy\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.496596 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.496597    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-certs\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.496812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.496652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-credential-socket\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.496812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.496725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trlhn\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-kube-api-access-trlhn\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.496812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.496766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-socket\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.496812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.496787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1983d12-f3f6-474e-8a1a-aba21127cac9-istiod-ca-cert\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.496812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.496805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-data\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.497006 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.496883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-token\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.497006 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.496921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-podinfo\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.598448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-podinfo\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.598448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-envoy\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.598448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-certs\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.598722 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-credential-socket\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.598722 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trlhn\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-kube-api-access-trlhn\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.598722 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-socket\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.598722 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1983d12-f3f6-474e-8a1a-aba21127cac9-istiod-ca-cert\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.598722 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-data\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.599034 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-token\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.599034 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.598958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-credential-socket\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.599034 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.599027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-socket\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.599242 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.599219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-data\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.599304 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.599270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-certs\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.599480 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.599463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1983d12-f3f6-474e-8a1a-aba21127cac9-istiod-ca-cert\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.601427 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.601411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-envoy\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.601750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.601729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-podinfo\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.611546 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.611525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trlhn\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-kube-api-access-trlhn\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.613467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.613441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-token\") pod \"e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") " pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.660399 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.660363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:31.937189 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.937133    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"]
Sep 11 21:45:31.939420 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:45:31.939387    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1983d12_f3f6_474e_8a1a_aba21127cac9.slice/crio-83a1f1cecefe7534c4c8f771e01fd0ccc21f2a97b5bb90741f48c81495149078 WatchSource:0}: Error finding container 83a1f1cecefe7534c4c8f771e01fd0ccc21f2a97b5bb90741f48c81495149078: Status 404 returned error can't find the container with id 83a1f1cecefe7534c4c8f771e01fd0ccc21f2a97b5bb90741f48c81495149078
Sep 11 21:45:31.941702 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.941663    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:45:31.941782 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.941733    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:45:31.941782 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:31.941770    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:45:32.910065 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:32.910028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" event={"ID":"c1983d12-f3f6-474e-8a1a-aba21127cac9","Type":"ContainerStarted","Data":"030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f"}
Sep 11 21:45:32.910478 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:32.910076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" event={"ID":"c1983d12-f3f6-474e-8a1a-aba21127cac9","Type":"ContainerStarted","Data":"83a1f1cecefe7534c4c8f771e01fd0ccc21f2a97b5bb90741f48c81495149078"}
Sep 11 21:45:32.935479 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:32.935432    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" podStartSLOduration=1.935417138 podStartE2EDuration="1.935417138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:45:32.934066923 +0000 UTC m=+1690.646726994" watchObservedRunningTime="2026-09-11 21:45:32.935417138 +0000 UTC m=+1690.648077184"
Sep 11 21:45:33.661298 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:33.661259    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:33.666454 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:33.666429    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:33.916424 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:33.916341    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:33.917546 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:33.917525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:38.446725 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.446693    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"]
Sep 11 21:45:38.450513 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.450488    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:38.454121 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.454102    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-9a6078\""
Sep 11 21:45:38.464053 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.464029    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"]
Sep 11 21:45:38.464770 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.464747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d2143b9-4621-4b8d-b623-f20b65d3e1af-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn\" (UID: \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:38.464879 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.464843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr8pg\" (UniqueName: \"kubernetes.io/projected/4d2143b9-4621-4b8d-b623-f20b65d3e1af-kube-api-access-xr8pg\") pod \"payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn\" (UID: \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:38.566341 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.566301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8pg\" (UniqueName: \"kubernetes.io/projected/4d2143b9-4621-4b8d-b623-f20b65d3e1af-kube-api-access-xr8pg\") pod \"payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn\" (UID: \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:38.566546 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.566426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d2143b9-4621-4b8d-b623-f20b65d3e1af-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn\" (UID: \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:38.567292 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.567264    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d2143b9-4621-4b8d-b623-f20b65d3e1af-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn\" (UID: \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:38.588573 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.588538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr8pg\" (UniqueName: \"kubernetes.io/projected/4d2143b9-4621-4b8d-b623-f20b65d3e1af-kube-api-access-xr8pg\") pod \"payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn\" (UID: \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:38.761400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:38.761314    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:39.038181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:39.038156    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"]
Sep 11 21:45:39.040293 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:45:39.040267    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2143b9_4621_4b8d_b623_f20b65d3e1af.slice/crio-cef796ae4ec25c3720e61b5ef0511a44908db6a96dbafce4c61ffabca5103343 WatchSource:0}: Error finding container cef796ae4ec25c3720e61b5ef0511a44908db6a96dbafce4c61ffabca5103343: Status 404 returned error can't find the container with id cef796ae4ec25c3720e61b5ef0511a44908db6a96dbafce4c61ffabca5103343
Sep 11 21:45:39.947296 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:39.947248    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn" event={"ID":"4d2143b9-4621-4b8d-b623-f20b65d3e1af","Type":"ContainerStarted","Data":"2965eb3070ef5da1ec0c39b79c50ad80853c6cb935e5d9043bcd8b371093799d"}
Sep 11 21:45:39.947744 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:39.947351    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn" event={"ID":"4d2143b9-4621-4b8d-b623-f20b65d3e1af","Type":"ContainerStarted","Data":"cef796ae4ec25c3720e61b5ef0511a44908db6a96dbafce4c61ffabca5103343"}
Sep 11 21:45:39.947744 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:39.947383    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:39.964433 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:39.964386    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn" podStartSLOduration=1.96437105 podStartE2EDuration="1.96437105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:45:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:45:39.963498571 +0000 UTC m=+1697.676158620" watchObservedRunningTime="2026-09-11 21:45:39.96437105 +0000 UTC m=+1697.677031169"
Sep 11 21:45:49.958006 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:49.957961    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 21:45:49.958539 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:49.958043    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 21:45:50.954119 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:50.954035    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:45:51.008921 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:51.008889    2560 generic.go:356] "Generic (PLEG): container finished" podID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerID="030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f" exitCode=0
Sep 11 21:45:51.009401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:51.008960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" event={"ID":"c1983d12-f3f6-474e-8a1a-aba21127cac9","Type":"ContainerDied","Data":"030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f"}
Sep 11 21:45:51.009467 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:51.009424    2560 scope.go:117] "RemoveContainer" containerID="030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f"
Sep 11 21:45:51.010585 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:51.010551    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:45:51.010714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:51.010619    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:45:51.010714 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:51.010658    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 11 21:45:52.016249 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:52.016212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" event={"ID":"c1983d12-f3f6-474e-8a1a-aba21127cac9","Type":"ContainerStarted","Data":"1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b"}
Sep 11 21:45:52.660712 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:52.660661    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:52.661331 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:52.661300    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 11 21:45:52.661449 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:52.661377    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 11 21:45:53.661289 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:53.661245    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 11 21:45:53.661696 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:53.661304    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 11 21:45:54.661561 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:54.661519    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 11 21:45:54.661965 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:54.661614    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 11 21:45:55.661777 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:55.661729    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 11 21:45:55.662190 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:55.661808    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 11 21:45:56.661371 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:56.661329    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 11 21:45:56.661556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:56.661398    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 11 21:45:57.664865 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:57.664806    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:57.665251 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:57.665231    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:45:57.665870 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:45:57.665855    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:46:08.133413 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.133375    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"]
Sep 11 21:46:08.137370 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.137345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:08.139713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.139695    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-213a70\""
Sep 11 21:46:08.139713 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.139706    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-213a70-dockercfg-c4rbg\""
Sep 11 21:46:08.145611 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.145593    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"]
Sep 11 21:46:08.177093 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.177062    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"]
Sep 11 21:46:08.180472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.180455    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:08.190941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.190914    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"]
Sep 11 21:46:08.258657 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.258622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjxc9\" (UniqueName: \"kubernetes.io/projected/675b4032-7663-462c-a2e9-c49ede3cfc53-kube-api-access-qjxc9\") pod \"payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d\" (UID: \"675b4032-7663-462c-a2e9-c49ede3cfc53\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:08.258883 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.258721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675b4032-7663-462c-a2e9-c49ede3cfc53-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d\" (UID: \"675b4032-7663-462c-a2e9-c49ede3cfc53\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:08.360236 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.360186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjxc9\" (UniqueName: \"kubernetes.io/projected/675b4032-7663-462c-a2e9-c49ede3cfc53-kube-api-access-qjxc9\") pod \"payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d\" (UID: \"675b4032-7663-462c-a2e9-c49ede3cfc53\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:08.360454 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.360288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675b4032-7663-462c-a2e9-c49ede3cfc53-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d\" (UID: \"675b4032-7663-462c-a2e9-c49ede3cfc53\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:08.360454 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.360339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e59bfc09-58a7-4a07-a521-76c9e9d5431e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx\" (UID: \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:08.360454 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.360365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjvkm\" (UniqueName: \"kubernetes.io/projected/e59bfc09-58a7-4a07-a521-76c9e9d5431e-kube-api-access-sjvkm\") pod \"payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx\" (UID: \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:08.361049 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.361031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675b4032-7663-462c-a2e9-c49ede3cfc53-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d\" (UID: \"675b4032-7663-462c-a2e9-c49ede3cfc53\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:08.369251 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.369222    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjxc9\" (UniqueName: \"kubernetes.io/projected/675b4032-7663-462c-a2e9-c49ede3cfc53-kube-api-access-qjxc9\") pod \"payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d\" (UID: \"675b4032-7663-462c-a2e9-c49ede3cfc53\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:08.448753 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.448656    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:08.461181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.461142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e59bfc09-58a7-4a07-a521-76c9e9d5431e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx\" (UID: \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:08.461290 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.461193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjvkm\" (UniqueName: \"kubernetes.io/projected/e59bfc09-58a7-4a07-a521-76c9e9d5431e-kube-api-access-sjvkm\") pod \"payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx\" (UID: \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:08.461791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.461770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e59bfc09-58a7-4a07-a521-76c9e9d5431e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx\" (UID: \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:08.468952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.468922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjvkm\" (UniqueName: \"kubernetes.io/projected/e59bfc09-58a7-4a07-a521-76c9e9d5431e-kube-api-access-sjvkm\") pod \"payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx\" (UID: \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:08.491993 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.491962    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:08.720458 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.720431    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"]
Sep 11 21:46:08.722649 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:46:08.722622    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675b4032_7663_462c_a2e9_c49ede3cfc53.slice/crio-b2035a0d8639466dc1df7169a9111e566c370584ae235a98b7a1ff21d9094e91 WatchSource:0}: Error finding container b2035a0d8639466dc1df7169a9111e566c370584ae235a98b7a1ff21d9094e91: Status 404 returned error can't find the container with id b2035a0d8639466dc1df7169a9111e566c370584ae235a98b7a1ff21d9094e91
Sep 11 21:46:08.779340 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:08.779318    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"]
Sep 11 21:46:08.781441 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:46:08.781416    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59bfc09_58a7_4a07_a521_76c9e9d5431e.slice/crio-b8a44c6f6798b95718e80b6b7f7af83d79a4cc9a5db38c683536c4b03a32ca59 WatchSource:0}: Error finding container b8a44c6f6798b95718e80b6b7f7af83d79a4cc9a5db38c683536c4b03a32ca59: Status 404 returned error can't find the container with id b8a44c6f6798b95718e80b6b7f7af83d79a4cc9a5db38c683536c4b03a32ca59
Sep 11 21:46:09.113029 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:09.112990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx" event={"ID":"e59bfc09-58a7-4a07-a521-76c9e9d5431e","Type":"ContainerStarted","Data":"569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2"}
Sep 11 21:46:09.113238 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:09.113083    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx" event={"ID":"e59bfc09-58a7-4a07-a521-76c9e9d5431e","Type":"ContainerStarted","Data":"b8a44c6f6798b95718e80b6b7f7af83d79a4cc9a5db38c683536c4b03a32ca59"}
Sep 11 21:46:09.113238 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:09.113115    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:09.114928 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:09.114903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d" event={"ID":"675b4032-7663-462c-a2e9-c49ede3cfc53","Type":"ContainerStarted","Data":"7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c"}
Sep 11 21:46:09.115055 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:09.114946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d" event={"ID":"675b4032-7663-462c-a2e9-c49ede3cfc53","Type":"ContainerStarted","Data":"b2035a0d8639466dc1df7169a9111e566c370584ae235a98b7a1ff21d9094e91"}
Sep 11 21:46:09.115055 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:09.115052    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:09.137526 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:09.137482    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx" podStartSLOduration=1.137467337 podStartE2EDuration="1.137467337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:46:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:46:09.135066296 +0000 UTC m=+1726.847726346" watchObservedRunningTime="2026-09-11 21:46:09.137467337 +0000 UTC m=+1726.850127427"
Sep 11 21:46:09.152661 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:09.152618    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d" podStartSLOduration=1.152604233 podStartE2EDuration="1.152604233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:46:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:46:09.151511593 +0000 UTC m=+1726.864171641" watchObservedRunningTime="2026-09-11 21:46:09.152604233 +0000 UTC m=+1726.865264282"
Sep 11 21:46:20.124033 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:20.124000    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:46:20.124492 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:20.124289    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:46:39.209804 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:39.209766    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-57lf9_1a607fc6-8797-4685-82f6-64490c7d4822/payload-processing/0.log"
Sep 11 21:46:39.337393 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:46:39.337364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d_675b4032-7663-462c-a2e9-c49ede3cfc53/payload-processing/0.log"
Sep 11 21:47:25.639312 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:25.639256    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-57lf9_1a607fc6-8797-4685-82f6-64490c7d4822/payload-processing/0.log"
Sep 11 21:47:25.769387 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:25.769361    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d_675b4032-7663-462c-a2e9-c49ede3cfc53/payload-processing/0.log"
Sep 11 21:47:33.881664 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:33.881630    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"]
Sep 11 21:47:33.885123 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:33.885107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:47:33.887358 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:33.887336    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-13e3ee\""
Sep 11 21:47:33.887478 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:33.887368    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-13e3ee-dockercfg-55bqt\""
Sep 11 21:47:33.895202 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:33.895177    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"]
Sep 11 21:47:33.999273 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:33.999237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7eb15f9-2ab9-4ddc-b069-418217f09450-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr\" (UID: \"c7eb15f9-2ab9-4ddc-b069-418217f09450\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:47:33.999449 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:33.999410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dppsh\" (UniqueName: \"kubernetes.io/projected/c7eb15f9-2ab9-4ddc-b069-418217f09450-kube-api-access-dppsh\") pod \"payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr\" (UID: \"c7eb15f9-2ab9-4ddc-b069-418217f09450\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:47:34.100518 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.100470    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dppsh\" (UniqueName: \"kubernetes.io/projected/c7eb15f9-2ab9-4ddc-b069-418217f09450-kube-api-access-dppsh\") pod \"payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr\" (UID: \"c7eb15f9-2ab9-4ddc-b069-418217f09450\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:47:34.100697 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.100541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7eb15f9-2ab9-4ddc-b069-418217f09450-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr\" (UID: \"c7eb15f9-2ab9-4ddc-b069-418217f09450\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:47:34.101860 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.101784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7eb15f9-2ab9-4ddc-b069-418217f09450-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr\" (UID: \"c7eb15f9-2ab9-4ddc-b069-418217f09450\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:47:34.110535 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.110504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dppsh\" (UniqueName: \"kubernetes.io/projected/c7eb15f9-2ab9-4ddc-b069-418217f09450-kube-api-access-dppsh\") pod \"payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr\" (UID: \"c7eb15f9-2ab9-4ddc-b069-418217f09450\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:47:34.196082 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.195990    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:47:34.471045 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.471018    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"]
Sep 11 21:47:34.473534 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:47:34.473508    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7eb15f9_2ab9_4ddc_b069_418217f09450.slice/crio-9e391e78e2630a501a88c63f55ba805618e05a961ca5343350934a9211671c76 WatchSource:0}: Error finding container 9e391e78e2630a501a88c63f55ba805618e05a961ca5343350934a9211671c76: Status 404 returned error can't find the container with id 9e391e78e2630a501a88c63f55ba805618e05a961ca5343350934a9211671c76
Sep 11 21:47:34.594690 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.594649    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr" event={"ID":"c7eb15f9-2ab9-4ddc-b069-418217f09450","Type":"ContainerStarted","Data":"ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364"}
Sep 11 21:47:34.594898 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.594718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr" event={"ID":"c7eb15f9-2ab9-4ddc-b069-418217f09450","Type":"ContainerStarted","Data":"9e391e78e2630a501a88c63f55ba805618e05a961ca5343350934a9211671c76"}
Sep 11 21:47:34.594898 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.594747    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:47:34.610346 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:34.610294    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr" podStartSLOduration=1.610275047 podStartE2EDuration="1.610275047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:47:34.609451257 +0000 UTC m=+1812.322111308" watchObservedRunningTime="2026-09-11 21:47:34.610275047 +0000 UTC m=+1812.322935102"
Sep 11 21:47:45.603364 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:47:45.603330    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:48:00.283730 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.283695    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"]
Sep 11 21:48:00.287266 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.287243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"
Sep 11 21:48:00.293110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.293088    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:48:00.294415 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.294387    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:48:00.307584 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.307556    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"]
Sep 11 21:48:00.373472 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.373436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8217272-7d48-4a26-8313-39e46c35f28f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z\" (UID: \"d8217272-7d48-4a26-8313-39e46c35f28f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"
Sep 11 21:48:00.475112 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.475075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8217272-7d48-4a26-8313-39e46c35f28f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z\" (UID: \"d8217272-7d48-4a26-8313-39e46c35f28f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"
Sep 11 21:48:00.475753 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.475732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8217272-7d48-4a26-8313-39e46c35f28f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z\" (UID: \"d8217272-7d48-4a26-8313-39e46c35f28f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"
Sep 11 21:48:00.602708 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.602677    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"
Sep 11 21:48:00.875874 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:00.875846    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"]
Sep 11 21:48:00.878288 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:48:00.878255    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8217272_7d48_4a26_8313_39e46c35f28f.slice/crio-d2cce5ec8f33a411e5b9ab86febe5c7b620f74df2314c67805548ab0f771eaf2 WatchSource:0}: Error finding container d2cce5ec8f33a411e5b9ab86febe5c7b620f74df2314c67805548ab0f771eaf2: Status 404 returned error can't find the container with id d2cce5ec8f33a411e5b9ab86febe5c7b620f74df2314c67805548ab0f771eaf2
Sep 11 21:48:01.746286 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:01.746253    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8217272-7d48-4a26-8313-39e46c35f28f" containerID="adf668ab9b730171a5bf2410edbc87042028759baf3c19455f13b1c698fdb1b7" exitCode=0
Sep 11 21:48:01.746669 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:01.746321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z" event={"ID":"d8217272-7d48-4a26-8313-39e46c35f28f","Type":"ContainerDied","Data":"adf668ab9b730171a5bf2410edbc87042028759baf3c19455f13b1c698fdb1b7"}
Sep 11 21:48:01.746669 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:01.746358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z" event={"ID":"d8217272-7d48-4a26-8313-39e46c35f28f","Type":"ContainerStarted","Data":"d2cce5ec8f33a411e5b9ab86febe5c7b620f74df2314c67805548ab0f771eaf2"}
Sep 11 21:48:02.887661 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:02.887637    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"
Sep 11 21:48:03.001610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:03.001575    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8217272-7d48-4a26-8313-39e46c35f28f-maas-api-service-ca\") pod \"d8217272-7d48-4a26-8313-39e46c35f28f\" (UID: \"d8217272-7d48-4a26-8313-39e46c35f28f\") "
Sep 11 21:48:03.002025 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:03.001970    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8217272-7d48-4a26-8313-39e46c35f28f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d8217272-7d48-4a26-8313-39e46c35f28f" (UID: "d8217272-7d48-4a26-8313-39e46c35f28f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:48:03.102732 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:03.102699    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8217272-7d48-4a26-8313-39e46c35f28f-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:48:03.758404 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:03.758373    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"
Sep 11 21:48:03.758591 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:03.758372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z" event={"ID":"d8217272-7d48-4a26-8313-39e46c35f28f","Type":"ContainerDied","Data":"d2cce5ec8f33a411e5b9ab86febe5c7b620f74df2314c67805548ab0f771eaf2"}
Sep 11 21:48:03.758591 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:03.758501    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2cce5ec8f33a411e5b9ab86febe5c7b620f74df2314c67805548ab0f771eaf2"
Sep 11 21:48:11.378659 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.378628    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"]
Sep 11 21:48:11.379237 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.378903    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr" podUID="c7eb15f9-2ab9-4ddc-b069-418217f09450" containerName="payload-pre-processing" containerID="cri-o://ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364" gracePeriod=30
Sep 11 21:48:11.546739 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.546684    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"]
Sep 11 21:48:11.549667 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.549641    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-13e3ee-pvh2z"]
Sep 11 21:48:11.631521 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.631466    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:48:11.790562 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.790527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7eb15f9-2ab9-4ddc-b069-418217f09450-plugins-config-volume\") pod \"c7eb15f9-2ab9-4ddc-b069-418217f09450\" (UID: \"c7eb15f9-2ab9-4ddc-b069-418217f09450\") "
Sep 11 21:48:11.790562 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.790566    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dppsh\" (UniqueName: \"kubernetes.io/projected/c7eb15f9-2ab9-4ddc-b069-418217f09450-kube-api-access-dppsh\") pod \"c7eb15f9-2ab9-4ddc-b069-418217f09450\" (UID: \"c7eb15f9-2ab9-4ddc-b069-418217f09450\") "
Sep 11 21:48:11.790952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.790926    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eb15f9-2ab9-4ddc-b069-418217f09450-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c7eb15f9-2ab9-4ddc-b069-418217f09450" (UID: "c7eb15f9-2ab9-4ddc-b069-418217f09450"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:48:11.792996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.792975    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7eb15f9-2ab9-4ddc-b069-418217f09450-kube-api-access-dppsh" (OuterVolumeSpecName: "kube-api-access-dppsh") pod "c7eb15f9-2ab9-4ddc-b069-418217f09450" (UID: "c7eb15f9-2ab9-4ddc-b069-418217f09450"). InnerVolumeSpecName "kube-api-access-dppsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:48:11.800146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.800120    2560 generic.go:356] "Generic (PLEG): container finished" podID="c7eb15f9-2ab9-4ddc-b069-418217f09450" containerID="ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364" exitCode=0
Sep 11 21:48:11.800236 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.800164    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"
Sep 11 21:48:11.800236 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.800183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr" event={"ID":"c7eb15f9-2ab9-4ddc-b069-418217f09450","Type":"ContainerDied","Data":"ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364"}
Sep 11 21:48:11.800236 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.800228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr" event={"ID":"c7eb15f9-2ab9-4ddc-b069-418217f09450","Type":"ContainerDied","Data":"9e391e78e2630a501a88c63f55ba805618e05a961ca5343350934a9211671c76"}
Sep 11 21:48:11.800339 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.800250    2560 scope.go:117] "RemoveContainer" containerID="ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364"
Sep 11 21:48:11.814434 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.814415    2560 scope.go:117] "RemoveContainer" containerID="ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364"
Sep 11 21:48:11.814738 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:48:11.814716    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364\": container with ID starting with ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364 not found: ID does not exist" containerID="ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364"
Sep 11 21:48:11.814783 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.814747    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364"} err="failed to get container status \"ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364\": rpc error: code = NotFound desc = could not find container \"ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364\": container with ID starting with ffa31cf62606c466b65745b350e335a18eeeb87f5a8691d65539ad6afe495364 not found: ID does not exist"
Sep 11 21:48:11.825155 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.825133    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"]
Sep 11 21:48:11.828952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.828933    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr"]
Sep 11 21:48:11.891566 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.891487    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7eb15f9-2ab9-4ddc-b069-418217f09450-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:48:11.891566 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:11.891516    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dppsh\" (UniqueName: \"kubernetes.io/projected/c7eb15f9-2ab9-4ddc-b069-418217f09450-kube-api-access-dppsh\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:48:12.800895 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:12.800856    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7eb15f9-2ab9-4ddc-b069-418217f09450" path="/var/lib/kubelet/pods/c7eb15f9-2ab9-4ddc-b069-418217f09450/volumes"
Sep 11 21:48:12.801412 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:12.801333    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8217272-7d48-4a26-8313-39e46c35f28f" path="/var/lib/kubelet/pods/d8217272-7d48-4a26-8313-39e46c35f28f/volumes"
Sep 11 21:48:22.153602 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.153564    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"]
Sep 11 21:48:22.154019 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.153972    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8217272-7d48-4a26-8313-39e46c35f28f" containerName="revoke-keys"
Sep 11 21:48:22.154019 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.153986    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8217272-7d48-4a26-8313-39e46c35f28f" containerName="revoke-keys"
Sep 11 21:48:22.154019 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.153999    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7eb15f9-2ab9-4ddc-b069-418217f09450" containerName="payload-pre-processing"
Sep 11 21:48:22.154019 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.154005    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7eb15f9-2ab9-4ddc-b069-418217f09450" containerName="payload-pre-processing"
Sep 11 21:48:22.154155 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.154068    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8217272-7d48-4a26-8313-39e46c35f28f" containerName="revoke-keys"
Sep 11 21:48:22.154155 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.154081    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7eb15f9-2ab9-4ddc-b069-418217f09450" containerName="payload-pre-processing"
Sep 11 21:48:22.158556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.158540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"
Sep 11 21:48:22.161507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.161481    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:48:22.162075 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.162050    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:48:22.163445 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.163422    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"]
Sep 11 21:48:22.190957 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.190925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668906fb-3586-47a3-b7a2-f8e0f646f6d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p\" (UID: \"668906fb-3586-47a3-b7a2-f8e0f646f6d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"
Sep 11 21:48:22.291494 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.291462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668906fb-3586-47a3-b7a2-f8e0f646f6d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p\" (UID: \"668906fb-3586-47a3-b7a2-f8e0f646f6d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"
Sep 11 21:48:22.292111 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.292094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668906fb-3586-47a3-b7a2-f8e0f646f6d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p\" (UID: \"668906fb-3586-47a3-b7a2-f8e0f646f6d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"
Sep 11 21:48:22.470481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.470402    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"
Sep 11 21:48:22.753611 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.753540    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"]
Sep 11 21:48:22.758468 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:48:22.758444    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668906fb_3586_47a3_b7a2_f8e0f646f6d6.slice/crio-eac985ad9d937ad790fe98e4469ff452fb558b5c5965347f06d4be9866ba7c3e WatchSource:0}: Error finding container eac985ad9d937ad790fe98e4469ff452fb558b5c5965347f06d4be9866ba7c3e: Status 404 returned error can't find the container with id eac985ad9d937ad790fe98e4469ff452fb558b5c5965347f06d4be9866ba7c3e
Sep 11 21:48:22.861939 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:22.861907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p" event={"ID":"668906fb-3586-47a3-b7a2-f8e0f646f6d6","Type":"ContainerStarted","Data":"eac985ad9d937ad790fe98e4469ff452fb558b5c5965347f06d4be9866ba7c3e"}
Sep 11 21:48:23.180293 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:23.180259    2560 scope.go:117] "RemoveContainer" containerID="f8b03628d7d727c1644c61fb190313892060c4dc6b9d370a1d5d0e5bab36d1e8"
Sep 11 21:48:23.189026 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:23.189004    2560 scope.go:117] "RemoveContainer" containerID="7172ebfdd395502c7bdbc5343da61257e313fe81b43afdab27d290073d561128"
Sep 11 21:48:23.197184 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:23.197158    2560 scope.go:117] "RemoveContainer" containerID="23102094009b0da29e643d73a79688443d8f2fb688c5d776d47106542fb6037d"
Sep 11 21:48:23.205219 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:23.205198    2560 scope.go:117] "RemoveContainer" containerID="65396c352c55f6f6f80b05e2d503776a26bf3ba1084fc55c6f6afd4ed482cd00"
Sep 11 21:48:23.869091 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:23.869050    2560 generic.go:356] "Generic (PLEG): container finished" podID="668906fb-3586-47a3-b7a2-f8e0f646f6d6" containerID="a627b113061ed00c2e47def6ad3a26afe7d0462027ecd0fab4c8e5bc87431495" exitCode=0
Sep 11 21:48:23.869264 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:23.869140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p" event={"ID":"668906fb-3586-47a3-b7a2-f8e0f646f6d6","Type":"ContainerDied","Data":"a627b113061ed00c2e47def6ad3a26afe7d0462027ecd0fab4c8e5bc87431495"}
Sep 11 21:48:25.012742 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:25.012708    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"
Sep 11 21:48:25.118990 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:25.118959    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668906fb-3586-47a3-b7a2-f8e0f646f6d6-maas-api-service-ca\") pod \"668906fb-3586-47a3-b7a2-f8e0f646f6d6\" (UID: \"668906fb-3586-47a3-b7a2-f8e0f646f6d6\") "
Sep 11 21:48:25.119315 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:25.119294    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/668906fb-3586-47a3-b7a2-f8e0f646f6d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "668906fb-3586-47a3-b7a2-f8e0f646f6d6" (UID: "668906fb-3586-47a3-b7a2-f8e0f646f6d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:48:25.220747 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:25.220659    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/668906fb-3586-47a3-b7a2-f8e0f646f6d6-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:48:25.881330 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:25.881300    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"
Sep 11 21:48:25.881330 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:25.881310    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p" event={"ID":"668906fb-3586-47a3-b7a2-f8e0f646f6d6","Type":"ContainerDied","Data":"eac985ad9d937ad790fe98e4469ff452fb558b5c5965347f06d4be9866ba7c3e"}
Sep 11 21:48:25.881520 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:25.881351    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eac985ad9d937ad790fe98e4469ff452fb558b5c5965347f06d4be9866ba7c3e"
Sep 11 21:48:37.781419 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:37.781381    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"]
Sep 11 21:48:37.781969 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:37.781611    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn" podUID="4d2143b9-4621-4b8d-b623-f20b65d3e1af" containerName="payload-pre-processing" containerID="cri-o://2965eb3070ef5da1ec0c39b79c50ad80853c6cb935e5d9043bcd8b371093799d" gracePeriod=30
Sep 11 21:48:37.944217 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:37.944172    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"]
Sep 11 21:48:37.947515 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:37.947478    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a6078-qtr2p"]
Sep 11 21:48:37.949323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:37.949295    2560 generic.go:356] "Generic (PLEG): container finished" podID="4d2143b9-4621-4b8d-b623-f20b65d3e1af" containerID="2965eb3070ef5da1ec0c39b79c50ad80853c6cb935e5d9043bcd8b371093799d" exitCode=0
Sep 11 21:48:37.949449 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:37.949366    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn" event={"ID":"4d2143b9-4621-4b8d-b623-f20b65d3e1af","Type":"ContainerDied","Data":"2965eb3070ef5da1ec0c39b79c50ad80853c6cb935e5d9043bcd8b371093799d"}
Sep 11 21:48:38.063012 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.062988    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:48:38.146172 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.146139    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr8pg\" (UniqueName: \"kubernetes.io/projected/4d2143b9-4621-4b8d-b623-f20b65d3e1af-kube-api-access-xr8pg\") pod \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\" (UID: \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\") "
Sep 11 21:48:38.146376 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.146208    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d2143b9-4621-4b8d-b623-f20b65d3e1af-plugins-config-volume\") pod \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\" (UID: \"4d2143b9-4621-4b8d-b623-f20b65d3e1af\") "
Sep 11 21:48:38.146569 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.146542    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2143b9-4621-4b8d-b623-f20b65d3e1af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d2143b9-4621-4b8d-b623-f20b65d3e1af" (UID: "4d2143b9-4621-4b8d-b623-f20b65d3e1af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:48:38.148582 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.148559    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2143b9-4621-4b8d-b623-f20b65d3e1af-kube-api-access-xr8pg" (OuterVolumeSpecName: "kube-api-access-xr8pg") pod "4d2143b9-4621-4b8d-b623-f20b65d3e1af" (UID: "4d2143b9-4621-4b8d-b623-f20b65d3e1af"). InnerVolumeSpecName "kube-api-access-xr8pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:48:38.247348 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.247309    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d2143b9-4621-4b8d-b623-f20b65d3e1af-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:48:38.247348 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.247340    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr8pg\" (UniqueName: \"kubernetes.io/projected/4d2143b9-4621-4b8d-b623-f20b65d3e1af-kube-api-access-xr8pg\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:48:38.801774 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.801743    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="668906fb-3586-47a3-b7a2-f8e0f646f6d6" path="/var/lib/kubelet/pods/668906fb-3586-47a3-b7a2-f8e0f646f6d6/volumes"
Sep 11 21:48:38.957146 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.957116    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"
Sep 11 21:48:38.957323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.957124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn" event={"ID":"4d2143b9-4621-4b8d-b623-f20b65d3e1af","Type":"ContainerDied","Data":"cef796ae4ec25c3720e61b5ef0511a44908db6a96dbafce4c61ffabca5103343"}
Sep 11 21:48:38.957323 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.957266    2560 scope.go:117] "RemoveContainer" containerID="2965eb3070ef5da1ec0c39b79c50ad80853c6cb935e5d9043bcd8b371093799d"
Sep 11 21:48:38.973027 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.972994    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"]
Sep 11 21:48:38.977538 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:38.977515    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn"]
Sep 11 21:48:40.800796 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:48:40.800762    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d2143b9-4621-4b8d-b623-f20b65d3e1af" path="/var/lib/kubelet/pods/4d2143b9-4621-4b8d-b623-f20b65d3e1af/volumes"
Sep 11 21:49:23.239876 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:23.239813    2560 scope.go:117] "RemoveContainer" containerID="5191ed8c84a322788e35b4a018c02418e56d412fef47df83552ae93a5ce46f3e"
Sep 11 21:49:23.248572 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:23.248552    2560 scope.go:117] "RemoveContainer" containerID="cab1012ca42620d52ad8d0ab0949ad93b3d9570957a4113d4b1681fe79f4aeeb"
Sep 11 21:49:32.004919 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.004886    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"]
Sep 11 21:49:32.005346 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.005121    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy" containerID="cri-o://1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b" gracePeriod=30
Sep 11 21:49:32.357177 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.357144    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"]
Sep 11 21:49:32.357590 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.357577    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="668906fb-3586-47a3-b7a2-f8e0f646f6d6" containerName="revoke-keys"
Sep 11 21:49:32.357638 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.357593    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="668906fb-3586-47a3-b7a2-f8e0f646f6d6" containerName="revoke-keys"
Sep 11 21:49:32.357638 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.357616    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2143b9-4621-4b8d-b623-f20b65d3e1af" containerName="payload-pre-processing"
Sep 11 21:49:32.357638 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.357625    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2143b9-4621-4b8d-b623-f20b65d3e1af" containerName="payload-pre-processing"
Sep 11 21:49:32.357778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.357695    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d2143b9-4621-4b8d-b623-f20b65d3e1af" containerName="payload-pre-processing"
Sep 11 21:49:32.357778 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.357704    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="668906fb-3586-47a3-b7a2-f8e0f646f6d6" containerName="revoke-keys"
Sep 11 21:49:32.360949 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.360930    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"
Sep 11 21:49:32.363251 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.363227    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:49:32.363381 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.363254    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:49:32.367223 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.367201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a868bf52-1fbd-41cc-a91a-3f9cd485f547-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr\" (UID: \"a868bf52-1fbd-41cc-a91a-3f9cd485f547\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"
Sep 11 21:49:32.368452 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.368425    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"]
Sep 11 21:49:32.468633 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.468592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a868bf52-1fbd-41cc-a91a-3f9cd485f547-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr\" (UID: \"a868bf52-1fbd-41cc-a91a-3f9cd485f547\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"
Sep 11 21:49:32.469195 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.469176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a868bf52-1fbd-41cc-a91a-3f9cd485f547-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr\" (UID: \"a868bf52-1fbd-41cc-a91a-3f9cd485f547\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"
Sep 11 21:49:32.673242 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.673156    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"
Sep 11 21:49:32.971312 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:49:32.971281    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda868bf52_1fbd_41cc_a91a_3f9cd485f547.slice/crio-90a96c828eb24ed8ca13faaf1de0efcd90f7e445fe69b8ced38c652cb00e5311 WatchSource:0}: Error finding container 90a96c828eb24ed8ca13faaf1de0efcd90f7e445fe69b8ced38c652cb00e5311: Status 404 returned error can't find the container with id 90a96c828eb24ed8ca13faaf1de0efcd90f7e445fe69b8ced38c652cb00e5311
Sep 11 21:49:32.972006 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:32.971985    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"]
Sep 11 21:49:33.242658 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:33.242566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr" event={"ID":"a868bf52-1fbd-41cc-a91a-3f9cd485f547","Type":"ContainerStarted","Data":"58b86300bf45bde60b0e99acec1a86566f525d40fd3eac4e95d7bdf4cfbfc8b0"}
Sep 11 21:49:33.242658 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:33.242616    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr" event={"ID":"a868bf52-1fbd-41cc-a91a-3f9cd485f547","Type":"ContainerStarted","Data":"90a96c828eb24ed8ca13faaf1de0efcd90f7e445fe69b8ced38c652cb00e5311"}
Sep 11 21:49:33.257892 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:33.257801    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr" podStartSLOduration=1.2577766750000001 podStartE2EDuration="1.257776675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:49:33.257365652 +0000 UTC m=+1930.970025701" watchObservedRunningTime="2026-09-11 21:49:33.257776675 +0000 UTC m=+1930.970436723"
Sep 11 21:49:34.249243 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:34.249209    2560 generic.go:356] "Generic (PLEG): container finished" podID="a868bf52-1fbd-41cc-a91a-3f9cd485f547" containerID="58b86300bf45bde60b0e99acec1a86566f525d40fd3eac4e95d7bdf4cfbfc8b0" exitCode=0
Sep 11 21:49:34.249640 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:34.249260    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr" event={"ID":"a868bf52-1fbd-41cc-a91a-3f9cd485f547","Type":"ContainerDied","Data":"58b86300bf45bde60b0e99acec1a86566f525d40fd3eac4e95d7bdf4cfbfc8b0"}
Sep 11 21:49:35.388556 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:35.388533    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"
Sep 11 21:49:35.492458 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:35.492419    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a868bf52-1fbd-41cc-a91a-3f9cd485f547-maas-api-service-ca\") pod \"a868bf52-1fbd-41cc-a91a-3f9cd485f547\" (UID: \"a868bf52-1fbd-41cc-a91a-3f9cd485f547\") "
Sep 11 21:49:35.492771 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:35.492748    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a868bf52-1fbd-41cc-a91a-3f9cd485f547-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a868bf52-1fbd-41cc-a91a-3f9cd485f547" (UID: "a868bf52-1fbd-41cc-a91a-3f9cd485f547"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:49:35.594055 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:35.594023    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a868bf52-1fbd-41cc-a91a-3f9cd485f547-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:36.260655 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:36.260625    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"
Sep 11 21:49:36.260892 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:36.260655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr" event={"ID":"a868bf52-1fbd-41cc-a91a-3f9cd485f547","Type":"ContainerDied","Data":"90a96c828eb24ed8ca13faaf1de0efcd90f7e445fe69b8ced38c652cb00e5311"}
Sep 11 21:49:36.260892 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:36.260694    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90a96c828eb24ed8ca13faaf1de0efcd90f7e445fe69b8ced38c652cb00e5311"
Sep 11 21:49:37.264359 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.264333    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:49:37.267016 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.266948    2560 generic.go:356] "Generic (PLEG): container finished" podID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerID="1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b" exitCode=0
Sep 11 21:49:37.267016 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.266986    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"
Sep 11 21:49:37.267016 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.267007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" event={"ID":"c1983d12-f3f6-474e-8a1a-aba21127cac9","Type":"ContainerDied","Data":"1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b"}
Sep 11 21:49:37.267238 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.267060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f" event={"ID":"c1983d12-f3f6-474e-8a1a-aba21127cac9","Type":"ContainerDied","Data":"83a1f1cecefe7534c4c8f771e01fd0ccc21f2a97b5bb90741f48c81495149078"}
Sep 11 21:49:37.267238 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.267094    2560 scope.go:117] "RemoveContainer" containerID="1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b"
Sep 11 21:49:37.275670 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.275653    2560 scope.go:117] "RemoveContainer" containerID="030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f"
Sep 11 21:49:37.283364 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.283347    2560 scope.go:117] "RemoveContainer" containerID="1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b"
Sep 11 21:49:37.283669 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:49:37.283650    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b\": container with ID starting with 1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b not found: ID does not exist" containerID="1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b"
Sep 11 21:49:37.283750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.283681    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b"} err="failed to get container status \"1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b\": rpc error: code = NotFound desc = could not find container \"1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b\": container with ID starting with 1d17ad4a7812a0e959594bc6e6bdc8f3477abb329b4019eb97fd7c2958cbfe9b not found: ID does not exist"
Sep 11 21:49:37.283750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.283707    2560 scope.go:117] "RemoveContainer" containerID="030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f"
Sep 11 21:49:37.284028 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:49:37.284012    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f\": container with ID starting with 030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f not found: ID does not exist" containerID="030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f"
Sep 11 21:49:37.284072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.284036    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f"} err="failed to get container status \"030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f\": rpc error: code = NotFound desc = could not find container \"030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f\": container with ID starting with 030e2543c2abd59fab5d612ecb006dc7973b2154e3c79f86d84581e83222062f not found: ID does not exist"
Sep 11 21:49:37.311921 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.311878    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-token\") pod \"c1983d12-f3f6-474e-8a1a-aba21127cac9\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") "
Sep 11 21:49:37.312110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.311936    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1983d12-f3f6-474e-8a1a-aba21127cac9-istiod-ca-cert\") pod \"c1983d12-f3f6-474e-8a1a-aba21127cac9\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") "
Sep 11 21:49:37.312110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.311973    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-data\") pod \"c1983d12-f3f6-474e-8a1a-aba21127cac9\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") "
Sep 11 21:49:37.312110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.311991    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-credential-socket\") pod \"c1983d12-f3f6-474e-8a1a-aba21127cac9\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") "
Sep 11 21:49:37.312110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312080    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-envoy\") pod \"c1983d12-f3f6-474e-8a1a-aba21127cac9\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") "
Sep 11 21:49:37.312110 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-certs\") pod \"c1983d12-f3f6-474e-8a1a-aba21127cac9\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") "
Sep 11 21:49:37.312385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312144    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trlhn\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-kube-api-access-trlhn\") pod \"c1983d12-f3f6-474e-8a1a-aba21127cac9\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") "
Sep 11 21:49:37.312385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312173    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-podinfo\") pod \"c1983d12-f3f6-474e-8a1a-aba21127cac9\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") "
Sep 11 21:49:37.312385 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312199    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-socket\") pod \"c1983d12-f3f6-474e-8a1a-aba21127cac9\" (UID: \"c1983d12-f3f6-474e-8a1a-aba21127cac9\") "
Sep 11 21:49:37.312542 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312439    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-data" (OuterVolumeSpecName: "istio-data") pod "c1983d12-f3f6-474e-8a1a-aba21127cac9" (UID: "c1983d12-f3f6-474e-8a1a-aba21127cac9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:37.312599 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312560    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1983d12-f3f6-474e-8a1a-aba21127cac9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c1983d12-f3f6-474e-8a1a-aba21127cac9" (UID: "c1983d12-f3f6-474e-8a1a-aba21127cac9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:49:37.312651 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312621    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c1983d12-f3f6-474e-8a1a-aba21127cac9" (UID: "c1983d12-f3f6-474e-8a1a-aba21127cac9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:37.312651 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312633    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c1983d12-f3f6-474e-8a1a-aba21127cac9" (UID: "c1983d12-f3f6-474e-8a1a-aba21127cac9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:37.312952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312732    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1983d12-f3f6-474e-8a1a-aba21127cac9-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:37.312952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312750    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:37.312952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312763    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:37.312952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312777    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:37.312952 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.312896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c1983d12-f3f6-474e-8a1a-aba21127cac9" (UID: "c1983d12-f3f6-474e-8a1a-aba21127cac9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:37.314566 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.314540    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-token" (OuterVolumeSpecName: "istio-token") pod "c1983d12-f3f6-474e-8a1a-aba21127cac9" (UID: "c1983d12-f3f6-474e-8a1a-aba21127cac9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:49:37.314709 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.314688    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c1983d12-f3f6-474e-8a1a-aba21127cac9" (UID: "c1983d12-f3f6-474e-8a1a-aba21127cac9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:37.314913 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.314896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c1983d12-f3f6-474e-8a1a-aba21127cac9" (UID: "c1983d12-f3f6-474e-8a1a-aba21127cac9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:49:37.315042 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.315017    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-kube-api-access-trlhn" (OuterVolumeSpecName: "kube-api-access-trlhn") pod "c1983d12-f3f6-474e-8a1a-aba21127cac9" (UID: "c1983d12-f3f6-474e-8a1a-aba21127cac9"). InnerVolumeSpecName "kube-api-access-trlhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:49:37.413498 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.413469    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:37.413498 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.413495    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:37.413498 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.413504    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:37.413715 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.413513    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trlhn\" (UniqueName: \"kubernetes.io/projected/c1983d12-f3f6-474e-8a1a-aba21127cac9-kube-api-access-trlhn\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:37.413715 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.413521    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1983d12-f3f6-474e-8a1a-aba21127cac9-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:37.589058 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.589030    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"]
Sep 11 21:49:37.595307 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:37.595282    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f"]
Sep 11 21:49:38.801072 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:38.801035    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" path="/var/lib/kubelet/pods/c1983d12-f3f6-474e-8a1a-aba21127cac9/volumes"
Sep 11 21:49:42.961218 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:42.961181    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"]
Sep 11 21:49:42.961697 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:42.961428    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d" podUID="675b4032-7663-462c-a2e9-c49ede3cfc53" containerName="payload-processing" containerID="cri-o://7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c" gracePeriod=30
Sep 11 21:49:42.971933 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:42.971901    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"]
Sep 11 21:49:42.972531 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:42.972500    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx" podUID="e59bfc09-58a7-4a07-a521-76c9e9d5431e" containerName="payload-pre-processing" containerID="cri-o://569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2" gracePeriod=30
Sep 11 21:49:43.129645 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.129593    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"]
Sep 11 21:49:43.133118 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.133093    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-213a70-5fdxr"]
Sep 11 21:49:43.250214 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.250193    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:49:43.252941 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.252925    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:49:43.325466 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.325281    2560 generic.go:356] "Generic (PLEG): container finished" podID="675b4032-7663-462c-a2e9-c49ede3cfc53" containerID="7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c" exitCode=0
Sep 11 21:49:43.325684 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.325468    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"
Sep 11 21:49:43.325684 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.325464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d" event={"ID":"675b4032-7663-462c-a2e9-c49ede3cfc53","Type":"ContainerDied","Data":"7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c"}
Sep 11 21:49:43.325815 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.325711    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d" event={"ID":"675b4032-7663-462c-a2e9-c49ede3cfc53","Type":"ContainerDied","Data":"b2035a0d8639466dc1df7169a9111e566c370584ae235a98b7a1ff21d9094e91"}
Sep 11 21:49:43.325815 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.325769    2560 scope.go:117] "RemoveContainer" containerID="7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c"
Sep 11 21:49:43.328391 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.328354    2560 generic.go:356] "Generic (PLEG): container finished" podID="e59bfc09-58a7-4a07-a521-76c9e9d5431e" containerID="569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2" exitCode=0
Sep 11 21:49:43.328587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.328389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx" event={"ID":"e59bfc09-58a7-4a07-a521-76c9e9d5431e","Type":"ContainerDied","Data":"569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2"}
Sep 11 21:49:43.328587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.328472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx" event={"ID":"e59bfc09-58a7-4a07-a521-76c9e9d5431e","Type":"ContainerDied","Data":"b8a44c6f6798b95718e80b6b7f7af83d79a4cc9a5db38c683536c4b03a32ca59"}
Sep 11 21:49:43.328587 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.328578    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"
Sep 11 21:49:43.337031 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.337011    2560 scope.go:117] "RemoveContainer" containerID="7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c"
Sep 11 21:49:43.337378 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:49:43.337348    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c\": container with ID starting with 7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c not found: ID does not exist" containerID="7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c"
Sep 11 21:49:43.337481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.337389    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c"} err="failed to get container status \"7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c\": rpc error: code = NotFound desc = could not find container \"7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c\": container with ID starting with 7de7de405f01f13672d1ec53b0c81f1c72c70ce45c8d7d2aca371d95b158503c not found: ID does not exist"
Sep 11 21:49:43.337481 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.337411    2560 scope.go:117] "RemoveContainer" containerID="569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2"
Sep 11 21:49:43.345368 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.345348    2560 scope.go:117] "RemoveContainer" containerID="569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2"
Sep 11 21:49:43.345664 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:49:43.345644    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2\": container with ID starting with 569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2 not found: ID does not exist" containerID="569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2"
Sep 11 21:49:43.345736 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.345672    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2"} err="failed to get container status \"569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2\": rpc error: code = NotFound desc = could not find container \"569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2\": container with ID starting with 569128e28dc99b550d6adaf5e614f9c618eb4ffe075faf66b44a44a46cff55c2 not found: ID does not exist"
Sep 11 21:49:43.370575 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.370554    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e59bfc09-58a7-4a07-a521-76c9e9d5431e-plugins-config-volume\") pod \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\" (UID: \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\") "
Sep 11 21:49:43.370685 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.370593    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjxc9\" (UniqueName: \"kubernetes.io/projected/675b4032-7663-462c-a2e9-c49ede3cfc53-kube-api-access-qjxc9\") pod \"675b4032-7663-462c-a2e9-c49ede3cfc53\" (UID: \"675b4032-7663-462c-a2e9-c49ede3cfc53\") "
Sep 11 21:49:43.370685 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.370667    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjvkm\" (UniqueName: \"kubernetes.io/projected/e59bfc09-58a7-4a07-a521-76c9e9d5431e-kube-api-access-sjvkm\") pod \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\" (UID: \"e59bfc09-58a7-4a07-a521-76c9e9d5431e\") "
Sep 11 21:49:43.370791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.370707    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675b4032-7663-462c-a2e9-c49ede3cfc53-plugins-config-volume\") pod \"675b4032-7663-462c-a2e9-c49ede3cfc53\" (UID: \"675b4032-7663-462c-a2e9-c49ede3cfc53\") "
Sep 11 21:49:43.371076 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.371046    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59bfc09-58a7-4a07-a521-76c9e9d5431e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e59bfc09-58a7-4a07-a521-76c9e9d5431e" (UID: "e59bfc09-58a7-4a07-a521-76c9e9d5431e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:49:43.371157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.371097    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/675b4032-7663-462c-a2e9-c49ede3cfc53-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "675b4032-7663-462c-a2e9-c49ede3cfc53" (UID: "675b4032-7663-462c-a2e9-c49ede3cfc53"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:49:43.372791 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.372772    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675b4032-7663-462c-a2e9-c49ede3cfc53-kube-api-access-qjxc9" (OuterVolumeSpecName: "kube-api-access-qjxc9") pod "675b4032-7663-462c-a2e9-c49ede3cfc53" (UID: "675b4032-7663-462c-a2e9-c49ede3cfc53"). InnerVolumeSpecName "kube-api-access-qjxc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:49:43.372873 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.372851    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59bfc09-58a7-4a07-a521-76c9e9d5431e-kube-api-access-sjvkm" (OuterVolumeSpecName: "kube-api-access-sjvkm") pod "e59bfc09-58a7-4a07-a521-76c9e9d5431e" (UID: "e59bfc09-58a7-4a07-a521-76c9e9d5431e"). InnerVolumeSpecName "kube-api-access-sjvkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:49:43.471711 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.471633    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjvkm\" (UniqueName: \"kubernetes.io/projected/e59bfc09-58a7-4a07-a521-76c9e9d5431e-kube-api-access-sjvkm\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:43.471711 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.471664    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/675b4032-7663-462c-a2e9-c49ede3cfc53-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:43.471711 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.471675    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e59bfc09-58a7-4a07-a521-76c9e9d5431e-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:43.471711 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.471683    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjxc9\" (UniqueName: \"kubernetes.io/projected/675b4032-7663-462c-a2e9-c49ede3cfc53-kube-api-access-qjxc9\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:43.650453 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.650425    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"]
Sep 11 21:49:43.661262 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.661233    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d"]
Sep 11 21:49:43.673279 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.673250    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"]
Sep 11 21:49:43.679541 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:43.679520    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx"]
Sep 11 21:49:44.801151 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:44.801116    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="675b4032-7663-462c-a2e9-c49ede3cfc53" path="/var/lib/kubelet/pods/675b4032-7663-462c-a2e9-c49ede3cfc53/volumes"
Sep 11 21:49:44.801507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:44.801460    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a868bf52-1fbd-41cc-a91a-3f9cd485f547" path="/var/lib/kubelet/pods/a868bf52-1fbd-41cc-a91a-3f9cd485f547/volumes"
Sep 11 21:49:44.801771 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:44.801758    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59bfc09-58a7-4a07-a521-76c9e9d5431e" path="/var/lib/kubelet/pods/e59bfc09-58a7-4a07-a521-76c9e9d5431e/volumes"
Sep 11 21:49:50.094560 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.094509    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"]
Sep 11 21:49:50.094945 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.094930    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="675b4032-7663-462c-a2e9-c49ede3cfc53" containerName="payload-processing"
Sep 11 21:49:50.094996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.094948    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="675b4032-7663-462c-a2e9-c49ede3cfc53" containerName="payload-processing"
Sep 11 21:49:50.094996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.094960    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59bfc09-58a7-4a07-a521-76c9e9d5431e" containerName="payload-pre-processing"
Sep 11 21:49:50.094996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.094966    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59bfc09-58a7-4a07-a521-76c9e9d5431e" containerName="payload-pre-processing"
Sep 11 21:49:50.094996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.094973    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy"
Sep 11 21:49:50.094996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.094979    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy"
Sep 11 21:49:50.094996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.094985    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a868bf52-1fbd-41cc-a91a-3f9cd485f547" containerName="revoke-keys"
Sep 11 21:49:50.094996 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.094992    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a868bf52-1fbd-41cc-a91a-3f9cd485f547" containerName="revoke-keys"
Sep 11 21:49:50.095209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.095006    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy"
Sep 11 21:49:50.095209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.095011    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy"
Sep 11 21:49:50.095209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.095064    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59bfc09-58a7-4a07-a521-76c9e9d5431e" containerName="payload-pre-processing"
Sep 11 21:49:50.095209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.095072    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy"
Sep 11 21:49:50.095209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.095078    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a868bf52-1fbd-41cc-a91a-3f9cd485f547" containerName="revoke-keys"
Sep 11 21:49:50.095209 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.095084    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="675b4032-7663-462c-a2e9-c49ede3cfc53" containerName="payload-processing"
Sep 11 21:49:50.099488 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.099467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"
Sep 11 21:49:50.101775 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.101745    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:49:50.101928 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.101902    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:49:50.106440 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.106416    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"]
Sep 11 21:49:50.237417 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.237382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/231aa202-64dd-444d-81a1-f9d891259fcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt\" (UID: \"231aa202-64dd-444d-81a1-f9d891259fcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"
Sep 11 21:49:50.338901 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.338865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/231aa202-64dd-444d-81a1-f9d891259fcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt\" (UID: \"231aa202-64dd-444d-81a1-f9d891259fcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"
Sep 11 21:49:50.339507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.339488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/231aa202-64dd-444d-81a1-f9d891259fcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt\" (UID: \"231aa202-64dd-444d-81a1-f9d891259fcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"
Sep 11 21:49:50.412318 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.412241    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"
Sep 11 21:49:50.684194 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:50.684170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"]
Sep 11 21:49:50.686605 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:49:50.686572    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231aa202_64dd_444d_81a1_f9d891259fcf.slice/crio-433265cb057d05a5f87f9543661a2ebba8b59c87a87296afc63c555c2926eec7 WatchSource:0}: Error finding container 433265cb057d05a5f87f9543661a2ebba8b59c87a87296afc63c555c2926eec7: Status 404 returned error can't find the container with id 433265cb057d05a5f87f9543661a2ebba8b59c87a87296afc63c555c2926eec7
Sep 11 21:49:51.371696 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:51.371662    2560 generic.go:356] "Generic (PLEG): container finished" podID="231aa202-64dd-444d-81a1-f9d891259fcf" containerID="d1c8b6c49bc728b05444e3c12d288f7595e0eb42c126a55695f7b0a73a5c4297" exitCode=0
Sep 11 21:49:51.372069 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:51.371736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt" event={"ID":"231aa202-64dd-444d-81a1-f9d891259fcf","Type":"ContainerDied","Data":"d1c8b6c49bc728b05444e3c12d288f7595e0eb42c126a55695f7b0a73a5c4297"}
Sep 11 21:49:51.372069 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:51.371791    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt" event={"ID":"231aa202-64dd-444d-81a1-f9d891259fcf","Type":"ContainerStarted","Data":"433265cb057d05a5f87f9543661a2ebba8b59c87a87296afc63c555c2926eec7"}
Sep 11 21:49:52.513498 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:52.513471    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"
Sep 11 21:49:52.662685 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:52.662592    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/231aa202-64dd-444d-81a1-f9d891259fcf-maas-api-service-ca\") pod \"231aa202-64dd-444d-81a1-f9d891259fcf\" (UID: \"231aa202-64dd-444d-81a1-f9d891259fcf\") "
Sep 11 21:49:52.662971 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:52.662949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/231aa202-64dd-444d-81a1-f9d891259fcf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "231aa202-64dd-444d-81a1-f9d891259fcf" (UID: "231aa202-64dd-444d-81a1-f9d891259fcf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:49:52.764399 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:52.764348    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/231aa202-64dd-444d-81a1-f9d891259fcf-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:49:53.383477 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:53.383446    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt" event={"ID":"231aa202-64dd-444d-81a1-f9d891259fcf","Type":"ContainerDied","Data":"433265cb057d05a5f87f9543661a2ebba8b59c87a87296afc63c555c2926eec7"}
Sep 11 21:49:53.383679 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:53.383495    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="433265cb057d05a5f87f9543661a2ebba8b59c87a87296afc63c555c2926eec7"
Sep 11 21:49:53.383679 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:49:53.383461    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"
Sep 11 21:50:00.606784 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:00.606755    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk"]
Sep 11 21:50:00.609629 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:00.609605    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c97420-29819385-2cqtk"]
Sep 11 21:50:00.645164 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:00.645129    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"]
Sep 11 21:50:00.645430 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:00.645370    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr" podUID="82a2412d-8774-4ef0-aa1a-fceaa13bc368" containerName="payload-pre-processing" containerID="cri-o://5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334" gracePeriod=30
Sep 11 21:50:00.801762 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:00.801707    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0375a2ae-5826-4733-8767-cc290068f5ba" path="/var/lib/kubelet/pods/0375a2ae-5826-4733-8767-cc290068f5ba/volumes"
Sep 11 21:50:00.824285 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:00.824261    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"]
Sep 11 21:50:00.827212 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:00.827187    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c97420-zvrdt"]
Sep 11 21:50:00.904299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:00.904276    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:50:01.052022 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.051986    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82a2412d-8774-4ef0-aa1a-fceaa13bc368-plugins-config-volume\") pod \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\" (UID: \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\") "
Sep 11 21:50:01.052230 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.052056    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks9pj\" (UniqueName: \"kubernetes.io/projected/82a2412d-8774-4ef0-aa1a-fceaa13bc368-kube-api-access-ks9pj\") pod \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\" (UID: \"82a2412d-8774-4ef0-aa1a-fceaa13bc368\") "
Sep 11 21:50:01.052427 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.052400    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a2412d-8774-4ef0-aa1a-fceaa13bc368-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82a2412d-8774-4ef0-aa1a-fceaa13bc368" (UID: "82a2412d-8774-4ef0-aa1a-fceaa13bc368"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:50:01.054387 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.054368    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a2412d-8774-4ef0-aa1a-fceaa13bc368-kube-api-access-ks9pj" (OuterVolumeSpecName: "kube-api-access-ks9pj") pod "82a2412d-8774-4ef0-aa1a-fceaa13bc368" (UID: "82a2412d-8774-4ef0-aa1a-fceaa13bc368"). InnerVolumeSpecName "kube-api-access-ks9pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:01.153414 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.153329    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82a2412d-8774-4ef0-aa1a-fceaa13bc368-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:01.153414 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.153360    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks9pj\" (UniqueName: \"kubernetes.io/projected/82a2412d-8774-4ef0-aa1a-fceaa13bc368-kube-api-access-ks9pj\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:01.424007 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.423904    2560 generic.go:356] "Generic (PLEG): container finished" podID="82a2412d-8774-4ef0-aa1a-fceaa13bc368" containerID="5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334" exitCode=0
Sep 11 21:50:01.424007 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.423952    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"
Sep 11 21:50:01.424007 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.423950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr" event={"ID":"82a2412d-8774-4ef0-aa1a-fceaa13bc368","Type":"ContainerDied","Data":"5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334"}
Sep 11 21:50:01.424315 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.424030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr" event={"ID":"82a2412d-8774-4ef0-aa1a-fceaa13bc368","Type":"ContainerDied","Data":"9e503aa2471f943e775937c9d7f788cd32591232df19c98aecb73b031d6d3ac1"}
Sep 11 21:50:01.424315 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.424073    2560 scope.go:117] "RemoveContainer" containerID="5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334"
Sep 11 21:50:01.438117 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.438097    2560 scope.go:117] "RemoveContainer" containerID="5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334"
Sep 11 21:50:01.438448 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:50:01.438429    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334\": container with ID starting with 5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334 not found: ID does not exist" containerID="5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334"
Sep 11 21:50:01.438490 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.438457    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334"} err="failed to get container status \"5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334\": rpc error: code = NotFound desc = could not find container \"5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334\": container with ID starting with 5f170153a99e458787e415c777fea84d3b1769c72e099409a12422c08f3a5334 not found: ID does not exist"
Sep 11 21:50:01.452328 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.452303    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"]
Sep 11 21:50:01.457775 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:01.457751    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr"]
Sep 11 21:50:02.800910 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:02.800877    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231aa202-64dd-444d-81a1-f9d891259fcf" path="/var/lib/kubelet/pods/231aa202-64dd-444d-81a1-f9d891259fcf/volumes"
Sep 11 21:50:02.801299 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:02.801283    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a2412d-8774-4ef0-aa1a-fceaa13bc368" path="/var/lib/kubelet/pods/82a2412d-8774-4ef0-aa1a-fceaa13bc368/volumes"
Sep 11 21:50:07.303001 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.302961    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"]
Sep 11 21:50:07.303555 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.303230    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerName="istio-proxy" containerID="cri-o://f68be4b4fca6f69de17e3c1bee761525e6823ef3d2e42a89a7a175500f730e8a" gracePeriod=30
Sep 11 21:50:07.674300 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.674263    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"]
Sep 11 21:50:07.674620 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.674607    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231aa202-64dd-444d-81a1-f9d891259fcf" containerName="revoke-keys"
Sep 11 21:50:07.674670 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.674621    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="231aa202-64dd-444d-81a1-f9d891259fcf" containerName="revoke-keys"
Sep 11 21:50:07.674670 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.674646    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a2412d-8774-4ef0-aa1a-fceaa13bc368" containerName="payload-pre-processing"
Sep 11 21:50:07.674670 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.674652    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a2412d-8774-4ef0-aa1a-fceaa13bc368" containerName="payload-pre-processing"
Sep 11 21:50:07.674770 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.674706    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="231aa202-64dd-444d-81a1-f9d891259fcf" containerName="revoke-keys"
Sep 11 21:50:07.674770 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.674713    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a2412d-8774-4ef0-aa1a-fceaa13bc368" containerName="payload-pre-processing"
Sep 11 21:50:07.674770 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.674723    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1983d12-f3f6-474e-8a1a-aba21127cac9" containerName="istio-proxy"
Sep 11 21:50:07.678959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.678942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"
Sep 11 21:50:07.681328 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.681300    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:50:07.681444 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.681338    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:50:07.686131 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.686104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"]
Sep 11 21:50:07.715503 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.715478    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faa5f52f-91db-4d57-9215-6851c0e34c7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6\" (UID: \"faa5f52f-91db-4d57-9215-6851c0e34c7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"
Sep 11 21:50:07.816524 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.816492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faa5f52f-91db-4d57-9215-6851c0e34c7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6\" (UID: \"faa5f52f-91db-4d57-9215-6851c0e34c7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"
Sep 11 21:50:07.817181 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.817161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faa5f52f-91db-4d57-9215-6851c0e34c7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6\" (UID: \"faa5f52f-91db-4d57-9215-6851c0e34c7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"
Sep 11 21:50:07.991092 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:07.991004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"
Sep 11 21:50:08.264926 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:08.264853    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"]
Sep 11 21:50:08.267216 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:50:08.267186    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa5f52f_91db_4d57_9215_6851c0e34c7a.slice/crio-6ea13ce107345fdf676c9ad4f532536b4cabde74368536d027d30f844bcd499d WatchSource:0}: Error finding container 6ea13ce107345fdf676c9ad4f532536b4cabde74368536d027d30f844bcd499d: Status 404 returned error can't find the container with id 6ea13ce107345fdf676c9ad4f532536b4cabde74368536d027d30f844bcd499d
Sep 11 21:50:08.464448 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:08.464403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6" event={"ID":"faa5f52f-91db-4d57-9215-6851c0e34c7a","Type":"ContainerStarted","Data":"6ea13ce107345fdf676c9ad4f532536b4cabde74368536d027d30f844bcd499d"}
Sep 11 21:50:09.471767 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:09.471722    2560 generic.go:356] "Generic (PLEG): container finished" podID="faa5f52f-91db-4d57-9215-6851c0e34c7a" containerID="9a321f8e7d06fda16fe5f3fa61cb8741453dad0f60ff3b90ba3c79ca18597fdc" exitCode=0
Sep 11 21:50:09.472232 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:09.471815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6" event={"ID":"faa5f52f-91db-4d57-9215-6851c0e34c7a","Type":"ContainerDied","Data":"9a321f8e7d06fda16fe5f3fa61cb8741453dad0f60ff3b90ba3c79ca18597fdc"}
Sep 11 21:50:10.607408 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:10.607386    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"
Sep 11 21:50:10.643866 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:10.643811    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faa5f52f-91db-4d57-9215-6851c0e34c7a-maas-api-service-ca\") pod \"faa5f52f-91db-4d57-9215-6851c0e34c7a\" (UID: \"faa5f52f-91db-4d57-9215-6851c0e34c7a\") "
Sep 11 21:50:10.644116 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:10.644091    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa5f52f-91db-4d57-9215-6851c0e34c7a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "faa5f52f-91db-4d57-9215-6851c0e34c7a" (UID: "faa5f52f-91db-4d57-9215-6851c0e34c7a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:50:10.644207 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:10.644196    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faa5f52f-91db-4d57-9215-6851c0e34c7a-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:11.484325 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:11.484292    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"
Sep 11 21:50:11.484502 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:11.484338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6" event={"ID":"faa5f52f-91db-4d57-9215-6851c0e34c7a","Type":"ContainerDied","Data":"6ea13ce107345fdf676c9ad4f532536b4cabde74368536d027d30f844bcd499d"}
Sep 11 21:50:11.484502 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:11.484381    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ea13ce107345fdf676c9ad4f532536b4cabde74368536d027d30f844bcd499d"
Sep 11 21:50:12.494073 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.494041    2560 generic.go:356] "Generic (PLEG): container finished" podID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerID="f68be4b4fca6f69de17e3c1bee761525e6823ef3d2e42a89a7a175500f730e8a" exitCode=0
Sep 11 21:50:12.494436 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.494073    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" event={"ID":"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9","Type":"ContainerDied","Data":"f68be4b4fca6f69de17e3c1bee761525e6823ef3d2e42a89a7a175500f730e8a"}
Sep 11 21:50:12.494436 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.494138    2560 scope.go:117] "RemoveContainer" containerID="2d3f997b71e9514c14ab74ec0161ace3da0f669ed2e28e86a2ef7864ab50bfe1"
Sep 11 21:50:12.553337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.553308    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:50:12.663408 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663334    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istiod-ca-cert\") pod \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") "
Sep 11 21:50:12.663408 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663401    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-data\") pod \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") "
Sep 11 21:50:12.663629 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663431    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-credential-socket\") pod \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") "
Sep 11 21:50:12.663629 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663460    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-podinfo\") pod \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") "
Sep 11 21:50:12.663629 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663509    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-token\") pod \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") "
Sep 11 21:50:12.663629 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663532    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5dbt\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-kube-api-access-c5dbt\") pod \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") "
Sep 11 21:50:12.663629 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663596    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-socket\") pod \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") "
Sep 11 21:50:12.663629 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663625    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-envoy\") pod \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") "
Sep 11 21:50:12.663955 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663673    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-certs\") pod \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\" (UID: \"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9\") "
Sep 11 21:50:12.663955 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663786    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-data" (OuterVolumeSpecName: "istio-data") pod "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" (UID: "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:12.663955 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663803    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" (UID: "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:12.663955 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663854    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" (UID: "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:50:12.664118 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.664054    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" (UID: "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:12.664118 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.664075    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:12.664118 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.664094    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:12.664118 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.663995    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" (UID: "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:12.664805 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.664108    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:12.672368 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.666610    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" (UID: "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:50:12.672368 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.666922    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" (UID: "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:12.672368 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.666937    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-kube-api-access-c5dbt" (OuterVolumeSpecName: "kube-api-access-c5dbt") pod "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" (UID: "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9"). InnerVolumeSpecName "kube-api-access-c5dbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:12.672579 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.672421    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-token" (OuterVolumeSpecName: "istio-token") pod "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" (UID: "57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:12.765689 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.765657    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:12.765689 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.765685    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:12.765689 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.765694    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:12.765940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.765701    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:12.765940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.765709    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:12.765940 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:12.765717    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5dbt\" (UniqueName: \"kubernetes.io/projected/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9-kube-api-access-c5dbt\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:13.500288 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:13.500260    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"
Sep 11 21:50:13.500755 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:13.500291    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj" event={"ID":"57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9","Type":"ContainerDied","Data":"8c940159e84890285695947270d3cac13e8d7c399f3ff553e95a960125c93b80"}
Sep 11 21:50:13.500755 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:13.500343    2560 scope.go:117] "RemoveContainer" containerID="f68be4b4fca6f69de17e3c1bee761525e6823ef3d2e42a89a7a175500f730e8a"
Sep 11 21:50:13.519257 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:13.519209    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"]
Sep 11 21:50:13.520967 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:13.520947    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj"]
Sep 11 21:50:14.801328 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:14.801294    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" path="/var/lib/kubelet/pods/57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9/volumes"
Sep 11 21:50:18.251749 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:18.251717    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g"]
Sep 11 21:50:18.257309 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:18.257200    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0c211-29819385-l2d2g"]
Sep 11 21:50:18.469580 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:18.469519    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"]
Sep 11 21:50:18.471162 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:18.471142    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e0c211-7lwv6"]
Sep 11 21:50:18.800896 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:18.800846    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641" path="/var/lib/kubelet/pods/6bd4ec68-34bf-4a96-bd5d-9c8d7bdf0641/volumes"
Sep 11 21:50:18.801198 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:18.801184    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faa5f52f-91db-4d57-9215-6851c0e34c7a" path="/var/lib/kubelet/pods/faa5f52f-91db-4d57-9215-6851c0e34c7a/volumes"
Sep 11 21:50:25.188406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:25.188362    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"]
Sep 11 21:50:25.188942 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:25.188623    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy" containerID="cri-o://8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a" gracePeriod=30
Sep 11 21:50:30.442681 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.442655    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:50:30.528920 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.528811    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-envoy\") pod \"f449085b-6e33-492c-b439-c4a4c592ef56\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") "
Sep 11 21:50:30.528920 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.528882    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449085b-6e33-492c-b439-c4a4c592ef56-istiod-ca-cert\") pod \"f449085b-6e33-492c-b439-c4a4c592ef56\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") "
Sep 11 21:50:30.529157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.528924    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-socket\") pod \"f449085b-6e33-492c-b439-c4a4c592ef56\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") "
Sep 11 21:50:30.529157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.528971    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-data\") pod \"f449085b-6e33-492c-b439-c4a4c592ef56\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") "
Sep 11 21:50:30.529157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.528996    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-istio-token\") pod \"f449085b-6e33-492c-b439-c4a4c592ef56\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") "
Sep 11 21:50:30.529157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529025    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-credential-socket\") pod \"f449085b-6e33-492c-b439-c4a4c592ef56\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") "
Sep 11 21:50:30.529157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x858b\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-kube-api-access-x858b\") pod \"f449085b-6e33-492c-b439-c4a4c592ef56\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") "
Sep 11 21:50:30.529157 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529142    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449085b-6e33-492c-b439-c4a4c592ef56-istio-podinfo\") pod \"f449085b-6e33-492c-b439-c4a4c592ef56\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") "
Sep 11 21:50:30.529451 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-certs\") pod \"f449085b-6e33-492c-b439-c4a4c592ef56\" (UID: \"f449085b-6e33-492c-b439-c4a4c592ef56\") "
Sep 11 21:50:30.529451 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529312    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-data" (OuterVolumeSpecName: "istio-data") pod "f449085b-6e33-492c-b439-c4a4c592ef56" (UID: "f449085b-6e33-492c-b439-c4a4c592ef56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:30.529451 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f449085b-6e33-492c-b439-c4a4c592ef56" (UID: "f449085b-6e33-492c-b439-c4a4c592ef56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:30.529610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529539    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f449085b-6e33-492c-b439-c4a4c592ef56" (UID: "f449085b-6e33-492c-b439-c4a4c592ef56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:30.529610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529583    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.529610 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529603    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.529771 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.529625    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f449085b-6e33-492c-b439-c4a4c592ef56" (UID: "f449085b-6e33-492c-b439-c4a4c592ef56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:30.530056 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.530030    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f449085b-6e33-492c-b439-c4a4c592ef56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f449085b-6e33-492c-b439-c4a4c592ef56" (UID: "f449085b-6e33-492c-b439-c4a4c592ef56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:50:30.531810 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.531772    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f449085b-6e33-492c-b439-c4a4c592ef56" (UID: "f449085b-6e33-492c-b439-c4a4c592ef56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:50:30.531937 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.531892    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-istio-token" (OuterVolumeSpecName: "istio-token") pod "f449085b-6e33-492c-b439-c4a4c592ef56" (UID: "f449085b-6e33-492c-b439-c4a4c592ef56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:30.532132 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.532100    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-kube-api-access-x858b" (OuterVolumeSpecName: "kube-api-access-x858b") pod "f449085b-6e33-492c-b439-c4a4c592ef56" (UID: "f449085b-6e33-492c-b439-c4a4c592ef56"). InnerVolumeSpecName "kube-api-access-x858b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:30.532401 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.532384    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f449085b-6e33-492c-b439-c4a4c592ef56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f449085b-6e33-492c-b439-c4a4c592ef56" (UID: "f449085b-6e33-492c-b439-c4a4c592ef56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:50:30.587579 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.587546    2560 generic.go:356] "Generic (PLEG): container finished" podID="f449085b-6e33-492c-b439-c4a4c592ef56" containerID="8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a" exitCode=0
Sep 11 21:50:30.587738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.587608    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"
Sep 11 21:50:30.587738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.587625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" event={"ID":"f449085b-6e33-492c-b439-c4a4c592ef56","Type":"ContainerDied","Data":"8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a"}
Sep 11 21:50:30.587738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.587676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g" event={"ID":"f449085b-6e33-492c-b439-c4a4c592ef56","Type":"ContainerDied","Data":"1c0eeee25b5712454f9a255e1fee2b55ed6eced1b53ac96f8c590c17301feccd"}
Sep 11 21:50:30.587738 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.587697    2560 scope.go:117] "RemoveContainer" containerID="8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a"
Sep 11 21:50:30.610217 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.610189    2560 scope.go:117] "RemoveContainer" containerID="e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86"
Sep 11 21:50:30.620572 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.620550    2560 scope.go:117] "RemoveContainer" containerID="8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a"
Sep 11 21:50:30.621365 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:50:30.621334    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a\": container with ID starting with 8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a not found: ID does not exist" containerID="8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a"
Sep 11 21:50:30.621482 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.621376    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a"} err="failed to get container status \"8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a\": rpc error: code = NotFound desc = could not find container \"8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a\": container with ID starting with 8d15d98c49b55003b9e71d8b3d8f7d9d0c58ff36967bfe21c6a647273697773a not found: ID does not exist"
Sep 11 21:50:30.621482 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.621401    2560 scope.go:117] "RemoveContainer" containerID="e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86"
Sep 11 21:50:30.621749 ip-10-0-141-71 kubenswrapper[2560]: E0911 21:50:30.621723    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86\": container with ID starting with e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86 not found: ID does not exist" containerID="e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86"
Sep 11 21:50:30.621889 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.621760    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86"} err="failed to get container status \"e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86\": rpc error: code = NotFound desc = could not find container \"e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86\": container with ID starting with e4642ea2076902ecf6771cb0eb8c6996f96bbd3f663f59b132b31d6f64184f86 not found: ID does not exist"
Sep 11 21:50:30.621970 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.621809    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"]
Sep 11 21:50:30.623581 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.623559    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g"]
Sep 11 21:50:30.630392 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.630363    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.630507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.630395    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.630507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.630411    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x858b\" (UniqueName: \"kubernetes.io/projected/f449085b-6e33-492c-b439-c4a4c592ef56-kube-api-access-x858b\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.630507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.630426    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449085b-6e33-492c-b439-c4a4c592ef56-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.630507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.630439    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.630507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.630452    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449085b-6e33-492c-b439-c4a4c592ef56-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.630507 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.630464    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449085b-6e33-492c-b439-c4a4c592ef56-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.801802 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:50:30.801706    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" path="/var/lib/kubelet/pods/f449085b-6e33-492c-b439-c4a4c592ef56/volumes"
Sep 11 21:51:23.311113 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:51:23.311084    2560 scope.go:117] "RemoveContainer" containerID="e82d34643b53fe453fb789c7251f2e63c55a41b7f08ff7079326138791e18624"
Sep 11 21:51:23.319588 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:51:23.319570    2560 scope.go:117] "RemoveContainer" containerID="ad1208bf2cc5655c6e4842a70abefb1b0e7184685e0bc1a60dbb548ecb562a47"
Sep 11 21:54:23.359378 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:54:23.359345    2560 scope.go:117] "RemoveContainer" containerID="a627b113061ed00c2e47def6ad3a26afe7d0462027ecd0fab4c8e5bc87431495"
Sep 11 21:54:23.367601 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:54:23.367581    2560 scope.go:117] "RemoveContainer" containerID="adf668ab9b730171a5bf2410edbc87042028759baf3c19455f13b1c698fdb1b7"
Sep 11 21:55:50.369085 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:50.369051    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l6j54_551f8cb3-0301-45e8-b920-4c24eda7cc52/server/0.log"
Sep 11 21:55:50.499069 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:50.499041    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9v5pk_ed95ac20-0932-4d0c-b239-d15adfd8dfb2/manager/0.log"
Sep 11 21:55:50.867070 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:50.867043    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b6c4779-sfgch_78158658-1724-4cde-a29f-4e64223f3394/copy-manifests/0.log"
Sep 11 21:55:50.874881 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:50.874852    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b6c4779-sfgch_78158658-1724-4cde-a29f-4e64223f3394/manager/0.log"
Sep 11 21:55:53.733740 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:53.733686    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tnjdk_1773d242-8378-4e91-bd0b-e8eb4112da5a/discovery/0.log"
Sep 11 21:55:54.092810 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:54.092783    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2gf9z_873fa006-b769-42b7-b0ad-c16cdbbb700e/istio-proxy/1.log"
Sep 11 21:55:54.339358 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:54.339310    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-57lf9_1a607fc6-8797-4685-82f6-64490c7d4822/payload-processing/0.log"
Sep 11 21:55:54.460406 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:54.460311    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c84486586-ftqpb_f9438a19-93f7-48fd-9df3-c66553af78c5/router/0.log"
Sep 11 21:55:54.798936 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:54.798849    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mcqww_7e423e51-d2c5-449f-b48e-9ae54c953d3e/main/0.log"
Sep 11 21:55:55.160760 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:55.160734    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7p2cz_1a05ec59-3a14-4030-ae0b-9163c4ca78bb/main/0.log"
Sep 11 21:55:55.399698 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:55:55.399670    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4z4sr_8a858d55-d6cc-4201-8f5e-f884b32d1f7f/main/0.log"
Sep 11 21:56:03.675731 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:03.675693    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-whrjq_dfaf9e9b-b15a-4b42-a4f5-f3668577ebb8/global-pull-secret-syncer/0.log"
Sep 11 21:56:03.770166 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:03.770134    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gcfz6_5070b1d6-abf9-462c-b660-e9782f95bc35/konnectivity-agent/0.log"
Sep 11 21:56:03.879337 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:03.879302    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-71.ec2.internal_b773acae9b26ce935d4f41dd9b33839a/haproxy/0.log"
Sep 11 21:56:11.270087 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.270052    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w9nrz_2fd48e5d-9f4b-4458-9ad2-7836033df16e/node-exporter/0.log"
Sep 11 21:56:11.288225 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.288195    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w9nrz_2fd48e5d-9f4b-4458-9ad2-7836033df16e/kube-rbac-proxy/0.log"
Sep 11 21:56:11.306812 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.306791    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w9nrz_2fd48e5d-9f4b-4458-9ad2-7836033df16e/init-textfile/0.log"
Sep 11 21:56:11.490407 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.490382    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8b1a56be-033f-4e3c-bc98-b98d238379bd/prometheus/0.log"
Sep 11 21:56:11.513554 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.513530    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8b1a56be-033f-4e3c-bc98-b98d238379bd/config-reloader/0.log"
Sep 11 21:56:11.533648 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.533624    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8b1a56be-033f-4e3c-bc98-b98d238379bd/thanos-sidecar/0.log"
Sep 11 21:56:11.556471 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.556447    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8b1a56be-033f-4e3c-bc98-b98d238379bd/kube-rbac-proxy-web/0.log"
Sep 11 21:56:11.572458 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.572418    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8b1a56be-033f-4e3c-bc98-b98d238379bd/kube-rbac-proxy/0.log"
Sep 11 21:56:11.597497 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.597474    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8b1a56be-033f-4e3c-bc98-b98d238379bd/kube-rbac-proxy-thanos/0.log"
Sep 11 21:56:11.617204 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:11.617176    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8b1a56be-033f-4e3c-bc98-b98d238379bd/init-config-reloader/0.log"
Sep 11 21:56:13.798671 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.798591    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"]
Sep 11 21:56:13.799043 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799012    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerName="istio-proxy"
Sep 11 21:56:13.799043 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799026    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerName="istio-proxy"
Sep 11 21:56:13.799043 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799037    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy"
Sep 11 21:56:13.799043 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799042    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy"
Sep 11 21:56:13.799177 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799061    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faa5f52f-91db-4d57-9215-6851c0e34c7a" containerName="revoke-keys"
Sep 11 21:56:13.799177 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799067    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="faa5f52f-91db-4d57-9215-6851c0e34c7a" containerName="revoke-keys"
Sep 11 21:56:13.799177 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799122    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ae4a4c-5ea8-45ca-881f-30a6e5f38cc9" containerName="istio-proxy"
Sep 11 21:56:13.799177 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799131    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy"
Sep 11 21:56:13.799177 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799138    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f449085b-6e33-492c-b439-c4a4c592ef56" containerName="istio-proxy"
Sep 11 21:56:13.799177 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.799144    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="faa5f52f-91db-4d57-9215-6851c0e34c7a" containerName="revoke-keys"
Sep 11 21:56:13.802247 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.802228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.804577 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.804552    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xhtjn\"/\"openshift-service-ca.crt\""
Sep 11 21:56:13.804739 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.804564    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xhtjn\"/\"kube-root-ca.crt\""
Sep 11 21:56:13.804946 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.804930    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xhtjn\"/\"default-dockercfg-8csvh\""
Sep 11 21:56:13.808964 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.808939    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"]
Sep 11 21:56:13.857501 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.857473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-proc\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.857627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.857507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-sys\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.857627 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.857531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-podres\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.857716 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.857622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-lib-modules\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.857716 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.857661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7gvb\" (UniqueName: \"kubernetes.io/projected/9c9b237e-88a6-467e-a95f-491a16462541-kube-api-access-p7gvb\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.958691 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.958657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-proc\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.958691 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.958697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-sys\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.958924 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.958722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-podres\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.958924 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.958762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-lib-modules\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.958924 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.958785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-proc\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.958924 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.958795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7gvb\" (UniqueName: \"kubernetes.io/projected/9c9b237e-88a6-467e-a95f-491a16462541-kube-api-access-p7gvb\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.958924 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.958787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-sys\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.958924 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.958887    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-podres\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.958924 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.958909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c9b237e-88a6-467e-a95f-491a16462541-lib-modules\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:13.966191 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:13.966171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7gvb\" (UniqueName: \"kubernetes.io/projected/9c9b237e-88a6-467e-a95f-491a16462541-kube-api-access-p7gvb\") pod \"perf-node-gather-daemonset-r52v9\" (UID: \"9c9b237e-88a6-467e-a95f-491a16462541\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:14.112743 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:14.112709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:14.307400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:14.307370    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d45d994bf-nxmvd_7a490a76-914c-46ca-a890-bf835610ba19/console/0.log"
Sep 11 21:56:14.382772 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:14.382749    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"]
Sep 11 21:56:14.385243 ip-10-0-141-71 kubenswrapper[2560]: W0911 21:56:14.385215    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9c9b237e_88a6_467e_a95f_491a16462541.slice/crio-05eb69cf2b252b1993eb31470a2e16a49f318498e9de18bfd0d62533f7504542 WatchSource:0}: Error finding container 05eb69cf2b252b1993eb31470a2e16a49f318498e9de18bfd0d62533f7504542: Status 404 returned error can't find the container with id 05eb69cf2b252b1993eb31470a2e16a49f318498e9de18bfd0d62533f7504542
Sep 11 21:56:14.984666 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:14.984585    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-mw7lc_d73935be-b82e-4e10-a9c1-167e9a48a2a4/volume-data-source-validator/0.log"
Sep 11 21:56:15.225750 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:15.225720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9" event={"ID":"9c9b237e-88a6-467e-a95f-491a16462541","Type":"ContainerStarted","Data":"678cc078919172b1262b2345e6d9ecd5c0050339ad6fe7f4620c201de7d06937"}
Sep 11 21:56:15.225959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:15.225767    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9" event={"ID":"9c9b237e-88a6-467e-a95f-491a16462541","Type":"ContainerStarted","Data":"05eb69cf2b252b1993eb31470a2e16a49f318498e9de18bfd0d62533f7504542"}
Sep 11 21:56:15.225959 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:15.225950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:15.241349 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:15.241253    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9" podStartSLOduration=2.24123719 podStartE2EDuration="2.24123719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:56:15.239766752 +0000 UTC m=+2332.952426802" watchObservedRunningTime="2026-09-11 21:56:15.24123719 +0000 UTC m=+2332.953897240"
Sep 11 21:56:16.064099 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:16.064061    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9dfl7_0e67c3c0-b167-4c88-add1-1a8fbe2d2845/dns/0.log"
Sep 11 21:56:16.083251 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:16.083230    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9dfl7_0e67c3c0-b167-4c88-add1-1a8fbe2d2845/kube-rbac-proxy/0.log"
Sep 11 21:56:16.221052 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:16.221020    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qkfqp_8bcbacb0-e371-4960-b618-9b05daf4fdcf/dns-node-resolver/0.log"
Sep 11 21:56:16.831466 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:16.831440    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lr2nj_3e7d3f47-930d-4f95-9876-9d672acd1f17/node-ca/0.log"
Sep 11 21:56:18.481140 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:18.481107    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tnjdk_1773d242-8378-4e91-bd0b-e8eb4112da5a/discovery/0.log"
Sep 11 21:56:18.704400 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:18.704371    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2gf9z_873fa006-b769-42b7-b0ad-c16cdbbb700e/istio-proxy/0.log"
Sep 11 21:56:18.708588 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:18.708555    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2gf9z_873fa006-b769-42b7-b0ad-c16cdbbb700e/istio-proxy/1.log"
Sep 11 21:56:18.805185 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:18.805109    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-57lf9_1a607fc6-8797-4685-82f6-64490c7d4822/payload-processing/0.log"
Sep 11 21:56:18.833115 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:18.833082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c84486586-ftqpb_f9438a19-93f7-48fd-9df3-c66553af78c5/router/0.log"
Sep 11 21:56:19.752956 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:19.752923    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hv7xh_f36bed74-6b22-4866-92d5-8fd4bda70bfd/serve-healthcheck-canary/0.log"
Sep 11 21:56:20.263295 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:20.263260    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-tzww9_029205bf-1e5e-4119-8a62-bb2640d621fb/insights-operator/0.log"
Sep 11 21:56:20.264451 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:20.264428    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-tzww9_029205bf-1e5e-4119-8a62-bb2640d621fb/insights-operator/1.log"
Sep 11 21:56:20.284788 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:20.284751    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dcth4_23aa2db7-4415-413d-9e4e-e9fe5556ba2f/kube-rbac-proxy/0.log"
Sep 11 21:56:20.303324 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:20.303299    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dcth4_23aa2db7-4415-413d-9e4e-e9fe5556ba2f/exporter/0.log"
Sep 11 21:56:20.328365 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:20.328342    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dcth4_23aa2db7-4415-413d-9e4e-e9fe5556ba2f/extractor/0.log"
Sep 11 21:56:21.240703 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:21.240675    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-r52v9"
Sep 11 21:56:23.106420 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:23.106393    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l6j54_551f8cb3-0301-45e8-b920-4c24eda7cc52/server/0.log"
Sep 11 21:56:23.258765 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:23.258678    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9v5pk_ed95ac20-0932-4d0c-b239-d15adfd8dfb2/manager/0.log"
Sep 11 21:56:23.398355 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:23.398321    2560 scope.go:117] "RemoveContainer" containerID="9a321f8e7d06fda16fe5f3fa61cb8741453dad0f60ff3b90ba3c79ca18597fdc"
Sep 11 21:56:23.407740 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:23.407720    2560 scope.go:117] "RemoveContainer" containerID="58b86300bf45bde60b0e99acec1a86566f525d40fd3eac4e95d7bdf4cfbfc8b0"
Sep 11 21:56:23.415614 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:23.415596    2560 scope.go:117] "RemoveContainer" containerID="d1c8b6c49bc728b05444e3c12d288f7595e0eb42c126a55695f7b0a73a5c4297"
Sep 11 21:56:23.427868 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:23.427844    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b6c4779-sfgch_78158658-1724-4cde-a29f-4e64223f3394/manager/0.log"
Sep 11 21:56:23.449211 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:23.449194    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b6c4779-sfgch_78158658-1724-4cde-a29f-4e64223f3394/copy-manifests/0.log"
Sep 11 21:56:24.710162 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:24.710134    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77b49fdcf4-vmwp4_ea681fc0-194b-4cd9-aaed-f0750c896f22/manager/0.log"
Sep 11 21:56:25.088065 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:25.088028    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tnjdk_1773d242-8378-4e91-bd0b-e8eb4112da5a/discovery/0.log"
Sep 11 21:56:25.136755 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:25.136728    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2gf9z_873fa006-b769-42b7-b0ad-c16cdbbb700e/istio-proxy/0.log"
Sep 11 21:56:25.141573 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:25.141541    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2gf9z_873fa006-b769-42b7-b0ad-c16cdbbb700e/istio-proxy/1.log"
Sep 11 21:56:25.200093 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:25.200065    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-57lf9_1a607fc6-8797-4685-82f6-64490c7d4822/payload-processing/0.log"
Sep 11 21:56:25.214595 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:25.214561    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c84486586-ftqpb_f9438a19-93f7-48fd-9df3-c66553af78c5/router/0.log"
Sep 11 21:56:27.550794 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:27.550758    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tnjdk_1773d242-8378-4e91-bd0b-e8eb4112da5a/discovery/0.log"
Sep 11 21:56:27.610801 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:27.610772    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2gf9z_873fa006-b769-42b7-b0ad-c16cdbbb700e/istio-proxy/0.log"
Sep 11 21:56:27.616190 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:27.616165    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-2gf9z_873fa006-b769-42b7-b0ad-c16cdbbb700e/istio-proxy/1.log"
Sep 11 21:56:27.673563 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:27.673534    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-57lf9_1a607fc6-8797-4685-82f6-64490c7d4822/payload-processing/0.log"
Sep 11 21:56:27.689845 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:27.689796    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c84486586-ftqpb_f9438a19-93f7-48fd-9df3-c66553af78c5/router/0.log"
Sep 11 21:56:30.261981 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:30.261891    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-gd94x_eb9db64c-af22-4710-8074-5af2ac0687d3/kube-storage-version-migrator-operator/1.log"
Sep 11 21:56:30.263815 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:30.263784    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-gd94x_eb9db64c-af22-4710-8074-5af2ac0687d3/kube-storage-version-migrator-operator/0.log"
Sep 11 21:56:31.335408 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:31.335379    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-225cz_17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf/kube-multus-additional-cni-plugins/0.log"
Sep 11 21:56:31.354709 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:31.354684    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-225cz_17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf/egress-router-binary-copy/0.log"
Sep 11 21:56:31.374226 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:31.374205    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-225cz_17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf/cni-plugins/0.log"
Sep 11 21:56:31.394878 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:31.394850    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-225cz_17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf/bond-cni-plugin/0.log"
Sep 11 21:56:31.414817 ip-10-0-141-71 kubenswrapper[2560]: I0911 21:56:31.414790    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-225cz_17e9f537-7cf5-4aa8-b5aa-63a5fcb631cf/routeoverride-cni/0.log"