Sep 15 09:04:47.716690 ip-10-0-140-124 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 15 09:04:47.716706 ip-10-0-140-124 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 15 09:04:47.716716 ip-10-0-140-124 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 15 09:04:47.717021 ip-10-0-140-124 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 15 09:04:57.754695 ip-10-0-140-124 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 15 09:04:57.754714 ip-10-0-140-124 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 96f5ab5e9705434a97d01d1fcbc7aacb --
Sep 15 09:06:52.296167 ip-10-0-140-124 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 09:06:52.667205 ip-10-0-140-124 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:06:52.667205 ip-10-0-140-124 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 09:06:52.667205 ip-10-0-140-124 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:06:52.667205 ip-10-0-140-124 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 09:06:52.667205 ip-10-0-140-124 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:06:52.668209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.668114    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 09:06:52.671272 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671256    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:06:52.671272 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671272    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671276    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671280    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671283    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671286    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671294    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671297    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671300    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671303    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671306    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671308    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671311    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671315    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671319    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671322    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671325    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671328    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671330    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671333    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:06:52.671342 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671335    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671338    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671341    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671344    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671347    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671350    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671353    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671355    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671358    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671360    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671363    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671365    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671368    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671370    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671373    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671376    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671380    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671384    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671388    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:06:52.671790 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671390    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671393    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671396    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671399    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671401    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671404    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671408    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671411    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671414    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671417    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671419    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671422    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671425    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671427    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671430    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671433    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671436    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671439    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671441    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671445    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:06:52.672268 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671447    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671450    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671453    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671455    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671458    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671461    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671464    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671466    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671468    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671471    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671473    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671476    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671479    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671481    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671484    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671486    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671489    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671491    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671494    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671496    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:06:52.672751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671498    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671501    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671503    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671506    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671508    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671511    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671514    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671517    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671520    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671523    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671525    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671528    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671530    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671533    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671535    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671538    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671541    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671543    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671545    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.671548    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:06:52.673289 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672245    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672252    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672255    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672257    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672260    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672263    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672267    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672270    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672272    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672275    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672278    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672281    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672284    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672287    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672289    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672292    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672295    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672297    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672300    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:06:52.673776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672305    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672308    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672310    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672313    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672316    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672318    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672321    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672325    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672329    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672332    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672335    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672338    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672341    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672344    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672347    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672350    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672353    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672356    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672359    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:06:52.674267 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672364    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672367    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672371    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672374    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672377    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672380    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672383    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672386    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672389    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672393    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672397    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672399    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672402    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672405    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672408    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672411    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672413    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672416    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672419    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:06:52.674726 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672421    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672424    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672426    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672429    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672431    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672434    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672437    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672440    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672443    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672445    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672448    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672451    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672454    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672457    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672460    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672463    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672466    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672468    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672471    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672474    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:06:52.675203 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672476    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672479    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672481    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672484    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672487    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672489    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672492    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672494    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672497    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672499    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672502    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672505    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672507    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672510    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672512    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672515    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672517    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672520    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672523    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672526    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:06:52.675699 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672528    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672531    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672931    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672938    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672942    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672945    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672949    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672952    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672955    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672958    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672961    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672964    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672967    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672970    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672973    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672975    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672978    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672980    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672983    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:06:52.676199 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672988    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672991    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672994    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672997    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.672999    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673002    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673005    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673007    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673010    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673012    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673015    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673018    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673021    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673023    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673026    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673029    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673031    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673036    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673039    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:06:52.676665 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673042    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673051    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673054    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673056    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673059    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673062    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673064    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673067    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673076    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673079    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673081    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673084    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673087    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673089    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673092    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673094    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673097    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673100    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673102    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673104    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:06:52.677145 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673107    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673109    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673112    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673114    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673121    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673123    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673126    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673128    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673132    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673135    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673137    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673140    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673142    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673145    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673154    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673157    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673160    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673162    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673167    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673171    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:06:52.677620 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673174    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673177    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673180    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673182    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673185    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673187    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673190    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673192    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673195    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673197    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673200    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673202    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673205    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673207    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673210    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673212    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673216    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673219    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673221    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673224    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:06:52.678158 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673227    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673230    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.673232    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673309    2555 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673342    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673347    2555 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673352    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673362    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673365    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673369    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673374    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673377    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673380    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673383    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673387    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673390    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673393    2555 flags.go:64] FLAG: --cgroup-root=""
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673396    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673399    2555 flags.go:64] FLAG: --client-ca-file=""
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673402    2555 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673405    2555 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673412    2555 flags.go:64] FLAG: --cluster-domain=""
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673414    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 09:06:52.678660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673418    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673421    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673424    2555 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673428    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673431    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673435    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673438    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673441    2555 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673444    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673448    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673451    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673454    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673458    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673461    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673464    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673467    2555 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673469    2555 flags.go:64] FLAG: --enable-server="true"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673480    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673486    2555 flags.go:64] FLAG: --event-burst="100"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673489    2555 flags.go:64] FLAG: --event-qps="50"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673492    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673495    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673498    2555 flags.go:64] FLAG: --eviction-hard=""
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673502    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 09:06:52.679209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673505    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673508    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673511    2555 flags.go:64] FLAG: --eviction-soft=""
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673514    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673517    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673520    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673523    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673526    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673529    2555 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673532    2555 flags.go:64] FLAG: --feature-gates=""
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673535    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673538    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673541    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673546    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673549    2555 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673552    2555 flags.go:64] FLAG: --help="false"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673555    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-140-124.ec2.internal"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673560    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673563    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673566    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673569    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673572    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673575    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 09:06:52.679782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673578    2555 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673581    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673583    2555 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673592    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673595    2555 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673598    2555 flags.go:64] FLAG: --kube-reserved=""
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673601    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673604    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673607    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673610    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673613    2555 flags.go:64] FLAG: --lock-file=""
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673615    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673618    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673621    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673626    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673629    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673632    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673635    2555 flags.go:64] FLAG: --logging-format="text"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673638    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673641    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673644    2555 flags.go:64] FLAG: --manifest-url=""
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673647    2555 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673652    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673655    2555 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673663    2555 flags.go:64] FLAG: --max-pods="110"
Sep 15 09:06:52.680386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673666    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673670    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673673    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673676    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673679    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673682    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673685    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673698    2555 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673701    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673704    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673707    2555 flags.go:64] FLAG: --pod-cidr=""
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673716    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673721    2555 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673724    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673727    2555 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673730    2555 flags.go:64] FLAG: --port="10250"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673733    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673736    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dd048277cb3d889f"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673740    2555 flags.go:64] FLAG: --qos-reserved=""
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673743    2555 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673746    2555 flags.go:64] FLAG: --register-node="true"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673749    2555 flags.go:64] FLAG: --register-with-taints=""
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673752    2555 flags.go:64] FLAG: --registry-burst="10"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673755    2555 flags.go:64] FLAG: --registry-qps="5"
Sep 15 09:06:52.681063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673758    2555 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673761    2555 flags.go:64] FLAG: --reserved-memory=""
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673765    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673768    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673771    2555 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673773    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673778    2555 flags.go:64] FLAG: --runonce="false"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673781    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673784    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673788    2555 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673791    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673794    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673797    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673800    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673803    2555 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673806    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673809    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673812    2555 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673815    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673818    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673826    2555 flags.go:64] FLAG: --system-cgroups=""
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673830    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673835    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673838    2555 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673841    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 09:06:52.681696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673863    2555 flags.go:64] FLAG: --tls-min-version=""
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673865    2555 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673868    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673871    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673874    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673877    2555 flags.go:64] FLAG: --v="2"
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673881    2555 flags.go:64] FLAG: --version="false"
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673885    2555 flags.go:64] FLAG: --vmodule=""
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673889    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.673892    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674034    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674038    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674041    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674045    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674048    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674051    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674057    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674060    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674063    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674066    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674069    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:06:52.682327 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674072    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674075    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674078    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674081    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674084    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674087    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674089    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674097    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674100    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674102    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674106    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674111    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674115    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674119    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674121    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674124    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674127    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674130    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674132    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674135    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:06:52.682836 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674137    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674140    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674142    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674145    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674148    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674151    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674154    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674158    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674161    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674163    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674166    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674169    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674172    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674174    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674177    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674179    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674182    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674185    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674187    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674190    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:06:52.683334 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674198    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674201    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674204    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674206    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674209    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674211    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674214    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674217    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674219    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674222    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674224    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674227    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674230    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674232    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674235    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674238    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674242    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674244    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674247    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674251    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:06:52.683820 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674253    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674256    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674258    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674261    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674263    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674266    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674270    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674273    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674277    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674279    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674282    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674285    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674287    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674295    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674298    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674301    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674305    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674308    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:06:52.684617 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674311    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674314    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674316    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674319    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674321    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674324    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674327    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674329    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674332    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.674334    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.674795    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.682252    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.682271    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.683072    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.683079    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 09:06:52.685510 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683137    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683142    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683146    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683150    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683153    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683155    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683158    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683161    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683163    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683166    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683169    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683172    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683175    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683178    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683181    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683184    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683187    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683190    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683193    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:06:52.685962 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683196    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683198    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683201    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683203    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683206    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683208    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683211    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683213    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683216    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683218    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683222    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683225    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683227    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683230    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683233    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683235    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683238    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683240    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683243    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683245    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:06:52.686425 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683248    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683250    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683253    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683255    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683258    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683262    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683266    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683269    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683274    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683277    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683280    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683283    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683286    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683288    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683291    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683293    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683296    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683299    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683301    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:06:52.686922 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683304    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683307    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683309    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683312    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683316    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683318    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683321    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683324    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683326    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683329    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683331    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683334    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683337    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683339    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683342    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683345    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683347    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683350    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683353    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683355    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:06:52.687384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683358    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683361    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683364    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683367    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683370    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683374    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683377    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683380    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683383    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683386    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683388    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683391    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683394    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683397    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683400    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683403    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683406    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683410    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683412    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683415    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:06:52.687889 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683417    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.683422    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683538    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683543    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683546    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683549    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683552    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683555    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683558    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683561    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683563    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683565    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683568    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683571    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683574    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:06:52.688383 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683576    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683579    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683581    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683584    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683586    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683589    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683591    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683594    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683596    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683599    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683601    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683604    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683606    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683609    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683611    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683614    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683617    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683619    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683622    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683625    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:06:52.688756 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683627    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683630    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683632    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683635    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683638    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683641    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683644    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683648    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683652    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683655    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683659    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683662    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683666    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683668    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683671    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683673    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683676    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683678    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683681    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:06:52.689306 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683683    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683686    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683689    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683691    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683694    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683696    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683699    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683701    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683704    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683707    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683709    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683711    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683714    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683717    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683719    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683722    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683724    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683727    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683729    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:06:52.689755 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683732    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683734    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683737    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683739    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683742    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683745    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683747    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683749    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683752    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683755    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683758    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683760    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683763    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683765    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683768    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683770    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683773    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683775    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683778    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683781    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:06:52.690261 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683783    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683786    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683788    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683791    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683794    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683796    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683799    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:52.683801    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.683806    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.685686    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.687967    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.688835    2555 server.go:1019] "Starting client certificate rotation"
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.688944    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 09:06:52.690742 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.688984    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 09:06:52.691328 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.691314    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 09:06:52.692443 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.692424    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 09:06:52.701300 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.701284    2555 log.go:25] "Validated CRI v1 runtime API"
Sep 15 09:06:52.704424 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.704409    2555 log.go:25] "Validated CRI v1 image API"
Sep 15 09:06:52.705264 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.705250    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 09:06:52.707226 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.707208    2555 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 80e2b2fa-36d4-4b39-bdaa-961ca9d23b33:/dev/nvme0n1p3 fd48d691-090d-49f6-9dc7-d973996a9c5f:/dev/nvme0n1p4]
Sep 15 09:06:52.707268 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.707227    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 09:06:52.713144 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.713027    2555 manager.go:216] Machine: {Timestamp:2026-09-15 09:06:52.711595218 +0000 UTC m=+0.301419556 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3073294 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20169d33f5a1738b011ed3b9cf7a00 SystemUUID:ec20169d-33f5-a173-8b01-1ed3b9cf7a00 BootID:96f5ab5e-9705-434a-97d0-1d1fcbc7aacb Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d8:e6:f0:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d8:e6:f0:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:84:c1:7e:2a:40 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 09:06:52.713144 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.713127    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 09:06:52.713258 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.713201    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 09:06:52.716010 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.715985    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 09:06:52.716715 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.716506    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 09:06:52.716861 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.716721    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 09:06:52.717365 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.717356    2555 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 09:06:52.717405 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.717369    2555 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 09:06:52.717405 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.717376    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 09:06:52.718719 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.718707    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 09:06:52.719822 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.719812    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 09:06:52.723119 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.723109    2555 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 09:06:52.723227 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.723218    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 09:06:52.723259 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.723246    2555 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 09:06:52.723259 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.723256    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 09:06:52.723313 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.723270    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 09:06:52.723313 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.723278    2555 kubelet.go:398] "Adding apiserver pod source"
Sep 15 09:06:52.723313 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.723287    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 09:06:52.723611 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.723600    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 09:06:52.723652 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.723618    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 09:06:52.726021 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.726005    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 09:06:52.728643 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.728625    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 09:06:52.728735 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.728657    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 09:06:52.730399 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730385    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 09:06:52.730399 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730400    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730407    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730413    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730421    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730426    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730440    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730445    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730452    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730457    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730464    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 09:06:52.730487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.730470    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 09:06:52.731770 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.731754    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 09:06:52.731770 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.731767    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 09:06:52.734348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.734327    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 09:06:52.734977 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.734952    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 09:06:52.735044 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.734951    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 09:06:52.735362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.735351    2555 server.go:1268] "Started kubelet"
Sep 15 09:06:52.735487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.735415    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 09:06:52.735487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.735455    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 09:06:52.735621 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.735520    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 09:06:52.736155 ip-10-0-140-124 systemd[1]: Started Kubernetes Kubelet.
Sep 15 09:06:52.736861 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.736835    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 09:06:52.738083 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.738064    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-54ppg"
Sep 15 09:06:52.738398 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.738386    2555 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 09:06:52.740469 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.740405    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 09:06:52.743538 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.743515    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 09:06:52.744115 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.744097    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 09:06:52.744240 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.744222    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:52.744747 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.744730    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 09:06:52.744747 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.744749    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 09:06:52.744884 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.744733    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 09:06:52.744884 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.744880    2555 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 09:06:52.744982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.744888    2555 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 09:06:52.745194 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.745177    2555 factory.go:55] Registering systemd factory
Sep 15 09:06:52.745194 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.745192    2555 factory.go:223] Registration of the systemd container factory successfully
Sep 15 09:06:52.745406 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.745388    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-54ppg"
Sep 15 09:06:52.745461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.745416    2555 factory.go:153] Registering CRI-O factory
Sep 15 09:06:52.745461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.745429    2555 factory.go:223] Registration of the crio container factory successfully
Sep 15 09:06:52.745559 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.745480    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 09:06:52.745559 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.745504    2555 factory.go:103] Registering Raw factory
Sep 15 09:06:52.745559 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.745517    2555 manager.go:1196] Started watching for new ooms in manager
Sep 15 09:06:52.746375 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.746352    2555 manager.go:349] Starting recovery of all containers
Sep 15 09:06:52.750988 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.750960    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 09:06:52.754067 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.750677    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-124.ec2.internal.18d5734f9db7e626  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-124.ec2.internal,UID:ip-10-0-140-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-124.ec2.internal,},FirstTimestamp:2026-09-15 09:06:52.735325734 +0000 UTC m=+0.325150072,LastTimestamp:2026-09-15 09:06:52.735325734 +0000 UTC m=+0.325150072,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-124.ec2.internal,}"
Sep 15 09:06:52.759884 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.759757    2555 manager.go:354] Recovery completed
Sep 15 09:06:52.760317 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.760296    2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-124.ec2.internal\" not found" node="ip-10-0-140-124.ec2.internal"
Sep 15 09:06:52.761539 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.761028    2555 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 15 09:06:52.764246 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.764233    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:06:52.765951 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.765933    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:06:52.766032 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.765966    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:06:52.766032 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.765981    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:06:52.766591 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.766577    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 09:06:52.766591 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.766589    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 09:06:52.766741 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.766598    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:06:52.766741 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.766606    2555 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 09:06:52.767516 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.767501    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:06:52.767580 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.767527    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:06:52.767580 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.767540    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:06:52.844361 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.844333    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:52.915130 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.914645    2555 policy_none.go:49] "None policy: Start"
Sep 15 09:06:52.915130 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.914671    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 09:06:52.915130 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.914683    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 09:06:52.916017 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.916002    2555 policy_none.go:47] "Start"
Sep 15 09:06:52.944622 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.944604    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:52.946362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.946342    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 09:06:52.947441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.947425    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 09:06:52.947525 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.947482    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 09:06:52.947525 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.947509    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 09:06:52.947619 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.947592    2555 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 15 09:06:52.950298 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.950274    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:06:52.951418 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.951404    2555 manager.go:337] "Starting Device Plugin manager"
Sep 15 09:06:52.951536 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.951443    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 09:06:52.951536 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.951452    2555 server.go:87] "Starting device plugin registration server"
Sep 15 09:06:52.951780 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.951769    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 09:06:52.951817 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.951784    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 09:06:52.951945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.951929    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 09:06:52.952021 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.952006    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 09:06:52.952021 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:52.952020    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 09:06:52.952824 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.952806    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 09:06:52.952912 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:52.952901    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.048498 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.048459    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal"]
Sep 15 09:06:53.048630 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.048553    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:06:53.049514 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.049493    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:06:53.049611 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.049527    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:06:53.049611 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.049537    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:06:53.051379 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.051367    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:06:53.051498 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.051483    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.051544 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.051516    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:06:53.051947 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.051932    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:06:53.052093 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052079    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:06:53.052161 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052105    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:06:53.052161 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052110    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:06:53.052161 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052119    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:06:53.052161 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052133    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:06:53.052161 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052144    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:06:53.052496 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052483    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:06:53.052541 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052510    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:06:53.052541 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052523    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:06:53.052613 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.052547    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.053572 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.053555    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.053652 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.053589    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:06:53.054265 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.054240    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:06:53.054340 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.054280    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:06:53.054340 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.054293    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:06:53.061052 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.061030    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.061052 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.061058    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-124.ec2.internal\": node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.075453 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.075431    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.080478 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.080463    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-124.ec2.internal\" not found" node="ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.084751 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.084737    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-124.ec2.internal\" not found" node="ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.146778 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.146756    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59649c46d17a5b32ade6e46890bea4dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal\" (UID: \"59649c46d17a5b32ade6e46890bea4dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.146896 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.146785    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59649c46d17a5b32ade6e46890bea4dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal\" (UID: \"59649c46d17a5b32ade6e46890bea4dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.146896 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.146807    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cba8b8d5513f3abf7095e6b7b748e517-config\") pod \"kube-apiserver-proxy-ip-10-0-140-124.ec2.internal\" (UID: \"cba8b8d5513f3abf7095e6b7b748e517\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.176501 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.176482    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.247586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.247538    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59649c46d17a5b32ade6e46890bea4dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal\" (UID: \"59649c46d17a5b32ade6e46890bea4dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.247586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.247566    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59649c46d17a5b32ade6e46890bea4dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal\" (UID: \"59649c46d17a5b32ade6e46890bea4dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.247586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.247584    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cba8b8d5513f3abf7095e6b7b748e517-config\") pod \"kube-apiserver-proxy-ip-10-0-140-124.ec2.internal\" (UID: \"cba8b8d5513f3abf7095e6b7b748e517\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.247736 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.247625    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59649c46d17a5b32ade6e46890bea4dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal\" (UID: \"59649c46d17a5b32ade6e46890bea4dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.247736 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.247652    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cba8b8d5513f3abf7095e6b7b748e517-config\") pod \"kube-apiserver-proxy-ip-10-0-140-124.ec2.internal\" (UID: \"cba8b8d5513f3abf7095e6b7b748e517\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.247736 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.247667    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59649c46d17a5b32ade6e46890bea4dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal\" (UID: \"59649c46d17a5b32ade6e46890bea4dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.276599 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.276570    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.377159 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.377115    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.384289 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.384266    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.389054 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.388589    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:53.477830 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.477786    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.578184 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.578110    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.679160 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.679127    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.689011 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.688976    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 09:06:53.689162 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.689144    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 09:06:53.750178 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.750130    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 09:01:53 +0000 UTC" deadline="2028-03-04 04:47:18.187309397 +0000 UTC"
Sep 15 09:06:53.750178 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.750170    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12859h40m24.437144059s"
Sep 15 09:06:53.779267 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.779233    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.829429 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:53.829338    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:06:53.880213 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.880180    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:53.980959 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:53.980927    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:54.082038 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.081973    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:54.083110 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:54.083079    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59649c46d17a5b32ade6e46890bea4dc.slice/crio-ca4f0387ee9193b2cc15fcc1bb74132a92837b90d371fc4f79634c565b6d1a3f WatchSource:0}: Error finding container ca4f0387ee9193b2cc15fcc1bb74132a92837b90d371fc4f79634c565b6d1a3f: Status 404 returned error can't find the container with id ca4f0387ee9193b2cc15fcc1bb74132a92837b90d371fc4f79634c565b6d1a3f
Sep 15 09:06:54.089162 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.089144    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:06:54.183909 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.183862    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:54.285546 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.285500    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-124.ec2.internal\" not found"
Sep 15 09:06:54.288531 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.288515    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:06:54.318718 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.318656    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:06:54.321173 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:54.321149    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba8b8d5513f3abf7095e6b7b748e517.slice/crio-43c9b1723805d237c22810df5aa20d66690f7bba0833c3af8560ab21af489142 WatchSource:0}: Error finding container 43c9b1723805d237c22810df5aa20d66690f7bba0833c3af8560ab21af489142: Status 404 returned error can't find the container with id 43c9b1723805d237c22810df5aa20d66690f7bba0833c3af8560ab21af489142
Sep 15 09:06:54.345396 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.345339    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:54.358036 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.358016    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 09:06:54.358942 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.358928    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal"
Sep 15 09:06:54.367682 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.367661    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 09:06:54.725569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.725486    2555 apiserver.go:52] "Watching apiserver"
Sep 15 09:06:54.736348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.736322    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 09:06:54.737563 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.737532    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hm2qh","kube-system/konnectivity-agent-vczs2","kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal","openshift-multus/multus-additional-cni-plugins-rnghd","openshift-multus/network-metrics-daemon-7qqhq","openshift-network-diagnostics/network-check-target-qkk4l","openshift-cluster-node-tuning-operator/tuned-7762s","openshift-dns/node-resolver-lvd2g","openshift-image-registry/node-ca-s5kmk","openshift-multus/multus-flrg9","openshift-network-operator/iptables-alerter-m42d5","openshift-ovn-kubernetes/ovnkube-node-gjggr"]
Sep 15 09:06:54.739467 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.739441    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:54.739570 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.739515    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:06:54.740887 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.740872    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.742496 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.742476    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.743598 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.743574    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 09:06:54.743791 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.743775    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 09:06:54.743872 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.743838    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 09:06:54.743872 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.743866    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vc2lf\""
Sep 15 09:06:54.744011 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.743913    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 09:06:54.744186 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.744170    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.744761 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.744744    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 09:06:54.746272 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.746253    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:06:54.746358 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.746323    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:06:54.746590 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.746570    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 09:06:54.747359 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.747338    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 09:06:54.747470 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.747448    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 09:06:54.747709 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.747475    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 09:06:54.747709 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.747487    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s8d48\""
Sep 15 09:06:54.747709 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.747478    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 09:06:54.747709 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.747567    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 09:06:54.747709 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.747635    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-phrmm\""
Sep 15 09:06:54.748072 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.747966    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 09:06:54.749146 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.748627    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 09:06:54.749146 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.748685    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.752005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.751819    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 09:06:54.752005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.751860    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 09:06:54.752005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.751868    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9bc2l\""
Sep 15 09:06:54.752005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.751975    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 09:06:54.752005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.751975    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 09:06:54.752317 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.752228    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.752317 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.752264    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 09:06:54.754415 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.754395    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.755758 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755739    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f222340-1164-4de2-9a50-be0b4bd5ff0f-env-overrides\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.755897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755766    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f222340-1164-4de2-9a50-be0b4bd5ff0f-ovnkube-script-lib\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.755897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755783    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50c5aa27-d229-4edc-9bf9-2142ce3e2bc5-host\") pod \"node-ca-s5kmk\" (UID: \"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5\") " pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.755897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755798    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-systemd-units\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.755897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755822    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-socket-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.755897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755845    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-cni-netd\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.755897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755884    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755910    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-var-lib-openvswitch\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755934    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755958    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-slash\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.755994    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-run-ovn\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756033    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756041    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qpm6l\""
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756042    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xl7m\" (UniqueName: \"kubernetes.io/projected/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-kube-api-access-9xl7m\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756107    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756105    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-run-netns\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756147    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-run-openvswitch\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756166    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-cni-bin\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756188    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnz9x\" (UniqueName: \"kubernetes.io/projected/7f222340-1164-4de2-9a50-be0b4bd5ff0f-kube-api-access-vnz9x\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756220    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756241    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-sys-fs\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756287    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f222340-1164-4de2-9a50-be0b4bd5ff0f-ovn-node-metrics-cert\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756321    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50c5aa27-d229-4edc-9bf9-2142ce3e2bc5-serviceca\") pod \"node-ca-s5kmk\" (UID: \"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5\") " pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.756351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756351    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756347    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-run-systemd\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756432    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-etc-openvswitch\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756457    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvvlx\" (UniqueName: \"kubernetes.io/projected/50c5aa27-d229-4edc-9bf9-2142ce3e2bc5-kube-api-access-gvvlx\") pod \"node-ca-s5kmk\" (UID: \"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5\") " pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756482    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-node-log\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756519    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-log-socket\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756543    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756568    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-registration-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756593    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-device-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756617    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756641    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fklsl\" (UniqueName: \"kubernetes.io/projected/a1791e99-ae22-4734-96b8-eb1e70ce1d05-kube-api-access-fklsl\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756664    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-kubelet\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756710    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f222340-1164-4de2-9a50-be0b4bd5ff0f-ovnkube-config\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.756726    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.757035    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.757075    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:06:54.757395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.757152    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x29pp\""
Sep 15 09:06:54.758715 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.758696    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:54.759135 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.759116    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pw5mb\""
Sep 15 09:06:54.759303 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.759281    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 09:06:54.759592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.759573    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 09:06:54.761388 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.761368    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 09:06:54.761554 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.761513    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 09:06:54.761692 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.761666    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:54.761791 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.761728    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:06:54.761948 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.761931    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lfc8t\""
Sep 15 09:06:54.764625 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.763948    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.764625 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.764437    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 09:06:54.766200 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.766179    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 09:06:54.766594 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.766572    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dhpt6\""
Sep 15 09:06:54.783263 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.783243    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gftt7"
Sep 15 09:06:54.793130 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.793111    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gftt7"
Sep 15 09:06:54.825629 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.825602    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:06:54.846109 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.846085    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 09:06:54.857566 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857540    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-kubernetes\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.857653 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857582    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-cnibin\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.857653 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857611    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-cnibin\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.857653 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857639    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plnsh\" (UniqueName: \"kubernetes.io/projected/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-kube-api-access-plnsh\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.857753 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857670    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50c5aa27-d229-4edc-9bf9-2142ce3e2bc5-serviceca\") pod \"node-ca-s5kmk\" (UID: \"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5\") " pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.857753 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857697    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-run-systemd\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.857753 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857722    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-modprobe-d\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.857753 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857747    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-var-lib-kubelet\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.857964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857773    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f0f4746-99dd-4108-8702-8d9c3085e39f-cni-binary-copy\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.857964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857798    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-socket-dir-parent\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.857964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857831    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-run-k8s-cni-cncf-io\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.857964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857859    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.857964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857896    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-host\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.857964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857920    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59c90c42-51b9-47a7-8ad3-1361a7008c65-dbus\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:54.857964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857958    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f222340-1164-4de2-9a50-be0b4bd5ff0f-ovnkube-config\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.857986    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f222340-1164-4de2-9a50-be0b4bd5ff0f-ovnkube-script-lib\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858012    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-systemd\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858037    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/413e8187-a2ca-44b8-afcf-8c6110442c6f-tmp-dir\") pod \"node-resolver-lvd2g\" (UID: \"413e8187-a2ca-44b8-afcf-8c6110442c6f\") " pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858062    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-cni-dir\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858088    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50c5aa27-d229-4edc-9bf9-2142ce3e2bc5-host\") pod \"node-ca-s5kmk\" (UID: \"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5\") " pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858111    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-sysctl-d\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858150    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-system-cni-dir\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858192    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858215    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858223    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-run-ovn\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858258    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.858308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858287    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xl7m\" (UniqueName: \"kubernetes.io/projected/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-kube-api-access-9xl7m\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858316    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnz9x\" (UniqueName: \"kubernetes.io/projected/7f222340-1164-4de2-9a50-be0b4bd5ff0f-kube-api-access-vnz9x\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858344    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/122a3a00-a350-402e-a45e-0c11f278ab5f-agent-certs\") pod \"konnectivity-agent-vczs2\" (UID: \"122a3a00-a350-402e-a45e-0c11f278ab5f\") " pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858368    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-hostroot\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858391    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59c90c42-51b9-47a7-8ad3-1361a7008c65-kubelet-config\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858414    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-run-netns\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858439    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-run-multus-certs\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858465    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn269\" (UniqueName: \"kubernetes.io/projected/2f0f4746-99dd-4108-8702-8d9c3085e39f-kube-api-access-bn269\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858491    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858533    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17788574-b3c8-4671-9ac7-0712607cf46a-host-slash\") pod \"iptables-alerter-m42d5\" (UID: \"17788574-b3c8-4671-9ac7-0712607cf46a\") " pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858566    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-tuned\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858591    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-var-lib-cni-multus\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858619    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f222340-1164-4de2-9a50-be0b4bd5ff0f-ovn-node-metrics-cert\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858650    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-etc-openvswitch\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858681    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858689    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858696    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68xl5\" (UniqueName: \"kubernetes.io/projected/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-kube-api-access-68xl5\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.858945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858698    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-etc-openvswitch\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858744    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-run-ovn\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858760    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-conf-dir\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858837    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-daemon-config\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858848    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-run-systemd\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858867    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f222340-1164-4de2-9a50-be0b4bd5ff0f-ovnkube-config\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858895    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-system-cni-dir\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858931    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50c5aa27-d229-4edc-9bf9-2142ce3e2bc5-host\") pod \"node-ca-s5kmk\" (UID: \"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5\") " pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.858942    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvvlx\" (UniqueName: \"kubernetes.io/projected/50c5aa27-d229-4edc-9bf9-2142ce3e2bc5-kube-api-access-gvvlx\") pod \"node-ca-s5kmk\" (UID: \"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5\") " pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859162    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-node-log\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859225    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-log-socket\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859237    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-node-log\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859257    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-registration-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859283    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-device-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859288    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-log-socket\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859299    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f222340-1164-4de2-9a50-be0b4bd5ff0f-ovnkube-script-lib\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859309    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:06:54.859799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859337    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-registration-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859337    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/413e8187-a2ca-44b8-afcf-8c6110442c6f-hosts-file\") pod \"node-resolver-lvd2g\" (UID: \"413e8187-a2ca-44b8-afcf-8c6110442c6f\") " pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859371    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgscz\" (UniqueName: \"kubernetes.io/projected/413e8187-a2ca-44b8-afcf-8c6110442c6f-kube-api-access-tgscz\") pod \"node-resolver-lvd2g\" (UID: \"413e8187-a2ca-44b8-afcf-8c6110442c6f\") " pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859380    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50c5aa27-d229-4edc-9bf9-2142ce3e2bc5-serviceca\") pod \"node-ca-s5kmk\" (UID: \"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5\") " pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859390    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fklsl\" (UniqueName: \"kubernetes.io/projected/a1791e99-ae22-4734-96b8-eb1e70ce1d05-kube-api-access-fklsl\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859406    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-kubelet\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859416    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-device-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859424    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f222340-1164-4de2-9a50-be0b4bd5ff0f-env-overrides\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859453    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-sys\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859480    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-lib-modules\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859493    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-kubelet\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859506    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-tmp\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859533    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-etc-kubernetes\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859556    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859594    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-systemd-units\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859625    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-socket-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859629    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 09:06:54.860547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859653    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859707    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-cni-netd\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859732    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-var-lib-openvswitch\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859739    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-socket-dir\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859758    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859788    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-cni-netd\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859637    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-systemd-units\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859804    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-slash\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859804    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f222340-1164-4de2-9a50-be0b4bd5ff0f-env-overrides\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859851    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-var-lib-openvswitch\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859862    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-slash\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.859894    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859885    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859932    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17788574-b3c8-4671-9ac7-0712607cf46a-iptables-alerter-script\") pod \"iptables-alerter-m42d5\" (UID: \"17788574-b3c8-4671-9ac7-0712607cf46a\") " pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859962    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-run-netns\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.859989    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-run-openvswitch\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860015    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-cni-bin\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860022    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-run-netns\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.861311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860041    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-sysctl-conf\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860065    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-run-openvswitch\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860073    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-cni-bin\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.860088    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs podName:a1791e99-ae22-4734-96b8-eb1e70ce1d05 nodeName:}" failed. No retries permitted until 2026-09-15 09:06:55.360035656 +0000 UTC m=+2.949860011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs") pod "network-metrics-daemon-7qqhq" (UID: "a1791e99-ae22-4734-96b8-eb1e70ce1d05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860131    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-run\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860160    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/122a3a00-a350-402e-a45e-0c11f278ab5f-konnectivity-ca\") pod \"konnectivity-agent-vczs2\" (UID: \"122a3a00-a350-402e-a45e-0c11f278ab5f\") " pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860189    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tckh9\" (UniqueName: \"kubernetes.io/projected/17788574-b3c8-4671-9ac7-0712607cf46a-kube-api-access-tckh9\") pod \"iptables-alerter-m42d5\" (UID: \"17788574-b3c8-4671-9ac7-0712607cf46a\") " pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860219    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860246    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-sys-fs\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860271    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-sysconfig\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860286    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f222340-1164-4de2-9a50-be0b4bd5ff0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860296    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-var-lib-cni-bin\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860322    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-var-lib-kubelet\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860348    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-cni-binary-copy\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.862233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.860411    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-sys-fs\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.864091 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.864068    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f222340-1164-4de2-9a50-be0b4bd5ff0f-ovn-node-metrics-cert\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.866106 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.865017    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:06:54.866106 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.865042    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:06:54.866106 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.865058    2555 projected.go:196] Error preparing data for projected volume kube-api-access-9mvg9 for pod openshift-network-diagnostics/network-check-target-qkk4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:06:54.866106 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.865126    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9 podName:b4b3d3db-6fca-4562-95b3-dcb6b9f11257 nodeName:}" failed. No retries permitted until 2026-09-15 09:06:55.365109014 +0000 UTC m=+2.954933358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9mvg9" (UniqueName: "kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9") pod "network-check-target-qkk4l" (UID: "b4b3d3db-6fca-4562-95b3-dcb6b9f11257") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:06:54.867781 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.867754    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xl7m\" (UniqueName: \"kubernetes.io/projected/fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c-kube-api-access-9xl7m\") pod \"aws-ebs-csi-driver-node-lgcdw\" (UID: \"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:54.868907 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.868788    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvvlx\" (UniqueName: \"kubernetes.io/projected/50c5aa27-d229-4edc-9bf9-2142ce3e2bc5-kube-api-access-gvvlx\") pod \"node-ca-s5kmk\" (UID: \"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5\") " pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:54.869268 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.869247    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnz9x\" (UniqueName: \"kubernetes.io/projected/7f222340-1164-4de2-9a50-be0b4bd5ff0f-kube-api-access-vnz9x\") pod \"ovnkube-node-gjggr\" (UID: \"7f222340-1164-4de2-9a50-be0b4bd5ff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:54.869932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.869880    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fklsl\" (UniqueName: \"kubernetes.io/projected/a1791e99-ae22-4734-96b8-eb1e70ce1d05-kube-api-access-fklsl\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:54.955205 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.955135    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal" event={"ID":"cba8b8d5513f3abf7095e6b7b748e517","Type":"ContainerStarted","Data":"43c9b1723805d237c22810df5aa20d66690f7bba0833c3af8560ab21af489142"}
Sep 15 09:06:54.961777 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.957829    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal" event={"ID":"59649c46d17a5b32ade6e46890bea4dc","Type":"ContainerStarted","Data":"ca4f0387ee9193b2cc15fcc1bb74132a92837b90d371fc4f79634c565b6d1a3f"}
Sep 15 09:06:54.962070 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962045    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-modprobe-d\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.962173 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962102    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-var-lib-kubelet\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.962173 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962146    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f0f4746-99dd-4108-8702-8d9c3085e39f-cni-binary-copy\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962182    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-socket-dir-parent\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962239    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-run-k8s-cni-cncf-io\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962273    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-host\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.962439 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962306    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59c90c42-51b9-47a7-8ad3-1361a7008c65-dbus\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:54.962439 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962344    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-systemd\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.962439 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962376    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/413e8187-a2ca-44b8-afcf-8c6110442c6f-tmp-dir\") pod \"node-resolver-lvd2g\" (UID: \"413e8187-a2ca-44b8-afcf-8c6110442c6f\") " pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:54.962439 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962403    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-cni-dir\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962439 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-sysctl-d\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962463    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-system-cni-dir\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962493    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-run-k8s-cni-cncf-io\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962500    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/122a3a00-a350-402e-a45e-0c11f278ab5f-agent-certs\") pod \"konnectivity-agent-vczs2\" (UID: \"122a3a00-a350-402e-a45e-0c11f278ab5f\") " pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962531    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-hostroot\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962565    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59c90c42-51b9-47a7-8ad3-1361a7008c65-kubelet-config\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962595    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-run-netns\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962631    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-run-multus-certs\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962643    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-modprobe-d\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962663    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn269\" (UniqueName: \"kubernetes.io/projected/2f0f4746-99dd-4108-8702-8d9c3085e39f-kube-api-access-bn269\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.962697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962694    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962704    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-var-lib-kubelet\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962728    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17788574-b3c8-4671-9ac7-0712607cf46a-host-slash\") pod \"iptables-alerter-m42d5\" (UID: \"17788574-b3c8-4671-9ac7-0712607cf46a\") " pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962760    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-tuned\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962793    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-var-lib-cni-multus\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962796    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-socket-dir-parent\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962831    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68xl5\" (UniqueName: \"kubernetes.io/projected/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-kube-api-access-68xl5\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962860    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-conf-dir\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962864    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-hostroot\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962946    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-host\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.962952    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59c90c42-51b9-47a7-8ad3-1361a7008c65-kubelet-config\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963000    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-daemon-config\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963014    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59c90c42-51b9-47a7-8ad3-1361a7008c65-dbus\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963029    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-system-cni-dir\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963080    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-systemd\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963091    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/413e8187-a2ca-44b8-afcf-8c6110442c6f-hosts-file\") pod \"node-resolver-lvd2g\" (UID: \"413e8187-a2ca-44b8-afcf-8c6110442c6f\") " pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963119    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgscz\" (UniqueName: \"kubernetes.io/projected/413e8187-a2ca-44b8-afcf-8c6110442c6f-kube-api-access-tgscz\") pod \"node-resolver-lvd2g\" (UID: \"413e8187-a2ca-44b8-afcf-8c6110442c6f\") " pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963151    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-sys\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.963199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963180    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-lib-modules\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963205    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-tmp\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963235    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-etc-kubernetes\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963265    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963302    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963358    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963389    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17788574-b3c8-4671-9ac7-0712607cf46a-iptables-alerter-script\") pod \"iptables-alerter-m42d5\" (UID: \"17788574-b3c8-4671-9ac7-0712607cf46a\") " pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963410    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/413e8187-a2ca-44b8-afcf-8c6110442c6f-tmp-dir\") pod \"node-resolver-lvd2g\" (UID: \"413e8187-a2ca-44b8-afcf-8c6110442c6f\") " pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963431    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-sysctl-conf\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963462    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-run\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963525    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-run\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963531    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-cni-dir\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963575    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/122a3a00-a350-402e-a45e-0c11f278ab5f-konnectivity-ca\") pod \"konnectivity-agent-vczs2\" (UID: \"122a3a00-a350-402e-a45e-0c11f278ab5f\") " pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963600    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-run-netns\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963613    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tckh9\" (UniqueName: \"kubernetes.io/projected/17788574-b3c8-4671-9ac7-0712607cf46a-kube-api-access-tckh9\") pod \"iptables-alerter-m42d5\" (UID: \"17788574-b3c8-4671-9ac7-0712607cf46a\") " pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963656    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-sysconfig\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963684    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-var-lib-cni-bin\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963712    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-var-lib-kubelet\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.964113 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963722    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-system-cni-dir\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963746    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-cni-binary-copy\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963779    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-kubernetes\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963815    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-sys\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963833    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-cnibin\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963866    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-cnibin\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963871    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-run-multus-certs\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963941    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-cnibin\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.963981    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plnsh\" (UniqueName: \"kubernetes.io/projected/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-kube-api-access-plnsh\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.964413    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-lib-modules\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.964461    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.964531    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17788574-b3c8-4671-9ac7-0712607cf46a-host-slash\") pod \"iptables-alerter-m42d5\" (UID: \"17788574-b3c8-4671-9ac7-0712607cf46a\") " pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965034    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-etc-kubernetes\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965104    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f0f4746-99dd-4108-8702-8d9c3085e39f-cni-binary-copy\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965219    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.965335    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965429    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-cni-binary-copy\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.967378 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:54.965447    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret podName:59c90c42-51b9-47a7-8ad3-1361a7008c65 nodeName:}" failed. No retries permitted until 2026-09-15 09:06:55.465420764 +0000 UTC m=+3.055245107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret") pod "global-pull-secret-syncer-hm2qh" (UID: "59c90c42-51b9-47a7-8ad3-1361a7008c65") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965511    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-sysconfig\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965568    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-var-lib-cni-bin\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965630    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-var-lib-kubelet\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965843    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-sysctl-conf\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965841    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.965983    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-sysctl-d\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.966106    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-host-var-lib-cni-multus\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.966444    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-conf-dir\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.966625    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/122a3a00-a350-402e-a45e-0c11f278ab5f-konnectivity-ca\") pod \"konnectivity-agent-vczs2\" (UID: \"122a3a00-a350-402e-a45e-0c11f278ab5f\") " pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.966718    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/413e8187-a2ca-44b8-afcf-8c6110442c6f-hosts-file\") pod \"node-resolver-lvd2g\" (UID: \"413e8187-a2ca-44b8-afcf-8c6110442c6f\") " pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.966779    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-system-cni-dir\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.966949    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17788574-b3c8-4671-9ac7-0712607cf46a-iptables-alerter-script\") pod \"iptables-alerter-m42d5\" (UID: \"17788574-b3c8-4671-9ac7-0712607cf46a\") " pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.967034    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f0f4746-99dd-4108-8702-8d9c3085e39f-cnibin\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.967094    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f0f4746-99dd-4108-8702-8d9c3085e39f-multus-daemon-config\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.968285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.967100    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-kubernetes\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.969911 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.969836    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-tmp\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.970976 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.970664    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/122a3a00-a350-402e-a45e-0c11f278ab5f-agent-certs\") pod \"konnectivity-agent-vczs2\" (UID: \"122a3a00-a350-402e-a45e-0c11f278ab5f\") " pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:06:54.973505 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.973477    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-etc-tuned\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.977187 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.976636    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn269\" (UniqueName: \"kubernetes.io/projected/2f0f4746-99dd-4108-8702-8d9c3085e39f-kube-api-access-bn269\") pod \"multus-flrg9\" (UID: \"2f0f4746-99dd-4108-8702-8d9c3085e39f\") " pod="openshift-multus/multus-flrg9"
Sep 15 09:06:54.977187 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.977106    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plnsh\" (UniqueName: \"kubernetes.io/projected/a65cdf45-fc8a-4bee-95c4-72fd9f36a211-kube-api-access-plnsh\") pod \"multus-additional-cni-plugins-rnghd\" (UID: \"a65cdf45-fc8a-4bee-95c4-72fd9f36a211\") " pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:54.977737 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.977644    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tckh9\" (UniqueName: \"kubernetes.io/projected/17788574-b3c8-4671-9ac7-0712607cf46a-kube-api-access-tckh9\") pod \"iptables-alerter-m42d5\" (UID: \"17788574-b3c8-4671-9ac7-0712607cf46a\") " pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:54.979459 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.979352    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68xl5\" (UniqueName: \"kubernetes.io/projected/3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4-kube-api-access-68xl5\") pod \"tuned-7762s\" (UID: \"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4\") " pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:54.980929 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:54.980867    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgscz\" (UniqueName: \"kubernetes.io/projected/413e8187-a2ca-44b8-afcf-8c6110442c6f-kube-api-access-tgscz\") pod \"node-resolver-lvd2g\" (UID: \"413e8187-a2ca-44b8-afcf-8c6110442c6f\") " pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:55.052774 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.052734    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s5kmk"
Sep 15 09:06:55.059370 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.059332    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:06:55.070752 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.070575    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw"
Sep 15 09:06:55.077115 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.076958    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rnghd"
Sep 15 09:06:55.085840 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.085789    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7762s"
Sep 15 09:06:55.095338 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.095305    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m42d5"
Sep 15 09:06:55.103816 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.103793    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:06:55.113532 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.113514    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvd2g"
Sep 15 09:06:55.121348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.121325    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-flrg9"
Sep 15 09:06:55.367227 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.367118    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:06:55.367227 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.367200    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:55.367467 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:55.367302    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:06:55.367467 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:55.367319    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:06:55.367467 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:55.367327    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:06:55.367467 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:55.367341    2555 projected.go:196] Error preparing data for projected volume kube-api-access-9mvg9 for pod openshift-network-diagnostics/network-check-target-qkk4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:06:55.367467 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:55.367383    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs podName:a1791e99-ae22-4734-96b8-eb1e70ce1d05 nodeName:}" failed. No retries permitted until 2026-09-15 09:06:56.367363378 +0000 UTC m=+3.957187724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs") pod "network-metrics-daemon-7qqhq" (UID: "a1791e99-ae22-4734-96b8-eb1e70ce1d05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:06:55.367467 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:55.367403    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9 podName:b4b3d3db-6fca-4562-95b3-dcb6b9f11257 nodeName:}" failed. No retries permitted until 2026-09-15 09:06:56.367393109 +0000 UTC m=+3.957217436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mvg9" (UniqueName: "kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9") pod "network-check-target-qkk4l" (UID: "b4b3d3db-6fca-4562-95b3-dcb6b9f11257") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:06:55.468257 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.468218    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:55.468438 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:55.468402    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:06:55.468505 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:55.468494    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret podName:59c90c42-51b9-47a7-8ad3-1361a7008c65 nodeName:}" failed. No retries permitted until 2026-09-15 09:06:56.468477209 +0000 UTC m=+4.058301558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret") pod "global-pull-secret-syncer-hm2qh" (UID: "59c90c42-51b9-47a7-8ad3-1361a7008c65") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:06:55.796520 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.796406    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:01:55 +0000 UTC" deadline="2028-06-03 08:16:30.391245992 +0000 UTC"
Sep 15 09:06:55.796520 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.796476    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15047h9m34.594773346s"
Sep 15 09:06:55.948659 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:55.948626    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:55.948844 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:55.948760    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:06:56.156930 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:56.156681    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c5aa27_d229_4edc_9bf9_2142ce3e2bc5.slice/crio-6b6c00f019601568aed68fb98d874aa81329412e138356664d175912e1738f99 WatchSource:0}: Error finding container 6b6c00f019601568aed68fb98d874aa81329412e138356664d175912e1738f99: Status 404 returned error can't find the container with id 6b6c00f019601568aed68fb98d874aa81329412e138356664d175912e1738f99
Sep 15 09:06:56.159467 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:56.159441    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f222340_1164_4de2_9a50_be0b4bd5ff0f.slice/crio-68bfae5930a9313c815cea028e874e3d1063fb191d8ddc6b0e836181545c66bc WatchSource:0}: Error finding container 68bfae5930a9313c815cea028e874e3d1063fb191d8ddc6b0e836181545c66bc: Status 404 returned error can't find the container with id 68bfae5930a9313c815cea028e874e3d1063fb191d8ddc6b0e836181545c66bc
Sep 15 09:06:56.163035 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:56.163011    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0f4746_99dd_4108_8702_8d9c3085e39f.slice/crio-62d87d50b3665a5b58fb607bc9896793f98806af55c48c0e262a7ab5725bf053 WatchSource:0}: Error finding container 62d87d50b3665a5b58fb607bc9896793f98806af55c48c0e262a7ab5725bf053: Status 404 returned error can't find the container with id 62d87d50b3665a5b58fb607bc9896793f98806af55c48c0e262a7ab5725bf053
Sep 15 09:06:56.186776 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:56.186747    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dee9ad8_9f7c_4314_a0ff_b4669ad14bc4.slice/crio-f4722bb2b8d8d7f393e94e423c26ee42e5e06259362c15b9c61890c86695826f WatchSource:0}: Error finding container f4722bb2b8d8d7f393e94e423c26ee42e5e06259362c15b9c61890c86695826f: Status 404 returned error can't find the container with id f4722bb2b8d8d7f393e94e423c26ee42e5e06259362c15b9c61890c86695826f
Sep 15 09:06:56.187603 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:56.187575    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17788574_b3c8_4671_9ac7_0712607cf46a.slice/crio-ec203be739b2c4b058b15ea2ccd1980b06fce646594160b971449098defefb39 WatchSource:0}: Error finding container ec203be739b2c4b058b15ea2ccd1980b06fce646594160b971449098defefb39: Status 404 returned error can't find the container with id ec203be739b2c4b058b15ea2ccd1980b06fce646594160b971449098defefb39
Sep 15 09:06:56.189198 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:56.189166    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122a3a00_a350_402e_a45e_0c11f278ab5f.slice/crio-ec7ecb7ee476794e4db99f5feb10ef8fd5bfd1ebedb80579155987b51f1f388c WatchSource:0}: Error finding container ec7ecb7ee476794e4db99f5feb10ef8fd5bfd1ebedb80579155987b51f1f388c: Status 404 returned error can't find the container with id ec7ecb7ee476794e4db99f5feb10ef8fd5bfd1ebedb80579155987b51f1f388c
Sep 15 09:06:56.189976 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:56.189949    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65cdf45_fc8a_4bee_95c4_72fd9f36a211.slice/crio-2ac29482f633ac2d2ed01b3a375fc123ba398c4803f7108d6a829f4cb63bca57 WatchSource:0}: Error finding container 2ac29482f633ac2d2ed01b3a375fc123ba398c4803f7108d6a829f4cb63bca57: Status 404 returned error can't find the container with id 2ac29482f633ac2d2ed01b3a375fc123ba398c4803f7108d6a829f4cb63bca57
Sep 15 09:06:56.191384 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:56.190723    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc5dbe2_5d8e_4dd8_a344_5d7245c2757c.slice/crio-2449ed50167a161370343ede2ccc5e33a5c8fa419cb20faeb5ee2f30ce74c60a WatchSource:0}: Error finding container 2449ed50167a161370343ede2ccc5e33a5c8fa419cb20faeb5ee2f30ce74c60a: Status 404 returned error can't find the container with id 2449ed50167a161370343ede2ccc5e33a5c8fa419cb20faeb5ee2f30ce74c60a
Sep 15 09:06:56.191642 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:06:56.191592    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413e8187_a2ca_44b8_afcf_8c6110442c6f.slice/crio-b43f92a95fa487a866773c982695bdb9e280f1b8096ad9b8661b1cfaa6a44c3b WatchSource:0}: Error finding container b43f92a95fa487a866773c982695bdb9e280f1b8096ad9b8661b1cfaa6a44c3b: Status 404 returned error can't find the container with id b43f92a95fa487a866773c982695bdb9e280f1b8096ad9b8661b1cfaa6a44c3b
Sep 15 09:06:56.376197 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.376162    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:06:56.376361 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.376212    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:56.376361 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.376304    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:06:56.376361 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.376351    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:06:56.376488 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.376375    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:06:56.376488 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.376388    2555 projected.go:196] Error preparing data for projected volume kube-api-access-9mvg9 for pod openshift-network-diagnostics/network-check-target-qkk4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:06:56.376488 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.376359    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs podName:a1791e99-ae22-4734-96b8-eb1e70ce1d05 nodeName:}" failed. No retries permitted until 2026-09-15 09:06:58.376344841 +0000 UTC m=+5.966169173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs") pod "network-metrics-daemon-7qqhq" (UID: "a1791e99-ae22-4734-96b8-eb1e70ce1d05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:06:56.376488 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.376462    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9 podName:b4b3d3db-6fca-4562-95b3-dcb6b9f11257 nodeName:}" failed. No retries permitted until 2026-09-15 09:06:58.376429795 +0000 UTC m=+5.966254126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mvg9" (UniqueName: "kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9") pod "network-check-target-qkk4l" (UID: "b4b3d3db-6fca-4562-95b3-dcb6b9f11257") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:06:56.477029 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.476999    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:56.477134 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.477121    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:06:56.477180 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.477172    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret podName:59c90c42-51b9-47a7-8ad3-1361a7008c65 nodeName:}" failed. No retries permitted until 2026-09-15 09:06:58.477157218 +0000 UTC m=+6.066981552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret") pod "global-pull-secret-syncer-hm2qh" (UID: "59c90c42-51b9-47a7-8ad3-1361a7008c65") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:06:56.797766 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.797635    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:01:55 +0000 UTC" deadline="2028-05-10 00:52:42.77900915 +0000 UTC"
Sep 15 09:06:56.797766 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.797678    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14463h45m45.981336233s"
Sep 15 09:06:56.949441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.948683    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:06:56.949441 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.948812    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:06:56.949441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.949280    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:56.949441 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:56.949397    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:06:56.973816 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.972990    2555 generic.go:356] "Generic (PLEG): container finished" podID="59649c46d17a5b32ade6e46890bea4dc" containerID="0ce2d61378a9ad446719ac4192d4f64e87f89b443c61bb104ded55d1e961c2fe" exitCode=0
Sep 15 09:06:56.973816 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.973081    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal" event={"ID":"59649c46d17a5b32ade6e46890bea4dc","Type":"ContainerDied","Data":"0ce2d61378a9ad446719ac4192d4f64e87f89b443c61bb104ded55d1e961c2fe"}
Sep 15 09:06:56.978203 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.978173    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw" event={"ID":"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c","Type":"ContainerStarted","Data":"2449ed50167a161370343ede2ccc5e33a5c8fa419cb20faeb5ee2f30ce74c60a"}
Sep 15 09:06:56.985872 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.985753    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvd2g" event={"ID":"413e8187-a2ca-44b8-afcf-8c6110442c6f","Type":"ContainerStarted","Data":"b43f92a95fa487a866773c982695bdb9e280f1b8096ad9b8661b1cfaa6a44c3b"}
Sep 15 09:06:56.994030 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:56.993975    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vczs2" event={"ID":"122a3a00-a350-402e-a45e-0c11f278ab5f","Type":"ContainerStarted","Data":"ec7ecb7ee476794e4db99f5feb10ef8fd5bfd1ebedb80579155987b51f1f388c"}
Sep 15 09:06:57.008941 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:57.008891    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m42d5" event={"ID":"17788574-b3c8-4671-9ac7-0712607cf46a","Type":"ContainerStarted","Data":"ec203be739b2c4b058b15ea2ccd1980b06fce646594160b971449098defefb39"}
Sep 15 09:06:57.022862 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:57.022746    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" event={"ID":"7f222340-1164-4de2-9a50-be0b4bd5ff0f","Type":"ContainerStarted","Data":"68bfae5930a9313c815cea028e874e3d1063fb191d8ddc6b0e836181545c66bc"}
Sep 15 09:06:57.029427 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:57.029352    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s5kmk" event={"ID":"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5","Type":"ContainerStarted","Data":"6b6c00f019601568aed68fb98d874aa81329412e138356664d175912e1738f99"}
Sep 15 09:06:57.057839 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:57.057569    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal" event={"ID":"cba8b8d5513f3abf7095e6b7b748e517","Type":"ContainerStarted","Data":"21dedb86f86dd7474b1a4c882ed104f603b59537733e7585010a464aaeccc9c1"}
Sep 15 09:06:57.067378 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:57.067293    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnghd" event={"ID":"a65cdf45-fc8a-4bee-95c4-72fd9f36a211","Type":"ContainerStarted","Data":"2ac29482f633ac2d2ed01b3a375fc123ba398c4803f7108d6a829f4cb63bca57"}
Sep 15 09:06:57.069597 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:57.069527    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7762s" event={"ID":"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4","Type":"ContainerStarted","Data":"f4722bb2b8d8d7f393e94e423c26ee42e5e06259362c15b9c61890c86695826f"}
Sep 15 09:06:57.078690 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:57.078658    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-flrg9" event={"ID":"2f0f4746-99dd-4108-8702-8d9c3085e39f","Type":"ContainerStarted","Data":"62d87d50b3665a5b58fb607bc9896793f98806af55c48c0e262a7ab5725bf053"}
Sep 15 09:06:57.949141 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:57.949104    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:57.949968 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:57.949242    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:06:58.097237 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:58.097141    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal" event={"ID":"59649c46d17a5b32ade6e46890bea4dc","Type":"ContainerStarted","Data":"6eb6031bbcd404192c9a43c7b541e870287c1f7482daed85e5a1f2ceaf29084b"}
Sep 15 09:06:58.117729 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:58.116945    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-124.ec2.internal" podStartSLOduration=4.116904999 podStartE2EDuration="4.116904999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:06:57.075804807 +0000 UTC m=+4.665629163" watchObservedRunningTime="2026-09-15 09:06:58.116904999 +0000 UTC m=+5.706729352"
Sep 15 09:06:58.396164 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:58.395784    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:06:58.396164 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:58.395853    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:58.396164 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.395986    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:06:58.396164 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.395999    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:06:58.396164 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.396014    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:06:58.396164 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.396029    2555 projected.go:196] Error preparing data for projected volume kube-api-access-9mvg9 for pod openshift-network-diagnostics/network-check-target-qkk4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:06:58.396164 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.396066    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs podName:a1791e99-ae22-4734-96b8-eb1e70ce1d05 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:02.396046157 +0000 UTC m=+9.985870499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs") pod "network-metrics-daemon-7qqhq" (UID: "a1791e99-ae22-4734-96b8-eb1e70ce1d05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:06:58.396164 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.396088    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9 podName:b4b3d3db-6fca-4562-95b3-dcb6b9f11257 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:02.396075525 +0000 UTC m=+9.985899870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mvg9" (UniqueName: "kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9") pod "network-check-target-qkk4l" (UID: "b4b3d3db-6fca-4562-95b3-dcb6b9f11257") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:06:58.497574 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:58.496817    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:58.497574 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.497099    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:06:58.497574 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.497180    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret podName:59c90c42-51b9-47a7-8ad3-1361a7008c65 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:02.497158681 +0000 UTC m=+10.086983012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret") pod "global-pull-secret-syncer-hm2qh" (UID: "59c90c42-51b9-47a7-8ad3-1361a7008c65") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:06:58.949103 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:58.949065    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:06:58.949326 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.949224    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:06:58.949776 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:58.949715    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:06:58.949841 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:58.949820    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:06:59.948061 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:06:59.948022    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:06:59.948274 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:06:59.948175    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:00.951329 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:00.948151    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:00.951329 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:00.948290    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:00.951329 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:00.948113    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:00.951329 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:00.951265    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:01.948813 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:01.948726    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:01.949120 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:01.949076    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:02.431700 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:02.431616    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:02.432249 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:02.431706    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:02.432249 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.431818    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:02.432249 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.431833    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:02.432249 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.431834    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:02.432249 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.431931    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs podName:a1791e99-ae22-4734-96b8-eb1e70ce1d05 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:10.431910604 +0000 UTC m=+18.021734943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs") pod "network-metrics-daemon-7qqhq" (UID: "a1791e99-ae22-4734-96b8-eb1e70ce1d05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:02.432249 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.431841    2555 projected.go:196] Error preparing data for projected volume kube-api-access-9mvg9 for pod openshift-network-diagnostics/network-check-target-qkk4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:02.432249 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.431984    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9 podName:b4b3d3db-6fca-4562-95b3-dcb6b9f11257 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:10.431974436 +0000 UTC m=+18.021798774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mvg9" (UniqueName: "kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9") pod "network-check-target-qkk4l" (UID: "b4b3d3db-6fca-4562-95b3-dcb6b9f11257") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:02.532333 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:02.532294    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:02.532514 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.532435    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:02.532514 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.532495    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret podName:59c90c42-51b9-47a7-8ad3-1361a7008c65 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:10.532478052 +0000 UTC m=+18.122302380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret") pod "global-pull-secret-syncer-hm2qh" (UID: "59c90c42-51b9-47a7-8ad3-1361a7008c65") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:02.949583 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:02.948771    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:02.949583 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.948966    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:02.949583 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:02.949373    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:02.949583 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:02.949488    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:03.948515 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:03.948029    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:03.948515 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:03.948167    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:04.948400 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:04.948318    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:04.948565 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:04.948460    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:04.948946 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:04.948692    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:04.948946 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:04.948786    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:05.947895 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:05.947860    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:05.948036 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:05.947961    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:06.948193 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:06.948157    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:06.948636 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:06.948200    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:06.948636 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:06.948314    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:06.948636 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:06.948389    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:07.947919 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:07.947879    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:07.948088 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:07.948011    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:08.948931 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:08.948684    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:08.949412 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:08.948691    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:08.949412 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:08.949034    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:08.949412 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:08.949118    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:09.948736 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:09.948700    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:09.948981 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:09.948840    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:10.490354 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:10.490317    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:10.490529 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:10.490378    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:10.490529 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.490478    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:10.490529 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.490491    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:10.490649 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.490561    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs podName:a1791e99-ae22-4734-96b8-eb1e70ce1d05 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:26.490544268 +0000 UTC m=+34.080368606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs") pod "network-metrics-daemon-7qqhq" (UID: "a1791e99-ae22-4734-96b8-eb1e70ce1d05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:10.490649 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.490497    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:10.490649 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.490601    2555 projected.go:196] Error preparing data for projected volume kube-api-access-9mvg9 for pod openshift-network-diagnostics/network-check-target-qkk4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:10.490773 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.490652    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9 podName:b4b3d3db-6fca-4562-95b3-dcb6b9f11257 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:26.490638222 +0000 UTC m=+34.080462562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mvg9" (UniqueName: "kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9") pod "network-check-target-qkk4l" (UID: "b4b3d3db-6fca-4562-95b3-dcb6b9f11257") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:10.591486 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:10.591446    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:10.591642 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.591576    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:10.591642 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.591634    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret podName:59c90c42-51b9-47a7-8ad3-1361a7008c65 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:26.591619667 +0000 UTC m=+34.181444007 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret") pod "global-pull-secret-syncer-hm2qh" (UID: "59c90c42-51b9-47a7-8ad3-1361a7008c65") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:10.948203 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:10.948075    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:10.948203 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:10.948078    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:10.948203 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.948189    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:10.948463 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:10.948304    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:11.948142 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:11.948110    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:11.948526 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:11.948227    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:12.949218 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:12.949183    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:12.949651 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:12.949298    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:12.949651 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:12.949364    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:12.949651 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:12.949480    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:13.948214 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:13.948181    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:13.948381 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:13.948312    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:14.948684 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:14.948441    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:14.949310 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:14.948502    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:14.949310 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:14.948797    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:14.949310 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:14.948919    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:15.134874 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.134787    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" event={"ID":"7f222340-1164-4de2-9a50-be0b4bd5ff0f","Type":"ContainerStarted","Data":"a25a8add573510dbab1335d6bb1cb361b0f21388bc6962ee9a15f2e5aeb4a171"}
Sep 15 09:07:15.135017 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.134881    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" event={"ID":"7f222340-1164-4de2-9a50-be0b4bd5ff0f","Type":"ContainerStarted","Data":"e2ea5df622afa73b4e4c550cee7c87465fd44a6a564ed7ee77e6b56ecdeef22d"}
Sep 15 09:07:15.135017 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.134946    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" event={"ID":"7f222340-1164-4de2-9a50-be0b4bd5ff0f","Type":"ContainerStarted","Data":"96b6fab0dd705f91b64b78d2109e6a00e2ae99aa680a34b458d3f37cbfc62ac6"}
Sep 15 09:07:15.135017 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.135006    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" event={"ID":"7f222340-1164-4de2-9a50-be0b4bd5ff0f","Type":"ContainerStarted","Data":"f7fc882b535d2d6fa03f0e9ce8a51f37e53d2cd44dee83258846358566d3de43"}
Sep 15 09:07:15.135142 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.135056    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" event={"ID":"7f222340-1164-4de2-9a50-be0b4bd5ff0f","Type":"ContainerStarted","Data":"13a23d88cd2c378f4302997d8e50befe0ffe5f11f15d96316e164d113dfd922b"}
Sep 15 09:07:15.135142 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.135094    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" event={"ID":"7f222340-1164-4de2-9a50-be0b4bd5ff0f","Type":"ContainerStarted","Data":"a79b8391531a8c3921c1900add3e1a0f36dc267f382cbe587790b68f56825e7c"}
Sep 15 09:07:15.136263 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.136239    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s5kmk" event={"ID":"50c5aa27-d229-4edc-9bf9-2142ce3e2bc5","Type":"ContainerStarted","Data":"f18569f509d8499e89033194b98c5224cca22a76ed58a9132fd0a8c937d7cc5a"}
Sep 15 09:07:15.137796 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.137772    2555 generic.go:356] "Generic (PLEG): container finished" podID="a65cdf45-fc8a-4bee-95c4-72fd9f36a211" containerID="1fcc80d8460e935be9ac86ce4fd3e11da6b76c19ccbae35b855c83f7c3223d58" exitCode=0
Sep 15 09:07:15.137905 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.137821    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnghd" event={"ID":"a65cdf45-fc8a-4bee-95c4-72fd9f36a211","Type":"ContainerDied","Data":"1fcc80d8460e935be9ac86ce4fd3e11da6b76c19ccbae35b855c83f7c3223d58"}
Sep 15 09:07:15.139359 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.139342    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7762s" event={"ID":"3dee9ad8-9f7c-4314-a0ff-b4669ad14bc4","Type":"ContainerStarted","Data":"b3e933f9e5401950b36fbd983bf5973bea9865f595b2e63c7e0021978ae2b73f"}
Sep 15 09:07:15.141118 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.140866    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-flrg9" event={"ID":"2f0f4746-99dd-4108-8702-8d9c3085e39f","Type":"ContainerStarted","Data":"6dccd5117ddaff7b58275dd8b255008c9539b3340c2a1c221418ea7d7204681c"}
Sep 15 09:07:15.143976 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.143818    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw" event={"ID":"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c","Type":"ContainerStarted","Data":"35702af2fb2880586f7f8d7f381dd0485fa3585b4e08453b63c24eb94bf22159"}
Sep 15 09:07:15.145562 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.145543    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvd2g" event={"ID":"413e8187-a2ca-44b8-afcf-8c6110442c6f","Type":"ContainerStarted","Data":"bef87e5fc43b02d59234c24c041004b700576720f690adc7e4196b755c8a8817"}
Sep 15 09:07:15.146959 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.146937    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vczs2" event={"ID":"122a3a00-a350-402e-a45e-0c11f278ab5f","Type":"ContainerStarted","Data":"c3cc6e2b609722f8e94f399b7ae0547606f95c8be4f44b021983c5a86e5fdb85"}
Sep 15 09:07:15.151106 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.151074    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-124.ec2.internal" podStartSLOduration=21.151063289 podStartE2EDuration="21.151063289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:06:58.117701293 +0000 UTC m=+5.707525646" watchObservedRunningTime="2026-09-15 09:07:15.151063289 +0000 UTC m=+22.740887636"
Sep 15 09:07:15.151351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.151332    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s5kmk" podStartSLOduration=4.113392746 podStartE2EDuration="22.151325914s" totalImagesPullingTime="18.037933168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:15.150841843 +0000 UTC m=+22.740666192" watchObservedRunningTime="2026-09-15 09:07:15.151325914 +0000 UTC m=+22.741150252"
Sep 15 09:07:15.167895 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.167834    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lvd2g" podStartSLOduration=4.15968415 podStartE2EDuration="22.167823065s" totalImagesPullingTime="18.008138915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:15.167469806 +0000 UTC m=+22.757294176" watchObservedRunningTime="2026-09-15 09:07:15.167823065 +0000 UTC m=+22.757647413"
Sep 15 09:07:15.183579 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.183549    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-flrg9" podStartSLOduration=4.110317312 podStartE2EDuration="22.183537967s" totalImagesPullingTime="18.073220655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:15.18320784 +0000 UTC m=+22.773032189" watchObservedRunningTime="2026-09-15 09:07:15.183537967 +0000 UTC m=+22.773362314"
Sep 15 09:07:15.199349 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.199317    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7762s" podStartSLOduration=4.17522075 podStartE2EDuration="22.199307261s" totalImagesPullingTime="18.024086511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:15.199160025 +0000 UTC m=+22.788984384" watchObservedRunningTime="2026-09-15 09:07:15.199307261 +0000 UTC m=+22.789131649"
Sep 15 09:07:15.215178 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.215137    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vczs2" podStartSLOduration=4.212842876 podStartE2EDuration="22.215121488s" totalImagesPullingTime="18.002278612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:15.214541331 +0000 UTC m=+22.804365690" watchObservedRunningTime="2026-09-15 09:07:15.215121488 +0000 UTC m=+22.804945837"
Sep 15 09:07:15.948482 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:15.948415    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:15.948621 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:15.948519    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:16.152174 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:16.152142    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m42d5" event={"ID":"17788574-b3c8-4671-9ac7-0712607cf46a","Type":"ContainerStarted","Data":"adbf0904f2224669bb37c4d2c0ea56a2093e43ff2302db434b27b060b4bd266c"}
Sep 15 09:07:16.464787 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:16.464583    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 09:07:16.947888 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:16.947863    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:16.948001 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:16.947863    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:16.948001 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:16.947980    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:16.948118 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:16.948035    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:16.969851 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:16.969754    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T09:07:16.464787117Z","UUID":"36710087-ac5c-48d3-8c0d-9741991a9f79","Handler":null,"Name":"","Endpoint":""}
Sep 15 09:07:16.971586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:16.971562    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 09:07:16.971679 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:16.971600    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 09:07:17.156925 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:17.156827    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw" event={"ID":"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c","Type":"ContainerStarted","Data":"555ace603bed28f4f82084c1b27564e3e671af8d11bf527788373cc3400ca96e"}
Sep 15 09:07:17.159771 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:17.159742    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" event={"ID":"7f222340-1164-4de2-9a50-be0b4bd5ff0f","Type":"ContainerStarted","Data":"6ab187b392766205c7ef4d3f252c78fd175f24ba061f7c82efb0a9f728fe1d73"}
Sep 15 09:07:17.948035 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:17.948000    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:17.948187 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:17.948134    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:18.163455 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:18.163424    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw" event={"ID":"fbc5dbe2-5d8e-4dd8-a344-5d7245c2757c","Type":"ContainerStarted","Data":"eed79e61090a6c54f38febc1096e56f21f280d9d33c2ebe3d1501a4bd35409ee"}
Sep 15 09:07:18.183751 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:18.183654    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgcdw" podStartSLOduration=3.80180823 podStartE2EDuration="25.183638965s" totalImagesPullingTime="21.381830735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:18.183519681 +0000 UTC m=+25.773344029" watchObservedRunningTime="2026-09-15 09:07:18.183638965 +0000 UTC m=+25.773463313"
Sep 15 09:07:18.184165 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:18.184127    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m42d5" podStartSLOduration=7.167764613 podStartE2EDuration="25.184119446s" totalImagesPullingTime="18.016354833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:16.166822681 +0000 UTC m=+23.756647028" watchObservedRunningTime="2026-09-15 09:07:18.184119446 +0000 UTC m=+25.773943794"
Sep 15 09:07:18.948528 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:18.948491    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:18.948714 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:18.948490    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:18.948714 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:18.948624    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:18.948714 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:18.948675    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:19.948156 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:19.948134    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:19.948410 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:19.948231    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:20.078880 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.078667    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:07:20.079338 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.079318    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:07:20.170991 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.170913    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnghd" event={"ID":"a65cdf45-fc8a-4bee-95c4-72fd9f36a211","Type":"ContainerStarted","Data":"9b90bec6a0c7fd62c6907bcddb1d43ce75dae2f5391bec839a59a80b54482f4d"}
Sep 15 09:07:20.174938 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.174903    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" event={"ID":"7f222340-1164-4de2-9a50-be0b4bd5ff0f","Type":"ContainerStarted","Data":"5b4514efd9c1fe71b8063fce1ef5c41c4d6e21d7a1bfd0ec985abd4473c3252e"}
Sep 15 09:07:20.178171 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.175431    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:07:20.178171 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.175745    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:07:20.199885 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.199865    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:07:20.214134 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.214096    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr" podStartSLOduration=9.116894954 podStartE2EDuration="27.214082228s" totalImagesPullingTime="18.097187274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:20.212757746 +0000 UTC m=+27.802582094" watchObservedRunningTime="2026-09-15 09:07:20.214082228 +0000 UTC m=+27.803906576"
Sep 15 09:07:20.734612 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.734583    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:07:20.735154 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.735135    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vczs2"
Sep 15 09:07:20.948712 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.948683    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:20.949281 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:20.948690    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:20.949281 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:20.948813    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:20.949281 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:20.948970    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:21.180135 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.180051    2555 generic.go:356] "Generic (PLEG): container finished" podID="a65cdf45-fc8a-4bee-95c4-72fd9f36a211" containerID="9b90bec6a0c7fd62c6907bcddb1d43ce75dae2f5391bec839a59a80b54482f4d" exitCode=0
Sep 15 09:07:21.180409 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.180233    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnghd" event={"ID":"a65cdf45-fc8a-4bee-95c4-72fd9f36a211","Type":"ContainerDied","Data":"9b90bec6a0c7fd62c6907bcddb1d43ce75dae2f5391bec839a59a80b54482f4d"}
Sep 15 09:07:21.182876 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.182698    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:07:21.202798 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.202771    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:07:21.848039 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.848007    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hm2qh"]
Sep 15 09:07:21.848187 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.848158    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:21.848292 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:21.848272    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:21.851019 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.850993    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qkk4l"]
Sep 15 09:07:21.851121 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.851098    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:21.851213 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:21.851190    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:21.851609 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.851589    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7qqhq"]
Sep 15 09:07:21.851741 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:21.851682    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:21.851841 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:21.851823    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:22.184438 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:22.184168    2555 generic.go:356] "Generic (PLEG): container finished" podID="a65cdf45-fc8a-4bee-95c4-72fd9f36a211" containerID="5fb5337b99d9e0134e576b62fe5b5092193a83e63ca9051509dbe1327e95eeeb" exitCode=0
Sep 15 09:07:22.185062 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:22.184232    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnghd" event={"ID":"a65cdf45-fc8a-4bee-95c4-72fd9f36a211","Type":"ContainerDied","Data":"5fb5337b99d9e0134e576b62fe5b5092193a83e63ca9051509dbe1327e95eeeb"}
Sep 15 09:07:23.948432 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:23.948392    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:23.948962 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:23.948533    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:23.948962 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:23.948548    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:23.948962 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:23.948634    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:23.948962 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:23.948655    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:23.948962 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:23.948748    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:25.194049 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:25.194019    2555 generic.go:356] "Generic (PLEG): container finished" podID="a65cdf45-fc8a-4bee-95c4-72fd9f36a211" containerID="75bff19c4407b74918ad80584b2870ff5809e5c25c2cf5dbd4c111bd0f6eb971" exitCode=0
Sep 15 09:07:25.194049 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:25.194067    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnghd" event={"ID":"a65cdf45-fc8a-4bee-95c4-72fd9f36a211","Type":"ContainerDied","Data":"75bff19c4407b74918ad80584b2870ff5809e5c25c2cf5dbd4c111bd0f6eb971"}
Sep 15 09:07:25.947941 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:25.947913    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:25.948093 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:25.947913    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:25.948093 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:25.948016    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:25.948093 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:25.947913    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:25.948093 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:25.948081    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:25.948224 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:25.948143    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:26.502716 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:26.502675    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:26.503207 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:26.502842    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:26.503207 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:26.502875    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:26.503207 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:26.502903    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:26.503207 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:26.502918    2555 projected.go:196] Error preparing data for projected volume kube-api-access-9mvg9 for pod openshift-network-diagnostics/network-check-target-qkk4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:26.503207 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:26.502957    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:26.503207 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:26.502982    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9 podName:b4b3d3db-6fca-4562-95b3-dcb6b9f11257 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:58.502962564 +0000 UTC m=+66.092786910 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mvg9" (UniqueName: "kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9") pod "network-check-target-qkk4l" (UID: "b4b3d3db-6fca-4562-95b3-dcb6b9f11257") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:26.503207 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:26.503016    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs podName:a1791e99-ae22-4734-96b8-eb1e70ce1d05 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:58.502997712 +0000 UTC m=+66.092822052 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs") pod "network-metrics-daemon-7qqhq" (UID: "a1791e99-ae22-4734-96b8-eb1e70ce1d05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:26.603915 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:26.603869    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:26.604095 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:26.604017    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:26.604158 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:26.604102    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret podName:59c90c42-51b9-47a7-8ad3-1361a7008c65 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:58.604088424 +0000 UTC m=+66.193912751 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret") pod "global-pull-secret-syncer-hm2qh" (UID: "59c90c42-51b9-47a7-8ad3-1361a7008c65") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:27.947782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:27.947743    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:27.947782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:27.947784    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:27.948318 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:27.947743    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:27.948318 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:27.947893    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qkk4l" podUID="b4b3d3db-6fca-4562-95b3-dcb6b9f11257"
Sep 15 09:07:27.948318 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:27.947977    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm2qh" podUID="59c90c42-51b9-47a7-8ad3-1361a7008c65"
Sep 15 09:07:27.948318 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:27.948074    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qqhq" podUID="a1791e99-ae22-4734-96b8-eb1e70ce1d05"
Sep 15 09:07:28.163969 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.163895    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-124.ec2.internal" event="NodeReady"
Sep 15 09:07:28.164120 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.164070    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 09:07:28.212302 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.212272    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5mlqf"]
Sep 15 09:07:28.235026 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.235000    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zqfz6"]
Sep 15 09:07:28.235169 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.235130    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.237966 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.237939    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 09:07:28.238180 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.238023    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 09:07:28.238180 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.238090    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lb4vr\""
Sep 15 09:07:28.249130 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.249105    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zqfz6"]
Sep 15 09:07:28.249130 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.249133    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5mlqf"]
Sep 15 09:07:28.249302 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.249196    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zqfz6"
Sep 15 09:07:28.252189 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.252161    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 09:07:28.252189 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.252162    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 09:07:28.252348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.252192    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 09:07:28.252348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.252263    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2z5lh\""
Sep 15 09:07:28.318637 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.318605    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a57a6a-206a-4619-8db7-6a4b72556702-config-volume\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.318806 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.318662    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2a57a6a-206a-4619-8db7-6a4b72556702-tmp-dir\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.318806 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.318691    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4h86\" (UniqueName: \"kubernetes.io/projected/f2a57a6a-206a-4619-8db7-6a4b72556702-kube-api-access-n4h86\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.318806 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.318749    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.420053 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.419968    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.420213 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.420060    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a57a6a-206a-4619-8db7-6a4b72556702-config-volume\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.420213 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.420088    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7dxf\" (UniqueName: \"kubernetes.io/projected/46b63c97-b3cf-4388-b759-cfbd781a1827-kube-api-access-g7dxf\") pod \"ingress-canary-zqfz6\" (UID: \"46b63c97-b3cf-4388-b759-cfbd781a1827\") " pod="openshift-ingress-canary/ingress-canary-zqfz6"
Sep 15 09:07:28.420213 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:28.420128    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:28.420213 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.420134    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46b63c97-b3cf-4388-b759-cfbd781a1827-cert\") pod \"ingress-canary-zqfz6\" (UID: \"46b63c97-b3cf-4388-b759-cfbd781a1827\") " pod="openshift-ingress-canary/ingress-canary-zqfz6"
Sep 15 09:07:28.420213 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.420174    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2a57a6a-206a-4619-8db7-6a4b72556702-tmp-dir\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.420213 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:28.420195    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls podName:f2a57a6a-206a-4619-8db7-6a4b72556702 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:28.920173923 +0000 UTC m=+36.509998272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls") pod "dns-default-5mlqf" (UID: "f2a57a6a-206a-4619-8db7-6a4b72556702") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:28.420512 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.420253    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4h86\" (UniqueName: \"kubernetes.io/projected/f2a57a6a-206a-4619-8db7-6a4b72556702-kube-api-access-n4h86\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.420569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.420527    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2a57a6a-206a-4619-8db7-6a4b72556702-tmp-dir\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.420702 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.420683    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a57a6a-206a-4619-8db7-6a4b72556702-config-volume\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.431803 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.431774    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4h86\" (UniqueName: \"kubernetes.io/projected/f2a57a6a-206a-4619-8db7-6a4b72556702-kube-api-access-n4h86\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.520649 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.520605    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7dxf\" (UniqueName: \"kubernetes.io/projected/46b63c97-b3cf-4388-b759-cfbd781a1827-kube-api-access-g7dxf\") pod \"ingress-canary-zqfz6\" (UID: \"46b63c97-b3cf-4388-b759-cfbd781a1827\") " pod="openshift-ingress-canary/ingress-canary-zqfz6"
Sep 15 09:07:28.520833 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.520668    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46b63c97-b3cf-4388-b759-cfbd781a1827-cert\") pod \"ingress-canary-zqfz6\" (UID: \"46b63c97-b3cf-4388-b759-cfbd781a1827\") " pod="openshift-ingress-canary/ingress-canary-zqfz6"
Sep 15 09:07:28.523718 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.523690    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46b63c97-b3cf-4388-b759-cfbd781a1827-cert\") pod \"ingress-canary-zqfz6\" (UID: \"46b63c97-b3cf-4388-b759-cfbd781a1827\") " pod="openshift-ingress-canary/ingress-canary-zqfz6"
Sep 15 09:07:28.529456 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.529433    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7dxf\" (UniqueName: \"kubernetes.io/projected/46b63c97-b3cf-4388-b759-cfbd781a1827-kube-api-access-g7dxf\") pod \"ingress-canary-zqfz6\" (UID: \"46b63c97-b3cf-4388-b759-cfbd781a1827\") " pod="openshift-ingress-canary/ingress-canary-zqfz6"
Sep 15 09:07:28.558958 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.558932    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zqfz6"
Sep 15 09:07:28.924289 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:28.924051    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:28.924469 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:28.924218    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:28.924469 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:28.924433    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls podName:f2a57a6a-206a-4619-8db7-6a4b72556702 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:29.924412903 +0000 UTC m=+37.514237244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls") pod "dns-default-5mlqf" (UID: "f2a57a6a-206a-4619-8db7-6a4b72556702") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:29.617888 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.617808    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zqfz6"]
Sep 15 09:07:29.622952 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:07:29.622920    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b63c97_b3cf_4388_b759_cfbd781a1827.slice/crio-89eb7e8630782e702c87c39c1c88c392476345a1bc8653063a411fc57b99b044 WatchSource:0}: Error finding container 89eb7e8630782e702c87c39c1c88c392476345a1bc8653063a411fc57b99b044: Status 404 returned error can't find the container with id 89eb7e8630782e702c87c39c1c88c392476345a1bc8653063a411fc57b99b044
Sep 15 09:07:29.932665 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.932590    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:29.932795 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:29.932770    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:29.932883 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:29.932871    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls podName:f2a57a6a-206a-4619-8db7-6a4b72556702 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:31.932833714 +0000 UTC m=+39.522658057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls") pod "dns-default-5mlqf" (UID: "f2a57a6a-206a-4619-8db7-6a4b72556702") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:29.948446 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.948422    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:29.948527 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.948513    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:29.948643 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.948624    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:29.952450 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.952430    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sxrmh\""
Sep 15 09:07:29.952450 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.952446    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwjtr\""
Sep 15 09:07:29.952614 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.952456    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 09:07:29.952614 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.952433    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 09:07:29.952614 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.952527    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 09:07:29.952614 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:29.952565    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 09:07:30.209902 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:30.209809    2555 generic.go:356] "Generic (PLEG): container finished" podID="a65cdf45-fc8a-4bee-95c4-72fd9f36a211" containerID="7383dc67d7610444d47b35f45c29c7a0f776d4fe804def7ea764d354185e0da0" exitCode=0
Sep 15 09:07:30.209902 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:30.209886    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnghd" event={"ID":"a65cdf45-fc8a-4bee-95c4-72fd9f36a211","Type":"ContainerDied","Data":"7383dc67d7610444d47b35f45c29c7a0f776d4fe804def7ea764d354185e0da0"}
Sep 15 09:07:30.211354 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:30.211327    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zqfz6" event={"ID":"46b63c97-b3cf-4388-b759-cfbd781a1827","Type":"ContainerStarted","Data":"89eb7e8630782e702c87c39c1c88c392476345a1bc8653063a411fc57b99b044"}
Sep 15 09:07:31.107523 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.107487    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7"]
Sep 15 09:07:31.117644 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.117618    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-46z86"]
Sep 15 09:07:31.117800 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.117767    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7"
Sep 15 09:07:31.120865 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.120827    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8788q\""
Sep 15 09:07:31.121172 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.121150    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 15 09:07:31.121351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.121337    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:07:31.127640 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.127611    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"]
Sep 15 09:07:31.127759 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.127748    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-46z86"
Sep 15 09:07:31.130229 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.130209    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-crhm6\""
Sep 15 09:07:31.138011 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.137993    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"]
Sep 15 09:07:31.138157 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.138139    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.141105 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.141084    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 15 09:07:31.141217 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.141118    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 15 09:07:31.141746 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.141728    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l7s52\""
Sep 15 09:07:31.141832 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.141751    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:07:31.141832 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.141765    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 15 09:07:31.144606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.144586    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-46z86"]
Sep 15 09:07:31.144673 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.144626    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7"]
Sep 15 09:07:31.144673 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.144648    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"]
Sep 15 09:07:31.144673 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.144669    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"]
Sep 15 09:07:31.144757 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.144747    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:31.147145 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.147131    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 15 09:07:31.147220 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.147210    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 15 09:07:31.147316 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.147303    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fhk6c\""
Sep 15 09:07:31.147372 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.147343    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:07:31.213355 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.213329    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-tptsl"]
Sep 15 09:07:31.220837 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.220808    2555 generic.go:356] "Generic (PLEG): container finished" podID="a65cdf45-fc8a-4bee-95c4-72fd9f36a211" containerID="68d540fefe41163d00b0cf1e22a1872c7a1980610a0ecd4fa3194c027639cd8e" exitCode=0
Sep 15 09:07:31.225129 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.225097    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnghd" event={"ID":"a65cdf45-fc8a-4bee-95c4-72fd9f36a211","Type":"ContainerDied","Data":"68d540fefe41163d00b0cf1e22a1872c7a1980610a0ecd4fa3194c027639cd8e"}
Sep 15 09:07:31.225261 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.225149    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d7db79dfb-597mt"]
Sep 15 09:07:31.225261 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.225224    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.227631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.227609    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 15 09:07:31.227753 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.227628    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ckcr4\""
Sep 15 09:07:31.227826 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.227749    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 15 09:07:31.227826 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.227762    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 09:07:31.228129 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.228101    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 09:07:31.236547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.236526    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 15 09:07:31.239249 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.239231    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-tptsl"]
Sep 15 09:07:31.239331 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.239269    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d7db79dfb-597mt"]
Sep 15 09:07:31.239371 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.239347    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.241688 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.241670    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8vjg9\""
Sep 15 09:07:31.241939 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.241924    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 09:07:31.242099 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.241981    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 09:07:31.242178 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.242031    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 09:07:31.242306 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.242285    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3300178a-eb71-4450-952d-5d66f2ba3a83-config\") pod \"service-ca-operator-cf7c776b7-dxbgc\" (UID: \"3300178a-eb71-4450-952d-5d66f2ba3a83\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.242397 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.242370    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlnxc\" (UniqueName: \"kubernetes.io/projected/e706f2c9-46e9-43d0-a23e-c7c5d207e4ce-kube-api-access-jlnxc\") pod \"volume-data-source-validator-86695b7cc7-n9bb7\" (UID: \"e706f2c9-46e9-43d0-a23e-c7c5d207e4ce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7"
Sep 15 09:07:31.242397 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.242390    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdjfk\" (UniqueName: \"kubernetes.io/projected/26d6c1f0-2e17-42db-bdd8-e69c02b7b524-kube-api-access-wdjfk\") pod \"network-check-source-6f8b768455-46z86\" (UID: \"26d6c1f0-2e17-42db-bdd8-e69c02b7b524\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-46z86"
Sep 15 09:07:31.242514 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.242412    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:31.242577 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.242517    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pntcb\" (UniqueName: \"kubernetes.io/projected/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-kube-api-access-pntcb\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:31.242577 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.242553    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jhfv\" (UniqueName: \"kubernetes.io/projected/3300178a-eb71-4450-952d-5d66f2ba3a83-kube-api-access-2jhfv\") pod \"service-ca-operator-cf7c776b7-dxbgc\" (UID: \"3300178a-eb71-4450-952d-5d66f2ba3a83\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.242680 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.242585    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3300178a-eb71-4450-952d-5d66f2ba3a83-serving-cert\") pod \"service-ca-operator-cf7c776b7-dxbgc\" (UID: \"3300178a-eb71-4450-952d-5d66f2ba3a83\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.247443 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.247423    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 09:07:31.313840 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.313807    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"]
Sep 15 09:07:31.322257 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.322234    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:31.325575 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.325429    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 09:07:31.325575 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.325448    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 15 09:07:31.327205 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.327033    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 15 09:07:31.327205 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.327075    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nqkhq\""
Sep 15 09:07:31.327205 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.327179    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"]
Sep 15 09:07:31.327361 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.327349    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 09:07:31.342905 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.342885    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlnxc\" (UniqueName: \"kubernetes.io/projected/e706f2c9-46e9-43d0-a23e-c7c5d207e4ce-kube-api-access-jlnxc\") pod \"volume-data-source-validator-86695b7cc7-n9bb7\" (UID: \"e706f2c9-46e9-43d0-a23e-c7c5d207e4ce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7"
Sep 15 09:07:31.342988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.342918    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdjfk\" (UniqueName: \"kubernetes.io/projected/26d6c1f0-2e17-42db-bdd8-e69c02b7b524-kube-api-access-wdjfk\") pod \"network-check-source-6f8b768455-46z86\" (UID: \"26d6c1f0-2e17-42db-bdd8-e69c02b7b524\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-46z86"
Sep 15 09:07:31.342988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.342941    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:31.343100 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343076    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc60eeb8-97da-45c7-b698-3c135ab7f08e-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.343156 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343109    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-trusted-ca\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.343156 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343143    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc60eeb8-97da-45c7-b698-3c135ab7f08e-snapshots\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.343246 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343169    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc60eeb8-97da-45c7-b698-3c135ab7f08e-tmp\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.343246 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.343193    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:07:31.343246 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343195    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-ca-trust-extracted\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.343384 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.343257    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls podName:e27bcdde-76e2-490c-870f-73e9ec2e3f0c nodeName:}" failed. No retries permitted until 2026-09-15 09:07:31.843236376 +0000 UTC m=+39.433060723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x62j9" (UID: "e27bcdde-76e2-490c-870f-73e9ec2e3f0c") : secret "samples-operator-tls" not found
Sep 15 09:07:31.343384 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343304    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-certificates\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.343384 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343361    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-installation-pull-secrets\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.343527 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343397    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pntcb\" (UniqueName: \"kubernetes.io/projected/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-kube-api-access-pntcb\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:31.343527 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343429    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlk7p\" (UniqueName: \"kubernetes.io/projected/cc60eeb8-97da-45c7-b698-3c135ab7f08e-kube-api-access-mlk7p\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.343527 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343460    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jhfv\" (UniqueName: \"kubernetes.io/projected/3300178a-eb71-4450-952d-5d66f2ba3a83-kube-api-access-2jhfv\") pod \"service-ca-operator-cf7c776b7-dxbgc\" (UID: \"3300178a-eb71-4450-952d-5d66f2ba3a83\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.343527 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343499    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3300178a-eb71-4450-952d-5d66f2ba3a83-serving-cert\") pod \"service-ca-operator-cf7c776b7-dxbgc\" (UID: \"3300178a-eb71-4450-952d-5d66f2ba3a83\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.343713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343526    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc60eeb8-97da-45c7-b698-3c135ab7f08e-service-ca-bundle\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.343713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343551    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc60eeb8-97da-45c7-b698-3c135ab7f08e-serving-cert\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.343713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343575    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-image-registry-private-configuration\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.343713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343659    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3300178a-eb71-4450-952d-5d66f2ba3a83-config\") pod \"service-ca-operator-cf7c776b7-dxbgc\" (UID: \"3300178a-eb71-4450-952d-5d66f2ba3a83\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.343713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343704    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.343948 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343730    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-bound-sa-token\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.343948 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.343756    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxsgj\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-kube-api-access-zxsgj\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.344169 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.344149    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3300178a-eb71-4450-952d-5d66f2ba3a83-config\") pod \"service-ca-operator-cf7c776b7-dxbgc\" (UID: \"3300178a-eb71-4450-952d-5d66f2ba3a83\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.346325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.346306    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3300178a-eb71-4450-952d-5d66f2ba3a83-serving-cert\") pod \"service-ca-operator-cf7c776b7-dxbgc\" (UID: \"3300178a-eb71-4450-952d-5d66f2ba3a83\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.356426 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.356403    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdjfk\" (UniqueName: \"kubernetes.io/projected/26d6c1f0-2e17-42db-bdd8-e69c02b7b524-kube-api-access-wdjfk\") pod \"network-check-source-6f8b768455-46z86\" (UID: \"26d6c1f0-2e17-42db-bdd8-e69c02b7b524\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-46z86"
Sep 15 09:07:31.356552 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.356526    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pntcb\" (UniqueName: \"kubernetes.io/projected/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-kube-api-access-pntcb\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:31.356631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.356535    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jhfv\" (UniqueName: \"kubernetes.io/projected/3300178a-eb71-4450-952d-5d66f2ba3a83-kube-api-access-2jhfv\") pod \"service-ca-operator-cf7c776b7-dxbgc\" (UID: \"3300178a-eb71-4450-952d-5d66f2ba3a83\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.356631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.356585    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlnxc\" (UniqueName: \"kubernetes.io/projected/e706f2c9-46e9-43d0-a23e-c7c5d207e4ce-kube-api-access-jlnxc\") pod \"volume-data-source-validator-86695b7cc7-n9bb7\" (UID: \"e706f2c9-46e9-43d0-a23e-c7c5d207e4ce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7"
Sep 15 09:07:31.429597 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.429513    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7"
Sep 15 09:07:31.437657 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.437625    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-46z86"
Sep 15 09:07:31.444990 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.444960    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-image-registry-private-configuration\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.445106 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.444995    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-trusted-ca\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.445106 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.445038    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc60eeb8-97da-45c7-b698-3c135ab7f08e-tmp\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.445106 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.445095    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-installation-pull-secrets\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.445279 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.445144    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc60eeb8-97da-45c7-b698-3c135ab7f08e-serving-cert\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.445279 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.445179    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.445376 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.445293    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc60eeb8-97da-45c7-b698-3c135ab7f08e-snapshots\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.445376 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.445332    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:31.445480 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.445399    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc60eeb8-97da-45c7-b698-3c135ab7f08e-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.445480 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.445428    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-ca-trust-extracted\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.445480 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.445299    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:07:31.445480 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.445466    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7db79dfb-597mt: secret "image-registry-tls" not found
Sep 15 09:07:31.445631 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.445539    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls podName:29c1e868-2f3f-4f50-8265-eb7bb2c1f814 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:31.945512498 +0000 UTC m=+39.535337042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls") pod "image-registry-6d7db79dfb-597mt" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814") : secret "image-registry-tls" not found
Sep 15 09:07:31.446032 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446009    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-certificates\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.446317 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446291    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-trusted-ca\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.446355 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446328    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-ca-trust-extracted\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.446395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.445461    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-certificates\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.446434 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446396    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbpq4\" (UniqueName: \"kubernetes.io/projected/d6cd90bf-9aed-4a54-baed-0474366ddf5b-kube-api-access-rbpq4\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:31.446434 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446417    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc60eeb8-97da-45c7-b698-3c135ab7f08e-snapshots\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.446606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446431    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlk7p\" (UniqueName: \"kubernetes.io/projected/cc60eeb8-97da-45c7-b698-3c135ab7f08e-kube-api-access-mlk7p\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.446606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446476    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d6cd90bf-9aed-4a54-baed-0474366ddf5b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:31.446606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446510    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc60eeb8-97da-45c7-b698-3c135ab7f08e-service-ca-bundle\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.446606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446537    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-bound-sa-token\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.446606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446554    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc60eeb8-97da-45c7-b698-3c135ab7f08e-tmp\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.446606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446564    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxsgj\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-kube-api-access-zxsgj\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.446864 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.446833    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"
Sep 15 09:07:31.447031 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.447003    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc60eeb8-97da-45c7-b698-3c135ab7f08e-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.447163 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.447098    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc60eeb8-97da-45c7-b698-3c135ab7f08e-service-ca-bundle\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.448055 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.448016    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc60eeb8-97da-45c7-b698-3c135ab7f08e-serving-cert\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.448191 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.448170    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-installation-pull-secrets\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.448974 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.448955    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-image-registry-private-configuration\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.456735 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.456693    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlk7p\" (UniqueName: \"kubernetes.io/projected/cc60eeb8-97da-45c7-b698-3c135ab7f08e-kube-api-access-mlk7p\") pod \"insights-operator-5844b856db-tptsl\" (UID: \"cc60eeb8-97da-45c7-b698-3c135ab7f08e\") " pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.456735 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.456707    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-bound-sa-token\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.457112 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.457093    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxsgj\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-kube-api-access-zxsgj\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.537005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.536971    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-tptsl"
Sep 15 09:07:31.547626 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.547593    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:31.548088 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.547683    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbpq4\" (UniqueName: \"kubernetes.io/projected/d6cd90bf-9aed-4a54-baed-0474366ddf5b-kube-api-access-rbpq4\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:31.548088 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.547715    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d6cd90bf-9aed-4a54-baed-0474366ddf5b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:31.548088 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.547756    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:31.548088 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.547824    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls podName:d6cd90bf-9aed-4a54-baed-0474366ddf5b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:32.047802484 +0000 UTC m=+39.637626824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-ksxzd" (UID: "d6cd90bf-9aed-4a54-baed-0474366ddf5b") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:31.548604 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.548583    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d6cd90bf-9aed-4a54-baed-0474366ddf5b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:31.557070 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.557036    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbpq4\" (UniqueName: \"kubernetes.io/projected/d6cd90bf-9aed-4a54-baed-0474366ddf5b-kube-api-access-rbpq4\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:31.851310 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.851267    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:31.851518 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.851464    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:07:31.851588 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.851565    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls podName:e27bcdde-76e2-490c-870f-73e9ec2e3f0c nodeName:}" failed. No retries permitted until 2026-09-15 09:07:32.851543473 +0000 UTC m=+40.441367807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x62j9" (UID: "e27bcdde-76e2-490c-870f-73e9ec2e3f0c") : secret "samples-operator-tls" not found
Sep 15 09:07:31.952286 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.952254    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:31.952436 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:31.952348    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:31.952436 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.952407    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:07:31.952436 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.952428    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7db79dfb-597mt: secret "image-registry-tls" not found
Sep 15 09:07:31.952527 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.952445    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:31.952527 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.952493    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls podName:29c1e868-2f3f-4f50-8265-eb7bb2c1f814 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:32.952477972 +0000 UTC m=+40.542302301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls") pod "image-registry-6d7db79dfb-597mt" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814") : secret "image-registry-tls" not found
Sep 15 09:07:31.952527 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:31.952507    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls podName:f2a57a6a-206a-4619-8db7-6a4b72556702 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:35.952500869 +0000 UTC m=+43.542325195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls") pod "dns-default-5mlqf" (UID: "f2a57a6a-206a-4619-8db7-6a4b72556702") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:32.053689 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:32.053427    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:32.053867 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:32.053562    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:32.053867 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:32.053823    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls podName:d6cd90bf-9aed-4a54-baed-0474366ddf5b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:33.053802479 +0000 UTC m=+40.643626818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-ksxzd" (UID: "d6cd90bf-9aed-4a54-baed-0474366ddf5b") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:32.227295 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:32.227254    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnghd" event={"ID":"a65cdf45-fc8a-4bee-95c4-72fd9f36a211","Type":"ContainerStarted","Data":"5ef1d0f586f629a71986e0aec24d6a0ecbaefe8eafbc2d1e7583949c36b1a83e"}
Sep 15 09:07:32.237633 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:32.237594    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc"]
Sep 15 09:07:32.246601 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:32.246574    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7"]
Sep 15 09:07:32.247811 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:32.247786    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-46z86"]
Sep 15 09:07:32.248656 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:32.248637    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-tptsl"]
Sep 15 09:07:32.253521 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:32.253474    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rnghd" podStartSLOduration=9.378550073 podStartE2EDuration="39.253456661s" totalImagesPullingTime="29.874906588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:32.2519289 +0000 UTC m=+39.841753247" watchObservedRunningTime="2026-09-15 09:07:32.253456661 +0000 UTC m=+39.843281009"
Sep 15 09:07:32.308938 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:07:32.308917    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3300178a_eb71_4450_952d_5d66f2ba3a83.slice/crio-ce1609e8a09579e50c4bc9e2aeb77900df58590c99374f8cb01f198a25adc6a5 WatchSource:0}: Error finding container ce1609e8a09579e50c4bc9e2aeb77900df58590c99374f8cb01f198a25adc6a5: Status 404 returned error can't find the container with id ce1609e8a09579e50c4bc9e2aeb77900df58590c99374f8cb01f198a25adc6a5
Sep 15 09:07:32.309566 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:07:32.309544    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc60eeb8_97da_45c7_b698_3c135ab7f08e.slice/crio-a7efdda7132ded08c8d4a9fa9bfc1dbe5afe04c444dbf8091d551bcd6017d5e8 WatchSource:0}: Error finding container a7efdda7132ded08c8d4a9fa9bfc1dbe5afe04c444dbf8091d551bcd6017d5e8: Status 404 returned error can't find the container with id a7efdda7132ded08c8d4a9fa9bfc1dbe5afe04c444dbf8091d551bcd6017d5e8
Sep 15 09:07:32.311917 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:07:32.310871    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode706f2c9_46e9_43d0_a23e_c7c5d207e4ce.slice/crio-5af6c4da584b7e8f158e43257b5395296713018afe8578cc3b9ce67ec0fde7a0 WatchSource:0}: Error finding container 5af6c4da584b7e8f158e43257b5395296713018afe8578cc3b9ce67ec0fde7a0: Status 404 returned error can't find the container with id 5af6c4da584b7e8f158e43257b5395296713018afe8578cc3b9ce67ec0fde7a0
Sep 15 09:07:32.313578 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:07:32.313553    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d6c1f0_2e17_42db_bdd8_e69c02b7b524.slice/crio-0391b039a9c6977cd08dc0fa73166fabbb473c16a55df0d812705d5056b41350 WatchSource:0}: Error finding container 0391b039a9c6977cd08dc0fa73166fabbb473c16a55df0d812705d5056b41350: Status 404 returned error can't find the container with id 0391b039a9c6977cd08dc0fa73166fabbb473c16a55df0d812705d5056b41350
Sep 15 09:07:32.860419 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:32.860381    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:32.860605 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:32.860536    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:07:32.860605 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:32.860601    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls podName:e27bcdde-76e2-490c-870f-73e9ec2e3f0c nodeName:}" failed. No retries permitted until 2026-09-15 09:07:34.860585084 +0000 UTC m=+42.450409415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x62j9" (UID: "e27bcdde-76e2-490c-870f-73e9ec2e3f0c") : secret "samples-operator-tls" not found
Sep 15 09:07:32.961029 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:32.960981    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:32.961189 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:32.961125    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:07:32.961189 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:32.961140    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7db79dfb-597mt: secret "image-registry-tls" not found
Sep 15 09:07:32.961290 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:32.961200    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls podName:29c1e868-2f3f-4f50-8265-eb7bb2c1f814 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:34.961183209 +0000 UTC m=+42.551007541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls") pod "image-registry-6d7db79dfb-597mt" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814") : secret "image-registry-tls" not found
Sep 15 09:07:33.061937 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:33.061894    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:33.062125 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:33.062033    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:33.062125 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:33.062121    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls podName:d6cd90bf-9aed-4a54-baed-0474366ddf5b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:35.062098074 +0000 UTC m=+42.651922414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-ksxzd" (UID: "d6cd90bf-9aed-4a54-baed-0474366ddf5b") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:33.233269 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:33.232887    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zqfz6" event={"ID":"46b63c97-b3cf-4388-b759-cfbd781a1827","Type":"ContainerStarted","Data":"400467a92f9ebabe2e01e490647ad9aea628655ff7b8a2472e215d09f88e5055"}
Sep 15 09:07:33.234716 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:33.234654    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tptsl" event={"ID":"cc60eeb8-97da-45c7-b698-3c135ab7f08e","Type":"ContainerStarted","Data":"a7efdda7132ded08c8d4a9fa9bfc1dbe5afe04c444dbf8091d551bcd6017d5e8"}
Sep 15 09:07:33.238331 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:33.238306    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-46z86" event={"ID":"26d6c1f0-2e17-42db-bdd8-e69c02b7b524","Type":"ContainerStarted","Data":"0391b039a9c6977cd08dc0fa73166fabbb473c16a55df0d812705d5056b41350"}
Sep 15 09:07:33.239730 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:33.239706    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc" event={"ID":"3300178a-eb71-4450-952d-5d66f2ba3a83","Type":"ContainerStarted","Data":"ce1609e8a09579e50c4bc9e2aeb77900df58590c99374f8cb01f198a25adc6a5"}
Sep 15 09:07:33.241971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:33.241922    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7" event={"ID":"e706f2c9-46e9-43d0-a23e-c7c5d207e4ce","Type":"ContainerStarted","Data":"5af6c4da584b7e8f158e43257b5395296713018afe8578cc3b9ce67ec0fde7a0"}
Sep 15 09:07:33.251669 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:33.251512    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zqfz6" podStartSLOduration=2.532341546 podStartE2EDuration="5.251494852s" totalImagesPullingTime="2.719153306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:33.250437265 +0000 UTC m=+40.840261626" watchObservedRunningTime="2026-09-15 09:07:33.251494852 +0000 UTC m=+40.841319201"
Sep 15 09:07:34.879860 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:34.879801    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:34.880257 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:34.879962    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:07:34.880257 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:34.880031    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls podName:e27bcdde-76e2-490c-870f-73e9ec2e3f0c nodeName:}" failed. No retries permitted until 2026-09-15 09:07:38.880014864 +0000 UTC m=+46.469839195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x62j9" (UID: "e27bcdde-76e2-490c-870f-73e9ec2e3f0c") : secret "samples-operator-tls" not found
Sep 15 09:07:34.980477 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:34.980443    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:34.980667 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:34.980605    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:07:34.980667 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:34.980626    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7db79dfb-597mt: secret "image-registry-tls" not found
Sep 15 09:07:34.980776 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:34.980692    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls podName:29c1e868-2f3f-4f50-8265-eb7bb2c1f814 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:38.98067189 +0000 UTC m=+46.570496234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls") pod "image-registry-6d7db79dfb-597mt" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814") : secret "image-registry-tls" not found
Sep 15 09:07:35.081426 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:35.081364    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:35.081618 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:35.081549    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:35.081618 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:35.081618    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls podName:d6cd90bf-9aed-4a54-baed-0474366ddf5b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:39.081600666 +0000 UTC m=+46.671425006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-ksxzd" (UID: "d6cd90bf-9aed-4a54-baed-0474366ddf5b") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:35.987905 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:35.987863    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:35.988343 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:35.987951    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:35.988343 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:35.988036    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls podName:f2a57a6a-206a-4619-8db7-6a4b72556702 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:43.988015268 +0000 UTC m=+51.577839599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls") pod "dns-default-5mlqf" (UID: "f2a57a6a-206a-4619-8db7-6a4b72556702") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:37.256512 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.256417    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7" event={"ID":"e706f2c9-46e9-43d0-a23e-c7c5d207e4ce","Type":"ContainerStarted","Data":"00d29e32226e7f742e6a935bb5ba3636b40d65b8640d11c3c90fe001b182d3cc"}
Sep 15 09:07:37.258031 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.257991    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tptsl" event={"ID":"cc60eeb8-97da-45c7-b698-3c135ab7f08e","Type":"ContainerStarted","Data":"777ae69c16b2bac91ee4ab45c5b9faa37a82174e0ff22d322c8a515393ae5f0a"}
Sep 15 09:07:37.259693 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.259669    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-46z86" event={"ID":"26d6c1f0-2e17-42db-bdd8-e69c02b7b524","Type":"ContainerStarted","Data":"bb993c8ad30feb558babee2a1eb9ee5b0a70423d362b067e47936d403125f23d"}
Sep 15 09:07:37.261461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.261442    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc" event={"ID":"3300178a-eb71-4450-952d-5d66f2ba3a83","Type":"ContainerStarted","Data":"202f0b22b5192021619c4de34913fab0bdb428bdc2312c27b9013e91d0491be9"}
Sep 15 09:07:37.272525 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.272488    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-n9bb7" podStartSLOduration=1.99760245 podStartE2EDuration="6.272475535s" totalImagesPullingTime="4.274873085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:37.271832695 +0000 UTC m=+44.861657043" watchObservedRunningTime="2026-09-15 09:07:37.272475535 +0000 UTC m=+44.862299891"
Sep 15 09:07:37.290575 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.290529    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-tptsl" podStartSLOduration=2.014608675 podStartE2EDuration="6.290516967s" totalImagesPullingTime="4.275908292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:37.289745992 +0000 UTC m=+44.879570339" watchObservedRunningTime="2026-09-15 09:07:37.290516967 +0000 UTC m=+44.880341315"
Sep 15 09:07:37.307338 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.307293    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc" podStartSLOduration=1.651256158 podStartE2EDuration="6.307278716s" totalImagesPullingTime="4.656022558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:37.306447127 +0000 UTC m=+44.896271475" watchObservedRunningTime="2026-09-15 09:07:37.307278716 +0000 UTC m=+44.897103063"
Sep 15 09:07:37.328108 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.328064    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-46z86" podStartSLOduration=2.051934564 podStartE2EDuration="6.328048677s" totalImagesPullingTime="4.276114113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:37.327589189 +0000 UTC m=+44.917413538" watchObservedRunningTime="2026-09-15 09:07:37.328048677 +0000 UTC m=+44.917873025"
Sep 15 09:07:37.709214 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.709135    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2pgl7"]
Sep 15 09:07:37.731054 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.731026    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2pgl7"]
Sep 15 09:07:37.731220 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.731128    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.733792 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.733766    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 09:07:37.733944 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.733774    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 09:07:37.734141 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.734117    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwr78\""
Sep 15 09:07:37.801708 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.801673    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x5jm\" (UniqueName: \"kubernetes.io/projected/14f53453-227e-4a22-b572-76fd63c0027a-kube-api-access-7x5jm\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.801906 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.801769    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.801906 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.801832    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14f53453-227e-4a22-b572-76fd63c0027a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.801906 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.801866    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f53453-227e-4a22-b572-76fd63c0027a-data-volume\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.802049 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.801911    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14f53453-227e-4a22-b572-76fd63c0027a-crio-socket\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.902858 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.902806    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14f53453-227e-4a22-b572-76fd63c0027a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.902858 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.902861    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f53453-227e-4a22-b572-76fd63c0027a-data-volume\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.903105 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.902885    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14f53453-227e-4a22-b572-76fd63c0027a-crio-socket\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.903105 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.902905    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x5jm\" (UniqueName: \"kubernetes.io/projected/14f53453-227e-4a22-b572-76fd63c0027a-kube-api-access-7x5jm\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.903105 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:37.902941    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:07:37.903105 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.902967    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.903105 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:37.903037    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14f53453-227e-4a22-b572-76fd63c0027a-kube-rbac-proxy-cm podName:14f53453-227e-4a22-b572-76fd63c0027a nodeName:}" failed. No retries permitted until 2026-09-15 09:07:38.403014544 +0000 UTC m=+45.992838890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/14f53453-227e-4a22-b572-76fd63c0027a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2pgl7" (UID: "14f53453-227e-4a22-b572-76fd63c0027a") : configmap "kube-rbac-proxy" not found
Sep 15 09:07:37.903105 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:37.903085    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:37.903376 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:37.903146    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls podName:14f53453-227e-4a22-b572-76fd63c0027a nodeName:}" failed. No retries permitted until 2026-09-15 09:07:38.403130618 +0000 UTC m=+45.992954943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2pgl7" (UID: "14f53453-227e-4a22-b572-76fd63c0027a") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:37.903376 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.903156    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14f53453-227e-4a22-b572-76fd63c0027a-crio-socket\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.903376 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.903297    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f53453-227e-4a22-b572-76fd63c0027a-data-volume\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:37.911945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:37.911920    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x5jm\" (UniqueName: \"kubernetes.io/projected/14f53453-227e-4a22-b572-76fd63c0027a-kube-api-access-7x5jm\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:38.407014 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:38.406974    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:38.407351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:38.407120    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14f53453-227e-4a22-b572-76fd63c0027a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:38.407351 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:38.407144    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:38.407351 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:38.407196    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:07:38.407351 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:38.407214    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls podName:14f53453-227e-4a22-b572-76fd63c0027a nodeName:}" failed. No retries permitted until 2026-09-15 09:07:39.407197953 +0000 UTC m=+46.997022283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2pgl7" (UID: "14f53453-227e-4a22-b572-76fd63c0027a") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:38.407351 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:38.407272    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14f53453-227e-4a22-b572-76fd63c0027a-kube-rbac-proxy-cm podName:14f53453-227e-4a22-b572-76fd63c0027a nodeName:}" failed. No retries permitted until 2026-09-15 09:07:39.407257806 +0000 UTC m=+46.997082132 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/14f53453-227e-4a22-b572-76fd63c0027a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2pgl7" (UID: "14f53453-227e-4a22-b572-76fd63c0027a") : configmap "kube-rbac-proxy" not found
Sep 15 09:07:38.911193 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:38.911155    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:38.911360 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:38.911276    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:07:38.911360 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:38.911328    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls podName:e27bcdde-76e2-490c-870f-73e9ec2e3f0c nodeName:}" failed. No retries permitted until 2026-09-15 09:07:46.911314849 +0000 UTC m=+54.501139175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x62j9" (UID: "e27bcdde-76e2-490c-870f-73e9ec2e3f0c") : secret "samples-operator-tls" not found
Sep 15 09:07:39.011497 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:39.011460    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:39.011666 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:39.011624    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:07:39.011666 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:39.011647    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7db79dfb-597mt: secret "image-registry-tls" not found
Sep 15 09:07:39.011795 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:39.011711    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls podName:29c1e868-2f3f-4f50-8265-eb7bb2c1f814 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:47.011693768 +0000 UTC m=+54.601518100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls") pod "image-registry-6d7db79dfb-597mt" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814") : secret "image-registry-tls" not found
Sep 15 09:07:39.112124 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:39.112090    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:39.112276 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:39.112226    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:39.112317 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:39.112287    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls podName:d6cd90bf-9aed-4a54-baed-0474366ddf5b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:47.112273726 +0000 UTC m=+54.702098057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-ksxzd" (UID: "d6cd90bf-9aed-4a54-baed-0474366ddf5b") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:39.414886 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:39.414833    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:39.415326 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:39.414954    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14f53453-227e-4a22-b572-76fd63c0027a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:39.415326 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:39.414989    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:39.415326 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:39.415083    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls podName:14f53453-227e-4a22-b572-76fd63c0027a nodeName:}" failed. No retries permitted until 2026-09-15 09:07:41.415061412 +0000 UTC m=+49.004885753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2pgl7" (UID: "14f53453-227e-4a22-b572-76fd63c0027a") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:39.415487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:39.415466    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14f53453-227e-4a22-b572-76fd63c0027a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:40.287037 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:40.287011    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvd2g_413e8187-a2ca-44b8-afcf-8c6110442c6f/dns-node-resolver/0.log"
Sep 15 09:07:41.087177 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:41.087149    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s5kmk_50c5aa27-d229-4edc-9bf9-2142ce3e2bc5/node-ca/0.log"
Sep 15 09:07:41.432172 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:41.432090    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:41.432319 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:41.432249    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:41.432358 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:41.432351    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls podName:14f53453-227e-4a22-b572-76fd63c0027a nodeName:}" failed. No retries permitted until 2026-09-15 09:07:45.43233583 +0000 UTC m=+53.022160160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2pgl7" (UID: "14f53453-227e-4a22-b572-76fd63c0027a") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:41.888057 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:41.888031    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zqfz6_46b63c97-b3cf-4388-b759-cfbd781a1827/serve-healthcheck-canary/0.log"
Sep 15 09:07:44.053612 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:44.053577    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:07:44.054065 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:44.053722    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:44.054065 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:44.053785    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls podName:f2a57a6a-206a-4619-8db7-6a4b72556702 nodeName:}" failed. No retries permitted until 2026-09-15 09:08:00.053769801 +0000 UTC m=+67.643594132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls") pod "dns-default-5mlqf" (UID: "f2a57a6a-206a-4619-8db7-6a4b72556702") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:45.464070 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:45.464032    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:45.464547 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:45.464211    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:45.464547 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:45.464310    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls podName:14f53453-227e-4a22-b572-76fd63c0027a nodeName:}" failed. No retries permitted until 2026-09-15 09:07:53.46428817 +0000 UTC m=+61.054112510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2pgl7" (UID: "14f53453-227e-4a22-b572-76fd63c0027a") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:46.975700 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:46.975668    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:07:46.976136 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:46.975780    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:07:46.976136 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:46.975836    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls podName:e27bcdde-76e2-490c-870f-73e9ec2e3f0c nodeName:}" failed. No retries permitted until 2026-09-15 09:08:02.975819369 +0000 UTC m=+70.565643900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x62j9" (UID: "e27bcdde-76e2-490c-870f-73e9ec2e3f0c") : secret "samples-operator-tls" not found
Sep 15 09:07:47.076931 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:47.076899    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:07:47.077124 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:47.077064    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:07:47.077124 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:47.077084    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7db79dfb-597mt: secret "image-registry-tls" not found
Sep 15 09:07:47.077221 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:47.077139    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls podName:29c1e868-2f3f-4f50-8265-eb7bb2c1f814 nodeName:}" failed. No retries permitted until 2026-09-15 09:08:03.077123375 +0000 UTC m=+70.666947706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls") pod "image-registry-6d7db79dfb-597mt" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814") : secret "image-registry-tls" not found
Sep 15 09:07:47.177781 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:47.177743    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:07:47.177964 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:47.177886    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:47.177964 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:07:47.177943    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls podName:d6cd90bf-9aed-4a54-baed-0474366ddf5b nodeName:}" failed. No retries permitted until 2026-09-15 09:08:03.177927473 +0000 UTC m=+70.767751808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-ksxzd" (UID: "d6cd90bf-9aed-4a54-baed-0474366ddf5b") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:07:53.197181 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:53.197150    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjggr"
Sep 15 09:07:53.530745 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:53.530701    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:53.532971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:53.532949    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f53453-227e-4a22-b572-76fd63c0027a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pgl7\" (UID: \"14f53453-227e-4a22-b572-76fd63c0027a\") " pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:53.647084 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:53.647052    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwr78\""
Sep 15 09:07:53.655281 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:53.655259    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2pgl7"
Sep 15 09:07:53.919741 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:53.919665    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2pgl7"]
Sep 15 09:07:53.922883 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:07:53.922840    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f53453_227e_4a22_b572_76fd63c0027a.slice/crio-1e83d6172263b45b2e19d16e2870a43f0c623ee1e6725781d3a36b53ae6e8e75 WatchSource:0}: Error finding container 1e83d6172263b45b2e19d16e2870a43f0c623ee1e6725781d3a36b53ae6e8e75: Status 404 returned error can't find the container with id 1e83d6172263b45b2e19d16e2870a43f0c623ee1e6725781d3a36b53ae6e8e75
Sep 15 09:07:54.307483 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:54.307451    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2pgl7" event={"ID":"14f53453-227e-4a22-b572-76fd63c0027a","Type":"ContainerStarted","Data":"7a9b528f2f958b8231db0f40e9dc3879cbcd0358af6ca21a01810d052ef3ee9b"}
Sep 15 09:07:54.307875 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:54.307501    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2pgl7" event={"ID":"14f53453-227e-4a22-b572-76fd63c0027a","Type":"ContainerStarted","Data":"1e83d6172263b45b2e19d16e2870a43f0c623ee1e6725781d3a36b53ae6e8e75"}
Sep 15 09:07:56.314450 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:56.314412    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2pgl7" event={"ID":"14f53453-227e-4a22-b572-76fd63c0027a","Type":"ContainerStarted","Data":"adb173ee6587947275012bdcfeca1956a43a21fb5a9209363d74d444d01fb8b8"}
Sep 15 09:07:57.320661 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:57.320619    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2pgl7" event={"ID":"14f53453-227e-4a22-b572-76fd63c0027a","Type":"ContainerStarted","Data":"5be24ccb2d7f3410f81e65ddb9993c45f982066adb0cd705a597b471c8f0ad8e"}
Sep 15 09:07:57.340567 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:57.340514    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2pgl7" podStartSLOduration=17.136242681 podStartE2EDuration="20.340497431s" totalImagesPullingTime="3.20425475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:57.338970329 +0000 UTC m=+64.928794677" watchObservedRunningTime="2026-09-15 09:07:57.340497431 +0000 UTC m=+64.930321778"
Sep 15 09:07:58.570907 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.570842    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:58.571371 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.570928    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:58.573427 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.573402    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mvg9\" (UniqueName: \"kubernetes.io/projected/b4b3d3db-6fca-4562-95b3-dcb6b9f11257-kube-api-access-9mvg9\") pod \"network-check-target-qkk4l\" (UID: \"b4b3d3db-6fca-4562-95b3-dcb6b9f11257\") " pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:58.573547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.573531    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 09:07:58.583568 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.583547    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1791e99-ae22-4734-96b8-eb1e70ce1d05-metrics-certs\") pod \"network-metrics-daemon-7qqhq\" (UID: \"a1791e99-ae22-4734-96b8-eb1e70ce1d05\") " pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:58.672191 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.672149    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:58.674974 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.674955    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 09:07:58.685135 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.685115    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c90c42-51b9-47a7-8ad3-1361a7008c65-original-pull-secret\") pod \"global-pull-secret-syncer-hm2qh\" (UID: \"59c90c42-51b9-47a7-8ad3-1361a7008c65\") " pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:58.760528 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.760499    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sxrmh\""
Sep 15 09:07:58.763663 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.763644    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm2qh"
Sep 15 09:07:58.768142 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.768123    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:58.770233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.770217    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwjtr\""
Sep 15 09:07:58.779133 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:58.779110    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qqhq"
Sep 15 09:07:59.036531 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:59.036499    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hm2qh"]
Sep 15 09:07:59.039469 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:07:59.039444    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c90c42_51b9_47a7_8ad3_1361a7008c65.slice/crio-236640653bdbe64683792f639b1f6bf0164b34605cbbf69cd8c5dfdde82d91f1 WatchSource:0}: Error finding container 236640653bdbe64683792f639b1f6bf0164b34605cbbf69cd8c5dfdde82d91f1: Status 404 returned error can't find the container with id 236640653bdbe64683792f639b1f6bf0164b34605cbbf69cd8c5dfdde82d91f1
Sep 15 09:07:59.042165 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:59.042141    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qkk4l"]
Sep 15 09:07:59.044691 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:07:59.044670    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b3d3db_6fca_4562_95b3_dcb6b9f11257.slice/crio-457f9ed287245d7b0ce0954ab7124b40c8263188b935f54619de15431ef8cef7 WatchSource:0}: Error finding container 457f9ed287245d7b0ce0954ab7124b40c8263188b935f54619de15431ef8cef7: Status 404 returned error can't find the container with id 457f9ed287245d7b0ce0954ab7124b40c8263188b935f54619de15431ef8cef7
Sep 15 09:07:59.063341 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:59.063317    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7qqhq"]
Sep 15 09:07:59.071744 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:07:59.071699    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1791e99_ae22_4734_96b8_eb1e70ce1d05.slice/crio-1e3194066387ff11972bbf2e73761e7ec8af62cb6cfe3df9e875e822b4676491 WatchSource:0}: Error finding container 1e3194066387ff11972bbf2e73761e7ec8af62cb6cfe3df9e875e822b4676491: Status 404 returned error can't find the container with id 1e3194066387ff11972bbf2e73761e7ec8af62cb6cfe3df9e875e822b4676491
Sep 15 09:07:59.328017 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:59.327929    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7qqhq" event={"ID":"a1791e99-ae22-4734-96b8-eb1e70ce1d05","Type":"ContainerStarted","Data":"1e3194066387ff11972bbf2e73761e7ec8af62cb6cfe3df9e875e822b4676491"}
Sep 15 09:07:59.329312 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:59.329287    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qkk4l" event={"ID":"b4b3d3db-6fca-4562-95b3-dcb6b9f11257","Type":"ContainerStarted","Data":"94c46eabe76ccad86322ee092e8e56710fc29f2ed221faf5266189b6deaf6d31"}
Sep 15 09:07:59.329385 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:59.329334    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qkk4l" event={"ID":"b4b3d3db-6fca-4562-95b3-dcb6b9f11257","Type":"ContainerStarted","Data":"457f9ed287245d7b0ce0954ab7124b40c8263188b935f54619de15431ef8cef7"}
Sep 15 09:07:59.329443 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:59.329389    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:07:59.330422 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:59.330401    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hm2qh" event={"ID":"59c90c42-51b9-47a7-8ad3-1361a7008c65","Type":"ContainerStarted","Data":"236640653bdbe64683792f639b1f6bf0164b34605cbbf69cd8c5dfdde82d91f1"}
Sep 15 09:07:59.344540 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:07:59.344384    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qkk4l" podStartSLOduration=66.344361073 podStartE2EDuration="1m6.344361073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:59.344259019 +0000 UTC m=+66.934083368" watchObservedRunningTime="2026-09-15 09:07:59.344361073 +0000 UTC m=+66.934185423"
Sep 15 09:08:00.084418 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:00.084383    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:08:00.087026 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:00.087002    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a57a6a-206a-4619-8db7-6a4b72556702-metrics-tls\") pod \"dns-default-5mlqf\" (UID: \"f2a57a6a-206a-4619-8db7-6a4b72556702\") " pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:08:00.337001 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:00.336906    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7qqhq" event={"ID":"a1791e99-ae22-4734-96b8-eb1e70ce1d05","Type":"ContainerStarted","Data":"93c248ea837e212e4918fe2660cbfe7b04a0ec0964efc86f369e5c83f8b65eda"}
Sep 15 09:08:00.337001 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:00.336969    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7qqhq" event={"ID":"a1791e99-ae22-4734-96b8-eb1e70ce1d05","Type":"ContainerStarted","Data":"6f4729b45fdebb593c857fccde957e6bd9285fb6cedf1169f5562ffed8290f8d"}
Sep 15 09:08:00.347798 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:00.347770    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lb4vr\""
Sep 15 09:08:00.354889 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:00.354827    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7qqhq" podStartSLOduration=66.314434422 podStartE2EDuration="1m7.354809898s" totalImagesPullingTime="1.040375476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:00.354126267 +0000 UTC m=+67.943950627" watchObservedRunningTime="2026-09-15 09:08:00.354809898 +0000 UTC m=+67.944634251"
Sep 15 09:08:00.356206 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:00.356186    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:08:00.630936 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:00.630907    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5mlqf"]
Sep 15 09:08:00.633394 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:00.633361    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a57a6a_206a_4619_8db7_6a4b72556702.slice/crio-a5e2930c70661561db04cfc9aa5bf56f0133d67b0c6e2f640d0695b8059b71bf WatchSource:0}: Error finding container a5e2930c70661561db04cfc9aa5bf56f0133d67b0c6e2f640d0695b8059b71bf: Status 404 returned error can't find the container with id a5e2930c70661561db04cfc9aa5bf56f0133d67b0c6e2f640d0695b8059b71bf
Sep 15 09:08:01.342319 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:01.342259    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mlqf" event={"ID":"f2a57a6a-206a-4619-8db7-6a4b72556702","Type":"ContainerStarted","Data":"a5e2930c70661561db04cfc9aa5bf56f0133d67b0c6e2f640d0695b8059b71bf"}
Sep 15 09:08:03.005420 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.005375    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:08:03.008491 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.008462    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e27bcdde-76e2-490c-870f-73e9ec2e3f0c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x62j9\" (UID: \"e27bcdde-76e2-490c-870f-73e9ec2e3f0c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:08:03.106734 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.106691    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:08:03.109275 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.109245    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"image-registry-6d7db79dfb-597mt\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") " pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:08:03.207702 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.207655    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:08:03.210447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.210418    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6cd90bf-9aed-4a54-baed-0474366ddf5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-ksxzd\" (UID: \"d6cd90bf-9aed-4a54-baed-0474366ddf5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:08:03.256440 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.256369    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fhk6c\""
Sep 15 09:08:03.263724 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.263702    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"
Sep 15 09:08:03.351894 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.351859    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8vjg9\""
Sep 15 09:08:03.360006 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.359975    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:08:03.435801 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.435767    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nqkhq\""
Sep 15 09:08:03.444141 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.444108    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"
Sep 15 09:08:03.783497 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.783473    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d7db79dfb-597mt"]
Sep 15 09:08:03.883519 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.883228    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67cbb975ff-g5mvm"]
Sep 15 09:08:03.890163 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.890127    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:03.893808 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.893481    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d7db79dfb-597mt"]
Sep 15 09:08:03.902602 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.902290    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd"]
Sep 15 09:08:03.904353 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:03.904319    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c1e868_2f3f_4f50_8265_eb7bb2c1f814.slice/crio-d69fa7907b1e598a8d1ce23fa0f27ad965d94e09f75c1d748411a02bef7ab58b WatchSource:0}: Error finding container d69fa7907b1e598a8d1ce23fa0f27ad965d94e09f75c1d748411a02bef7ab58b: Status 404 returned error can't find the container with id d69fa7907b1e598a8d1ce23fa0f27ad965d94e09f75c1d748411a02bef7ab58b
Sep 15 09:08:03.904786 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.904719    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9"]
Sep 15 09:08:03.905946 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:03.905893    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cd90bf_9aed_4a54_baed_0474366ddf5b.slice/crio-f6d3f9a66a8c0d4e0e8993a847b6c223575efdd3c5ad23d793f3ad34fa6aa08b WatchSource:0}: Error finding container f6d3f9a66a8c0d4e0e8993a847b6c223575efdd3c5ad23d793f3ad34fa6aa08b: Status 404 returned error can't find the container with id f6d3f9a66a8c0d4e0e8993a847b6c223575efdd3c5ad23d793f3ad34fa6aa08b
Sep 15 09:08:03.910805 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:03.910774    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67cbb975ff-g5mvm"]
Sep 15 09:08:04.013984 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.013951    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ab58407-dc71-4075-a155-268d583c05f0-trusted-ca\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.014346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.014002    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ab58407-dc71-4075-a155-268d583c05f0-bound-sa-token\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.014346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.014048    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ab58407-dc71-4075-a155-268d583c05f0-image-registry-private-configuration\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.014346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.014105    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ab58407-dc71-4075-a155-268d583c05f0-registry-certificates\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.014346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.014157    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ab58407-dc71-4075-a155-268d583c05f0-ca-trust-extracted\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.014346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.014192    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ab58407-dc71-4075-a155-268d583c05f0-installation-pull-secrets\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.014346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.014226    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ab58407-dc71-4075-a155-268d583c05f0-registry-tls\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.014346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.014290    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v7n2\" (UniqueName: \"kubernetes.io/projected/6ab58407-dc71-4075-a155-268d583c05f0-kube-api-access-4v7n2\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.115522 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.115446    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ab58407-dc71-4075-a155-268d583c05f0-registry-certificates\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.115522 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.115482    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ab58407-dc71-4075-a155-268d583c05f0-ca-trust-extracted\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.115522 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.115511    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ab58407-dc71-4075-a155-268d583c05f0-installation-pull-secrets\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.115769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.115544    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ab58407-dc71-4075-a155-268d583c05f0-registry-tls\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.115769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.115572    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v7n2\" (UniqueName: \"kubernetes.io/projected/6ab58407-dc71-4075-a155-268d583c05f0-kube-api-access-4v7n2\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.115769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.115601    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ab58407-dc71-4075-a155-268d583c05f0-trusted-ca\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.115769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.115627    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ab58407-dc71-4075-a155-268d583c05f0-bound-sa-token\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.115769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.115661    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ab58407-dc71-4075-a155-268d583c05f0-image-registry-private-configuration\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.116065 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.115895    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ab58407-dc71-4075-a155-268d583c05f0-ca-trust-extracted\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.116386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.116348    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ab58407-dc71-4075-a155-268d583c05f0-registry-certificates\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.116681 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.116655    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ab58407-dc71-4075-a155-268d583c05f0-trusted-ca\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.118562 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.118540    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ab58407-dc71-4075-a155-268d583c05f0-installation-pull-secrets\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.118663 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.118641    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ab58407-dc71-4075-a155-268d583c05f0-registry-tls\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.118710 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.118675    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ab58407-dc71-4075-a155-268d583c05f0-image-registry-private-configuration\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.124471 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.124450    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v7n2\" (UniqueName: \"kubernetes.io/projected/6ab58407-dc71-4075-a155-268d583c05f0-kube-api-access-4v7n2\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.125618 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.125596    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ab58407-dc71-4075-a155-268d583c05f0-bound-sa-token\") pod \"image-registry-67cbb975ff-g5mvm\" (UID: \"6ab58407-dc71-4075-a155-268d583c05f0\") " pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.205838 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.205801    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:04.356945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.356903    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hm2qh" event={"ID":"59c90c42-51b9-47a7-8ad3-1361a7008c65","Type":"ContainerStarted","Data":"96bbddda47013eefe249730b80304e68f179669aa45663d8ac0d6ea484092854"}
Sep 15 09:08:04.358784 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.358751    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mlqf" event={"ID":"f2a57a6a-206a-4619-8db7-6a4b72556702","Type":"ContainerStarted","Data":"5507b1e131fd765968e464dff1acb32e2d85b2e3b3a4d6cae08a92a5c9556a87"}
Sep 15 09:08:04.358928 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.358804    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mlqf" event={"ID":"f2a57a6a-206a-4619-8db7-6a4b72556702","Type":"ContainerStarted","Data":"18cf944f82ecbd462ef971441af630471d269ef96428a8039e920f839b347ffe"}
Sep 15 09:08:04.358928 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.358864    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:08:04.360072 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.360049    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9" event={"ID":"e27bcdde-76e2-490c-870f-73e9ec2e3f0c","Type":"ContainerStarted","Data":"359d28426c2d84cfa563e51a3270ce131af7d9365ce4bac7902cd7f64af53a02"}
Sep 15 09:08:04.361182 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.361158    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd" event={"ID":"d6cd90bf-9aed-4a54-baed-0474366ddf5b","Type":"ContainerStarted","Data":"f6d3f9a66a8c0d4e0e8993a847b6c223575efdd3c5ad23d793f3ad34fa6aa08b"}
Sep 15 09:08:04.362454 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.362430    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt" event={"ID":"29c1e868-2f3f-4f50-8265-eb7bb2c1f814","Type":"ContainerStarted","Data":"eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10"}
Sep 15 09:08:04.362530 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.362471    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt" event={"ID":"29c1e868-2f3f-4f50-8265-eb7bb2c1f814","Type":"ContainerStarted","Data":"d69fa7907b1e598a8d1ce23fa0f27ad965d94e09f75c1d748411a02bef7ab58b"}
Sep 15 09:08:04.362589 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.362571    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:08:04.373747 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.373659    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hm2qh" podStartSLOduration=66.82673937 podStartE2EDuration="1m11.373638362s" totalImagesPullingTime="4.546898992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:04.372414968 +0000 UTC m=+71.962239311" watchObservedRunningTime="2026-09-15 09:08:04.373638362 +0000 UTC m=+71.963462715"
Sep 15 09:08:04.390138 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.390096    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5mlqf" podStartSLOduration=33.434815592 podStartE2EDuration="36.390079886s" totalImagesPullingTime="2.955264294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:04.389222905 +0000 UTC m=+71.979047253" watchObservedRunningTime="2026-09-15 09:08:04.390079886 +0000 UTC m=+71.979904235"
Sep 15 09:08:04.503859 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.503681    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt" podStartSLOduration=33.503656507 podStartE2EDuration="33.503656507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:04.409544523 +0000 UTC m=+71.999368878" watchObservedRunningTime="2026-09-15 09:08:04.503656507 +0000 UTC m=+72.093480856"
Sep 15 09:08:04.505219 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:04.504810    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67cbb975ff-g5mvm"]
Sep 15 09:08:04.508013 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:04.507987    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab58407_dc71_4075_a155_268d583c05f0.slice/crio-e51d2558950d84a7986ecea8ca94105597c82fb5033c8e3cd0a44cbda5d08003 WatchSource:0}: Error finding container e51d2558950d84a7986ecea8ca94105597c82fb5033c8e3cd0a44cbda5d08003: Status 404 returned error can't find the container with id e51d2558950d84a7986ecea8ca94105597c82fb5033c8e3cd0a44cbda5d08003
Sep 15 09:08:05.369097 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:05.369005    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm" event={"ID":"6ab58407-dc71-4075-a155-268d583c05f0","Type":"ContainerStarted","Data":"9f549f6ea24a3c714662abdf5da6bda9f017a9a1baa96af878471a57027152f2"}
Sep 15 09:08:05.369097 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:05.369067    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm" event={"ID":"6ab58407-dc71-4075-a155-268d583c05f0","Type":"ContainerStarted","Data":"e51d2558950d84a7986ecea8ca94105597c82fb5033c8e3cd0a44cbda5d08003"}
Sep 15 09:08:05.369600 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:05.369375    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:05.390117 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:05.390060    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm" podStartSLOduration=2.39003973 podStartE2EDuration="2.39003973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:05.38900476 +0000 UTC m=+72.978829108" watchObservedRunningTime="2026-09-15 09:08:05.39003973 +0000 UTC m=+72.979864080"
Sep 15 09:08:07.111584 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.111553    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"]
Sep 15 09:08:07.145777 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.145751    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"]
Sep 15 09:08:07.145899 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.145859    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"
Sep 15 09:08:07.148417 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.148391    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 15 09:08:07.148523 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.148467    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-m8h4l\""
Sep 15 09:08:07.239026 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.238969    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2ea1967-abf7-445f-9fa3-65171d7d507a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-twjzw\" (UID: \"f2ea1967-abf7-445f-9fa3-65171d7d507a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"
Sep 15 09:08:07.339897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.339829    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2ea1967-abf7-445f-9fa3-65171d7d507a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-twjzw\" (UID: \"f2ea1967-abf7-445f-9fa3-65171d7d507a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"
Sep 15 09:08:07.340067 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:08:07.339973    2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 09:08:07.340067 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:08:07.340050    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ea1967-abf7-445f-9fa3-65171d7d507a-tls-certificates podName:f2ea1967-abf7-445f-9fa3-65171d7d507a nodeName:}" failed. No retries permitted until 2026-09-15 09:08:07.840028814 +0000 UTC m=+75.429853157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f2ea1967-abf7-445f-9fa3-65171d7d507a-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-twjzw" (UID: "f2ea1967-abf7-445f-9fa3-65171d7d507a") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 09:08:07.377690 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.377653    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9" event={"ID":"e27bcdde-76e2-490c-870f-73e9ec2e3f0c","Type":"ContainerStarted","Data":"ac706f465c914aa89e2574ce200cc14bdb66b7ec13de28ed9723b3aaca04adc8"}
Sep 15 09:08:07.377883 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.377711    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9" event={"ID":"e27bcdde-76e2-490c-870f-73e9ec2e3f0c","Type":"ContainerStarted","Data":"48b3d62d2b67062eeadedffabc35ed016b395a62a9d7b56b544e4b18af4aa5c2"}
Sep 15 09:08:07.379224 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.379203    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd" event={"ID":"d6cd90bf-9aed-4a54-baed-0474366ddf5b","Type":"ContainerStarted","Data":"4a0a6d9dcedfb5edcea5d8a692aa6422209d63f684c43d6e6809b89576d87bd5"}
Sep 15 09:08:07.395982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.395910    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x62j9" podStartSLOduration=33.42698988 podStartE2EDuration="36.39589495s" totalImagesPullingTime="2.96890507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:07.395272949 +0000 UTC m=+74.985097299" watchObservedRunningTime="2026-09-15 09:08:07.39589495 +0000 UTC m=+74.985719297"
Sep 15 09:08:07.411732 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.411695    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-ksxzd" podStartSLOduration=33.726888332 podStartE2EDuration="36.411680952s" totalImagesPullingTime="2.68479262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:07.410715376 +0000 UTC m=+75.000539723" watchObservedRunningTime="2026-09-15 09:08:07.411680952 +0000 UTC m=+75.001505300"
Sep 15 09:08:07.845328 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.845290    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2ea1967-abf7-445f-9fa3-65171d7d507a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-twjzw\" (UID: \"f2ea1967-abf7-445f-9fa3-65171d7d507a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"
Sep 15 09:08:07.847637 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:07.847610    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2ea1967-abf7-445f-9fa3-65171d7d507a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-twjzw\" (UID: \"f2ea1967-abf7-445f-9fa3-65171d7d507a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"
Sep 15 09:08:08.053978 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:08.053938    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"
Sep 15 09:08:08.335372 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:08.335342    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"]
Sep 15 09:08:08.338829 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:08.338800    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ea1967_abf7_445f_9fa3_65171d7d507a.slice/crio-5706f7b098626272ee063476c43b7474accfd7b785f4f2ca4f56be8009bb4de0 WatchSource:0}: Error finding container 5706f7b098626272ee063476c43b7474accfd7b785f4f2ca4f56be8009bb4de0: Status 404 returned error can't find the container with id 5706f7b098626272ee063476c43b7474accfd7b785f4f2ca4f56be8009bb4de0
Sep 15 09:08:08.384278 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:08.384191    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw" event={"ID":"f2ea1967-abf7-445f-9fa3-65171d7d507a","Type":"ContainerStarted","Data":"5706f7b098626272ee063476c43b7474accfd7b785f4f2ca4f56be8009bb4de0"}
Sep 15 09:08:10.393412 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:10.393374    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw" event={"ID":"f2ea1967-abf7-445f-9fa3-65171d7d507a","Type":"ContainerStarted","Data":"9a29c85ba9e12562246d847b14dccb35668613f2392b13344774d937ceb72f8b"}
Sep 15 09:08:10.393816 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:10.393564    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"
Sep 15 09:08:10.398270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:10.398248    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw"
Sep 15 09:08:10.409514 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:10.409474    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-twjzw" podStartSLOduration=1.9688505109999999 podStartE2EDuration="3.409461115s" totalImagesPullingTime="1.440610604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:10.408377496 +0000 UTC m=+77.998201844" watchObservedRunningTime="2026-09-15 09:08:10.409461115 +0000 UTC m=+77.999285462"
Sep 15 09:08:11.167937 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.167900    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"]
Sep 15 09:08:11.170645 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.170628    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.174307 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.174283    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 15 09:08:11.174432 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.174336    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 09:08:11.174432 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.174336    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 15 09:08:11.174535 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.174494    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hdttr\""
Sep 15 09:08:11.181491 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.181467    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"]
Sep 15 09:08:11.271947 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.271914    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b3bdae7-0447-43a9-8711-3e54dfa357e1-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.272098 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.271957    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b3bdae7-0447-43a9-8711-3e54dfa357e1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.272098 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.271992    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b3bdae7-0447-43a9-8711-3e54dfa357e1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.272098 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.272008    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg9rk\" (UniqueName: \"kubernetes.io/projected/1b3bdae7-0447-43a9-8711-3e54dfa357e1-kube-api-access-lg9rk\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.373039 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.373007    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b3bdae7-0447-43a9-8711-3e54dfa357e1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.373131 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.373043    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg9rk\" (UniqueName: \"kubernetes.io/projected/1b3bdae7-0447-43a9-8711-3e54dfa357e1-kube-api-access-lg9rk\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.373131 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.373084    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b3bdae7-0447-43a9-8711-3e54dfa357e1-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.373131 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.373107    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b3bdae7-0447-43a9-8711-3e54dfa357e1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.373230 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:08:11.373189    2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 15 09:08:11.373278 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:08:11.373268    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b3bdae7-0447-43a9-8711-3e54dfa357e1-prometheus-operator-tls podName:1b3bdae7-0447-43a9-8711-3e54dfa357e1 nodeName:}" failed. No retries permitted until 2026-09-15 09:08:11.873249682 +0000 UTC m=+79.463074008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1b3bdae7-0447-43a9-8711-3e54dfa357e1-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-wrr5p" (UID: "1b3bdae7-0447-43a9-8711-3e54dfa357e1") : secret "prometheus-operator-tls" not found
Sep 15 09:08:11.374482 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.374457    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b3bdae7-0447-43a9-8711-3e54dfa357e1-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.375465 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.375441    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b3bdae7-0447-43a9-8711-3e54dfa357e1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.381152 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.381134    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg9rk\" (UniqueName: \"kubernetes.io/projected/1b3bdae7-0447-43a9-8711-3e54dfa357e1-kube-api-access-lg9rk\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.877776 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.877723    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b3bdae7-0447-43a9-8711-3e54dfa357e1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:11.880058 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:11.880038    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b3bdae7-0447-43a9-8711-3e54dfa357e1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wrr5p\" (UID: \"1b3bdae7-0447-43a9-8711-3e54dfa357e1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:12.078965 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:12.078915    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"
Sep 15 09:08:12.349530 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:12.349498    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p"]
Sep 15 09:08:12.352472 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:12.352443    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3bdae7_0447_43a9_8711_3e54dfa357e1.slice/crio-da1e1716925aabe1134f9c1c4a8ee5fda0c431668174e2b2c6dd9305893a9062 WatchSource:0}: Error finding container da1e1716925aabe1134f9c1c4a8ee5fda0c431668174e2b2c6dd9305893a9062: Status 404 returned error can't find the container with id da1e1716925aabe1134f9c1c4a8ee5fda0c431668174e2b2c6dd9305893a9062
Sep 15 09:08:12.401450 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:12.401386    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p" event={"ID":"1b3bdae7-0447-43a9-8711-3e54dfa357e1","Type":"ContainerStarted","Data":"da1e1716925aabe1134f9c1c4a8ee5fda0c431668174e2b2c6dd9305893a9062"}
Sep 15 09:08:14.371371 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:14.371341    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5mlqf"
Sep 15 09:08:15.413369 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:15.413315    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p" event={"ID":"1b3bdae7-0447-43a9-8711-3e54dfa357e1","Type":"ContainerStarted","Data":"8c7ed89bf1568c73b5ec2dca04fc5b9ce2d8e6a8bb98f1b37ca3179b82caa39f"}
Sep 15 09:08:15.413818 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:15.413385    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p" event={"ID":"1b3bdae7-0447-43a9-8711-3e54dfa357e1","Type":"ContainerStarted","Data":"09735d8afc11867ab7d7a5f0df451e0a1bf8d605b8dc73f99d44baedb0841bc1"}
Sep 15 09:08:15.430829 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:15.430782    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wrr5p" podStartSLOduration=2.007521769 podStartE2EDuration="4.430768831s" totalImagesPullingTime="2.423247062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:15.429510692 +0000 UTC m=+83.019335041" watchObservedRunningTime="2026-09-15 09:08:15.430768831 +0000 UTC m=+83.020593179"
Sep 15 09:08:17.507424 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.507388    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"]
Sep 15 09:08:17.509707 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.509693    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.513696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.513676    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xzgv5\""
Sep 15 09:08:17.514064 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.514045    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 15 09:08:17.514139 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.514050    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 15 09:08:17.524093 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.524066    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"]
Sep 15 09:08:17.532302 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.532281    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vhg8f"]
Sep 15 09:08:17.534452 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.534434    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.536769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.536753    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 09:08:17.536999 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.536985    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 09:08:17.537186 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.537167    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2gqnx\""
Sep 15 09:08:17.537287 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.537270    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 09:08:17.618330 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618300    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d39d301-40b2-4030-aa2e-0d010d36145d-sys\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.618461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618334    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.618461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618353    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4090c9f9-39fd-4647-a59b-fd2b216b6889-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.618461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618425    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d39d301-40b2-4030-aa2e-0d010d36145d-metrics-client-ca\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.618605 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618465    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6rxl\" (UniqueName: \"kubernetes.io/projected/4090c9f9-39fd-4647-a59b-fd2b216b6889-kube-api-access-h6rxl\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.618605 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618483    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-textfile\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.618605 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618496    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-tls\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.618605 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618574    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d39d301-40b2-4030-aa2e-0d010d36145d-root\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.618756 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618631    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-wtmp\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.618756 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618659    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.618756 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618678    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtw2h\" (UniqueName: \"kubernetes.io/projected/5d39d301-40b2-4030-aa2e-0d010d36145d-kube-api-access-rtw2h\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.619109 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.618709    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4090c9f9-39fd-4647-a59b-fd2b216b6889-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.619317 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.619286    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4090c9f9-39fd-4647-a59b-fd2b216b6889-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.720594 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4090c9f9-39fd-4647-a59b-fd2b216b6889-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.720594 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720606    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d39d301-40b2-4030-aa2e-0d010d36145d-metrics-client-ca\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.720830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720635    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6rxl\" (UniqueName: \"kubernetes.io/projected/4090c9f9-39fd-4647-a59b-fd2b216b6889-kube-api-access-h6rxl\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.720830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720656    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-textfile\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.720830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720679    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-tls\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.720830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720706    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d39d301-40b2-4030-aa2e-0d010d36145d-root\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.720830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720720    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-wtmp\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.720830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720743    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.720830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720770    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtw2h\" (UniqueName: \"kubernetes.io/projected/5d39d301-40b2-4030-aa2e-0d010d36145d-kube-api-access-rtw2h\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.720830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720798    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4090c9f9-39fd-4647-a59b-fd2b216b6889-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.721241 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:08:17.720840    2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 09:08:17.721241 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:08:17.720936    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-tls podName:5d39d301-40b2-4030-aa2e-0d010d36145d nodeName:}" failed. No retries permitted until 2026-09-15 09:08:18.220915512 +0000 UTC m=+85.810739839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-tls") pod "node-exporter-vhg8f" (UID: "5d39d301-40b2-4030-aa2e-0d010d36145d") : secret "node-exporter-tls" not found
Sep 15 09:08:17.721241 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.720840    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d39d301-40b2-4030-aa2e-0d010d36145d-root\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.721241 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.721151    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-textfile\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.721241 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.721168    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-wtmp\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.721241 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.721184    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4090c9f9-39fd-4647-a59b-fd2b216b6889-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.721542 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.721244    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d39d301-40b2-4030-aa2e-0d010d36145d-sys\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.721542 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.721280    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.721542 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.721305    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d39d301-40b2-4030-aa2e-0d010d36145d-sys\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.721542 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.721443    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.721866 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.721824    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d39d301-40b2-4030-aa2e-0d010d36145d-metrics-client-ca\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.722014 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.721987    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4090c9f9-39fd-4647-a59b-fd2b216b6889-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.723504 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.723482    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4090c9f9-39fd-4647-a59b-fd2b216b6889-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.723586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.723491    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4090c9f9-39fd-4647-a59b-fd2b216b6889-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.723586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.723541    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.729194 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.729171    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6rxl\" (UniqueName: \"kubernetes.io/projected/4090c9f9-39fd-4647-a59b-fd2b216b6889-kube-api-access-h6rxl\") pod \"openshift-state-metrics-67dcf8c979-8vx68\" (UID: \"4090c9f9-39fd-4647-a59b-fd2b216b6889\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:17.729377 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.729360    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtw2h\" (UniqueName: \"kubernetes.io/projected/5d39d301-40b2-4030-aa2e-0d010d36145d-kube-api-access-rtw2h\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:17.818379 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:17.818296    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"
Sep 15 09:08:18.090047 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:18.089942    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68"]
Sep 15 09:08:18.092598 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:18.092572    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4090c9f9_39fd_4647_a59b_fd2b216b6889.slice/crio-dd79c126e3be94d475ad987cc8a1f0dbaa92eefafb5b9ba474946f80ac346df4 WatchSource:0}: Error finding container dd79c126e3be94d475ad987cc8a1f0dbaa92eefafb5b9ba474946f80ac346df4: Status 404 returned error can't find the container with id dd79c126e3be94d475ad987cc8a1f0dbaa92eefafb5b9ba474946f80ac346df4
Sep 15 09:08:18.226094 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:18.226063    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-tls\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:18.228536 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:18.228511    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d39d301-40b2-4030-aa2e-0d010d36145d-node-exporter-tls\") pod \"node-exporter-vhg8f\" (UID: \"5d39d301-40b2-4030-aa2e-0d010d36145d\") " pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:18.425392 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:18.425312    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68" event={"ID":"4090c9f9-39fd-4647-a59b-fd2b216b6889","Type":"ContainerStarted","Data":"9e7a5350bab3ec59b9f23f5cc945ceaece6e765512ca07673a5192b44e4af231"}
Sep 15 09:08:18.425392 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:18.425367    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68" event={"ID":"4090c9f9-39fd-4647-a59b-fd2b216b6889","Type":"ContainerStarted","Data":"f7f0a103400fbce26719be5b46eab091045bbec607bf1ebfb29c74171d7e3854"}
Sep 15 09:08:18.425392 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:18.425387    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68" event={"ID":"4090c9f9-39fd-4647-a59b-fd2b216b6889","Type":"ContainerStarted","Data":"dd79c126e3be94d475ad987cc8a1f0dbaa92eefafb5b9ba474946f80ac346df4"}
Sep 15 09:08:18.442611 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:18.442585    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vhg8f"
Sep 15 09:08:18.452097 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:18.452073    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d39d301_40b2_4030_aa2e_0d010d36145d.slice/crio-7b9d5d82e424bec3ebcbdae678abd600d6f1b33bde1da9336c708b046b249a4b WatchSource:0}: Error finding container 7b9d5d82e424bec3ebcbdae678abd600d6f1b33bde1da9336c708b046b249a4b: Status 404 returned error can't find the container with id 7b9d5d82e424bec3ebcbdae678abd600d6f1b33bde1da9336c708b046b249a4b
Sep 15 09:08:19.431912 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:19.431866    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhg8f" event={"ID":"5d39d301-40b2-4030-aa2e-0d010d36145d","Type":"ContainerStarted","Data":"7b9d5d82e424bec3ebcbdae678abd600d6f1b33bde1da9336c708b046b249a4b"}
Sep 15 09:08:20.437930 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:20.437889    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68" event={"ID":"4090c9f9-39fd-4647-a59b-fd2b216b6889","Type":"ContainerStarted","Data":"d5f2fb686a5d1b4bbb5fd15bea38070862c91bd23d568f98069809a5be947f7d"}
Sep 15 09:08:20.439590 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:20.439566    2555 generic.go:356] "Generic (PLEG): container finished" podID="5d39d301-40b2-4030-aa2e-0d010d36145d" containerID="a80c428f3d7ef23452f921abb6d4fab14eb2805d13a63259f341f31a31b7a848" exitCode=0
Sep 15 09:08:20.439687 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:20.439608    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhg8f" event={"ID":"5d39d301-40b2-4030-aa2e-0d010d36145d","Type":"ContainerDied","Data":"a80c428f3d7ef23452f921abb6d4fab14eb2805d13a63259f341f31a31b7a848"}
Sep 15 09:08:20.456706 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:20.456658    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vx68" podStartSLOduration=2.11069804 podStartE2EDuration="3.456645663s" totalImagesPullingTime="1.345947623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:20.455476184 +0000 UTC m=+88.045300533" watchObservedRunningTime="2026-09-15 09:08:20.456645663 +0000 UTC m=+88.046470025"
Sep 15 09:08:21.445769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:21.445737    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhg8f" event={"ID":"5d39d301-40b2-4030-aa2e-0d010d36145d","Type":"ContainerStarted","Data":"1dab9565868a47c0d1c353de148eb49a88144bfe38b3d9fb3003ba568ad56b84"}
Sep 15 09:08:21.446174 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:21.445797    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhg8f" event={"ID":"5d39d301-40b2-4030-aa2e-0d010d36145d","Type":"ContainerStarted","Data":"4ca72ffbf7fbcca50d35e58ecce54576b5d73075a2f0af9364c8764f907516de"}
Sep 15 09:08:21.466401 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:21.466356    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vhg8f" podStartSLOduration=3.3065190859999998 podStartE2EDuration="4.46634213s" totalImagesPullingTime="1.095809632s" totalInitContainerRuntime="64.013412ms" isStatefulPod=true podCreationTimestamp="2026-09-15 09:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:21.464760066 +0000 UTC m=+89.054584411" watchObservedRunningTime="2026-09-15 09:08:21.46634213 +0000 UTC m=+89.056166478"
Sep 15 09:08:22.299126 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.299087    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"]
Sep 15 09:08:22.301222 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.301205    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:22.304145 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.304121    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 09:08:22.304266 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.304207    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hbpds\""
Sep 15 09:08:22.310394 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.310373    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"]
Sep 15 09:08:22.466490 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.466459    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7nx2\" (UniqueName: \"kubernetes.io/projected/c8e400e2-6bbb-407b-a13c-f08a18851cb6-kube-api-access-p7nx2\") pod \"monitoring-plugin-5d85778b9d-x46js\" (UID: \"c8e400e2-6bbb-407b-a13c-f08a18851cb6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:22.466908 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.466531    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8e400e2-6bbb-407b-a13c-f08a18851cb6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-x46js\" (UID: \"c8e400e2-6bbb-407b-a13c-f08a18851cb6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:22.567912 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.567818    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8e400e2-6bbb-407b-a13c-f08a18851cb6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-x46js\" (UID: \"c8e400e2-6bbb-407b-a13c-f08a18851cb6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:22.568127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.568100    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7nx2\" (UniqueName: \"kubernetes.io/projected/c8e400e2-6bbb-407b-a13c-f08a18851cb6-kube-api-access-p7nx2\") pod \"monitoring-plugin-5d85778b9d-x46js\" (UID: \"c8e400e2-6bbb-407b-a13c-f08a18851cb6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:22.570371 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.570349    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8e400e2-6bbb-407b-a13c-f08a18851cb6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-x46js\" (UID: \"c8e400e2-6bbb-407b-a13c-f08a18851cb6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:22.577209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.577185    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7nx2\" (UniqueName: \"kubernetes.io/projected/c8e400e2-6bbb-407b-a13c-f08a18851cb6-kube-api-access-p7nx2\") pod \"monitoring-plugin-5d85778b9d-x46js\" (UID: \"c8e400e2-6bbb-407b-a13c-f08a18851cb6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:22.611190 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.611165    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:22.725244 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.725207    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-689dd8966d-nwrhc"]
Sep 15 09:08:22.728127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.728104    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.730997 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.730971    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 09:08:22.731116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.731005    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 09:08:22.731116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.731023    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 09:08:22.731232 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.731147    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 09:08:22.731232 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.731154    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nkssg\""
Sep 15 09:08:22.731232 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.731172    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 09:08:22.736903 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.736839    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 09:08:22.743934 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.743914    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-689dd8966d-nwrhc"]
Sep 15 09:08:22.871510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.871437    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-secret-telemeter-client\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.871510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.871471    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5a42a1-987f-4305-86a2-e4b02b039095-metrics-client-ca\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.871510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.871497    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rn47\" (UniqueName: \"kubernetes.io/projected/6a5a42a1-987f-4305-86a2-e4b02b039095-kube-api-access-9rn47\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.871734 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.871599    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.871734 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.871634    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5a42a1-987f-4305-86a2-e4b02b039095-telemeter-trusted-ca-bundle\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.871734 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.871666    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-federate-client-tls\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.871734 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.871688    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5a42a1-987f-4305-86a2-e4b02b039095-serving-certs-ca-bundle\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.871734 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.871715    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-telemeter-client-tls\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.890674 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.890646    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"]
Sep 15 09:08:22.894621 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:22.894597    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e400e2_6bbb_407b_a13c_f08a18851cb6.slice/crio-bf714a8a0b49773b8b310bdb6a6e31faf047d7b527f06ac4c795fe69a06b182c WatchSource:0}: Error finding container bf714a8a0b49773b8b310bdb6a6e31faf047d7b527f06ac4c795fe69a06b182c: Status 404 returned error can't find the container with id bf714a8a0b49773b8b310bdb6a6e31faf047d7b527f06ac4c795fe69a06b182c
Sep 15 09:08:22.972129 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.972094    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.972291 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.972145    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5a42a1-987f-4305-86a2-e4b02b039095-telemeter-trusted-ca-bundle\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.972291 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.972197    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-federate-client-tls\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.972291 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.972234    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5a42a1-987f-4305-86a2-e4b02b039095-serving-certs-ca-bundle\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.972291 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.972266    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-telemeter-client-tls\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.972513 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.972450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-secret-telemeter-client\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.972513 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.972503    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5a42a1-987f-4305-86a2-e4b02b039095-metrics-client-ca\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.972605 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.972532    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rn47\" (UniqueName: \"kubernetes.io/projected/6a5a42a1-987f-4305-86a2-e4b02b039095-kube-api-access-9rn47\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.973135 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.973071    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5a42a1-987f-4305-86a2-e4b02b039095-serving-certs-ca-bundle\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.973301 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.973238    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5a42a1-987f-4305-86a2-e4b02b039095-metrics-client-ca\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.973448 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.973424    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5a42a1-987f-4305-86a2-e4b02b039095-telemeter-trusted-ca-bundle\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.975221 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.975194    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-secret-telemeter-client\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.975332 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.975308    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.975401 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.975342    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-telemeter-client-tls\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.975508 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.975489    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6a5a42a1-987f-4305-86a2-e4b02b039095-federate-client-tls\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:22.981531 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:22.981500    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rn47\" (UniqueName: \"kubernetes.io/projected/6a5a42a1-987f-4305-86a2-e4b02b039095-kube-api-access-9rn47\") pod \"telemeter-client-689dd8966d-nwrhc\" (UID: \"6a5a42a1-987f-4305-86a2-e4b02b039095\") " pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:23.038237 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:23.038185    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc"
Sep 15 09:08:23.315470 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:23.315416    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-689dd8966d-nwrhc"]
Sep 15 09:08:23.317167 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:23.317135    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5a42a1_987f_4305_86a2_e4b02b039095.slice/crio-77db47c7282e15d7937e30d8a9ba3b1b83fc7c08ec5e25be38a319aa82be1af7 WatchSource:0}: Error finding container 77db47c7282e15d7937e30d8a9ba3b1b83fc7c08ec5e25be38a319aa82be1af7: Status 404 returned error can't find the container with id 77db47c7282e15d7937e30d8a9ba3b1b83fc7c08ec5e25be38a319aa82be1af7
Sep 15 09:08:23.455694 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:23.455657    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js" event={"ID":"c8e400e2-6bbb-407b-a13c-f08a18851cb6","Type":"ContainerStarted","Data":"bf714a8a0b49773b8b310bdb6a6e31faf047d7b527f06ac4c795fe69a06b182c"}
Sep 15 09:08:23.456842 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:23.456816    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc" event={"ID":"6a5a42a1-987f-4305-86a2-e4b02b039095","Type":"ContainerStarted","Data":"77db47c7282e15d7937e30d8a9ba3b1b83fc7c08ec5e25be38a319aa82be1af7"}
Sep 15 09:08:24.369033 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:24.368995    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:08:25.467759 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:25.467688    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js" event={"ID":"c8e400e2-6bbb-407b-a13c-f08a18851cb6","Type":"ContainerStarted","Data":"4728a727bb391df03905fff7ba6df3f019b915169f90df73fbeef5f295b7250b"}
Sep 15 09:08:25.468241 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:25.467863    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:25.473629 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:25.473605    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js"
Sep 15 09:08:25.483820 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:25.483777    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-x46js" podStartSLOduration=1.954768402 podStartE2EDuration="3.483761941s" totalImagesPullingTime="1.528993539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:25.483216165 +0000 UTC m=+93.073040547" watchObservedRunningTime="2026-09-15 09:08:25.483761941 +0000 UTC m=+93.073586293"
Sep 15 09:08:26.376978 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:26.376944    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67cbb975ff-g5mvm"
Sep 15 09:08:26.475761 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:26.475727    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc" event={"ID":"6a5a42a1-987f-4305-86a2-e4b02b039095","Type":"ContainerStarted","Data":"83cdc69440044b3768ffbc787ccb934a49367471b9b96cee8356c517ef3475d7"}
Sep 15 09:08:27.481685 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:27.481645    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc" event={"ID":"6a5a42a1-987f-4305-86a2-e4b02b039095","Type":"ContainerStarted","Data":"0a98729cc5900f405fd583c69468353a234577456c4ee9947a938b759a30d7eb"}
Sep 15 09:08:27.482093 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:27.481701    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc" event={"ID":"6a5a42a1-987f-4305-86a2-e4b02b039095","Type":"ContainerStarted","Data":"e8eb5ad29b04849814bf2e8e01ff6966614eed51d3648b7c01381738ac9a5220"}
Sep 15 09:08:27.505064 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:27.505012    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-689dd8966d-nwrhc" podStartSLOduration=2.007961335 podStartE2EDuration="5.504995875s" totalImagesPullingTime="3.49703454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:27.502729248 +0000 UTC m=+95.092553631" watchObservedRunningTime="2026-09-15 09:08:27.504995875 +0000 UTC m=+95.094820222"
Sep 15 09:08:28.276605 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.276571    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665c7c6c54-77ts7"]
Sep 15 09:08:28.278806 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.278790    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.282729 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.282704    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 09:08:28.282829 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.282770    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 09:08:28.282944 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.282927    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 09:08:28.283020 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.283001    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 09:08:28.283020 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.283004    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cxmmt\""
Sep 15 09:08:28.283127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.283025    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 09:08:28.283127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.283091    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 09:08:28.283127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.283027    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 09:08:28.288730 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.288709    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665c7c6c54-77ts7"]
Sep 15 09:08:28.417532 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.417496    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-service-ca\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.417713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.417543    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-oauth-serving-cert\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.417713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.417570    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltxrt\" (UniqueName: \"kubernetes.io/projected/2589f826-aeaa-4b0b-9c5f-5ccda871b865-kube-api-access-ltxrt\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.417713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.417593    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-oauth-config\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.417713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.417667    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-config\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.417713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.417698    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-serving-cert\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.519900 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.519840    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-config\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.519900 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.519899    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-serving-cert\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.520403 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.519925    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-service-ca\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.520403 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.519950    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-oauth-serving-cert\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.520403 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.520053    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxrt\" (UniqueName: \"kubernetes.io/projected/2589f826-aeaa-4b0b-9c5f-5ccda871b865-kube-api-access-ltxrt\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.520403 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.520105    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-oauth-config\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.520709 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.520687    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-config\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.520792 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.520740    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-service-ca\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.520792 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.520741    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-oauth-serving-cert\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.522548 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.522524    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-oauth-config\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.522635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.522527    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-serving-cert\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.528574 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.528518    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltxrt\" (UniqueName: \"kubernetes.io/projected/2589f826-aeaa-4b0b-9c5f-5ccda871b865-kube-api-access-ltxrt\") pod \"console-665c7c6c54-77ts7\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") " pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.588278 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.588246    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:28.878498 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:28.878377    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665c7c6c54-77ts7"]
Sep 15 09:08:28.882075 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:28.882039    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2589f826_aeaa_4b0b_9c5f_5ccda871b865.slice/crio-02f38710d58304a94e6152c1333aa2067eb539bbb2905a8e50c32a1c93780a06 WatchSource:0}: Error finding container 02f38710d58304a94e6152c1333aa2067eb539bbb2905a8e50c32a1c93780a06: Status 404 returned error can't find the container with id 02f38710d58304a94e6152c1333aa2067eb539bbb2905a8e50c32a1c93780a06
Sep 15 09:08:29.382255 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.382207    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt" podUID="29c1e868-2f3f-4f50-8265-eb7bb2c1f814" containerName="registry" containerID="cri-o://eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10" gracePeriod=30
Sep 15 09:08:29.491636 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.491593    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665c7c6c54-77ts7" event={"ID":"2589f826-aeaa-4b0b-9c5f-5ccda871b865","Type":"ContainerStarted","Data":"02f38710d58304a94e6152c1333aa2067eb539bbb2905a8e50c32a1c93780a06"}
Sep 15 09:08:29.635194 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.635117    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:08:29.636414 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.636092    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") pod \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") "
Sep 15 09:08:29.636414 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.636129    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-trusted-ca\") pod \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") "
Sep 15 09:08:29.636414 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.636164    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxsgj\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-kube-api-access-zxsgj\") pod \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") "
Sep 15 09:08:29.636414 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.636206    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-ca-trust-extracted\") pod \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") "
Sep 15 09:08:29.636414 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.636248    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-bound-sa-token\") pod \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") "
Sep 15 09:08:29.636705 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.636508    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-installation-pull-secrets\") pod \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") "
Sep 15 09:08:29.636705 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.636564    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-image-registry-private-configuration\") pod \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") "
Sep 15 09:08:29.636705 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.636602    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-certificates\") pod \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\" (UID: \"29c1e868-2f3f-4f50-8265-eb7bb2c1f814\") "
Sep 15 09:08:29.637476 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.637138    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "29c1e868-2f3f-4f50-8265-eb7bb2c1f814" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:08:29.637476 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.637172    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "29c1e868-2f3f-4f50-8265-eb7bb2c1f814" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:08:29.641394 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.641330    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "29c1e868-2f3f-4f50-8265-eb7bb2c1f814" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:08:29.641394 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.641334    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "29c1e868-2f3f-4f50-8265-eb7bb2c1f814" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:08:29.641539 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.641504    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-kube-api-access-zxsgj" (OuterVolumeSpecName: "kube-api-access-zxsgj") pod "29c1e868-2f3f-4f50-8265-eb7bb2c1f814" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814"). InnerVolumeSpecName "kube-api-access-zxsgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:08:29.641661 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.641643    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "29c1e868-2f3f-4f50-8265-eb7bb2c1f814" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:08:29.641891 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.641868    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "29c1e868-2f3f-4f50-8265-eb7bb2c1f814" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:08:29.650122 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.650095    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "29c1e868-2f3f-4f50-8265-eb7bb2c1f814" (UID: "29c1e868-2f3f-4f50-8265-eb7bb2c1f814"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:08:29.737380 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.737326    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-installation-pull-secrets\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:08:29.737380 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.737368    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-image-registry-private-configuration\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:08:29.737380 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.737385    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-certificates\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:08:29.737380 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.737401    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-registry-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:08:29.737681 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.737413    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-trusted-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:08:29.737681 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.737421    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxsgj\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-kube-api-access-zxsgj\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:08:29.737681 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.737436    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-ca-trust-extracted\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:08:29.737681 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:29.737449    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29c1e868-2f3f-4f50-8265-eb7bb2c1f814-bound-sa-token\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:08:30.340821 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.340784    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qkk4l"
Sep 15 09:08:30.497275 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.497241    2555 generic.go:356] "Generic (PLEG): container finished" podID="29c1e868-2f3f-4f50-8265-eb7bb2c1f814" containerID="eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10" exitCode=0
Sep 15 09:08:30.497441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.497294    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt"
Sep 15 09:08:30.497441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.497315    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt" event={"ID":"29c1e868-2f3f-4f50-8265-eb7bb2c1f814","Type":"ContainerDied","Data":"eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10"}
Sep 15 09:08:30.497441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.497367    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7db79dfb-597mt" event={"ID":"29c1e868-2f3f-4f50-8265-eb7bb2c1f814","Type":"ContainerDied","Data":"d69fa7907b1e598a8d1ce23fa0f27ad965d94e09f75c1d748411a02bef7ab58b"}
Sep 15 09:08:30.497441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.497396    2555 scope.go:117] "RemoveContainer" containerID="eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10"
Sep 15 09:08:30.507762 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.507744    2555 scope.go:117] "RemoveContainer" containerID="eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10"
Sep 15 09:08:30.508110 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:08:30.508089    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10\": container with ID starting with eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10 not found: ID does not exist" containerID="eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10"
Sep 15 09:08:30.508199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.508117    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10"} err="failed to get container status \"eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10\": rpc error: code = NotFound desc = could not find container \"eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10\": container with ID starting with eafe8e17c2ff2a1f7c4ee622fab64d42dbb9c45205d5e55873b88e178e1faf10 not found: ID does not exist"
Sep 15 09:08:30.521624 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.521598    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d7db79dfb-597mt"]
Sep 15 09:08:30.524380 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.524357    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d7db79dfb-597mt"]
Sep 15 09:08:30.954957 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:30.954926    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29c1e868-2f3f-4f50-8265-eb7bb2c1f814" path="/var/lib/kubelet/pods/29c1e868-2f3f-4f50-8265-eb7bb2c1f814/volumes"
Sep 15 09:08:32.510720 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:32.510678    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665c7c6c54-77ts7" event={"ID":"2589f826-aeaa-4b0b-9c5f-5ccda871b865","Type":"ContainerStarted","Data":"750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc"}
Sep 15 09:08:32.532720 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:32.532663    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665c7c6c54-77ts7" podStartSLOduration=1.78871426 podStartE2EDuration="4.532642263s" totalImagesPullingTime="2.743928003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:32.530197451 +0000 UTC m=+100.120021800" watchObservedRunningTime="2026-09-15 09:08:32.532642263 +0000 UTC m=+100.122466612"
Sep 15 09:08:35.611382 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.611345    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cff6d5cb8-jpxwh"]
Sep 15 09:08:35.611774 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.611684    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29c1e868-2f3f-4f50-8265-eb7bb2c1f814" containerName="registry"
Sep 15 09:08:35.611774 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.611698    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="29c1e868-2f3f-4f50-8265-eb7bb2c1f814" containerName="registry"
Sep 15 09:08:35.611866 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.611755    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="29c1e868-2f3f-4f50-8265-eb7bb2c1f814" containerName="registry"
Sep 15 09:08:35.615715 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.615700    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.624247 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.624222    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 09:08:35.624722 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.624702    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cff6d5cb8-jpxwh"]
Sep 15 09:08:35.683337 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.683308    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-trusted-ca-bundle\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.683471 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.683349    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-serving-cert\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.683471 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.683373    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-config\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.683471 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.683409    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-service-ca\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.683471 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.683432    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-oauth-serving-cert\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.683593 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.683492    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-oauth-config\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.683593 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.683547    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7bqw\" (UniqueName: \"kubernetes.io/projected/b26de61b-3350-4719-8904-8dfacf4a0bb7-kube-api-access-x7bqw\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.784508 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.784481    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7bqw\" (UniqueName: \"kubernetes.io/projected/b26de61b-3350-4719-8904-8dfacf4a0bb7-kube-api-access-x7bqw\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.784631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.784520    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-trusted-ca-bundle\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.784781 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.784760    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-serving-cert\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.784830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.784801    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-config\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.784830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.784823    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-service-ca\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.784938 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.784866    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-oauth-serving-cert\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.784938 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.784915    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-oauth-config\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.785390 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.785357    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-trusted-ca-bundle\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.785509 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.785438    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-config\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.785509 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.785476    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-oauth-serving-cert\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.785606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.785506    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-service-ca\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.787172 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.787155    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-serving-cert\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.787282 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.787263    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-oauth-config\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.794181 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.794159    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7bqw\" (UniqueName: \"kubernetes.io/projected/b26de61b-3350-4719-8904-8dfacf4a0bb7-kube-api-access-x7bqw\") pod \"console-cff6d5cb8-jpxwh\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") " pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:35.925233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:35.925155    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:36.198263 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:36.198175    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cff6d5cb8-jpxwh"]
Sep 15 09:08:36.201010 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:08:36.200985    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26de61b_3350_4719_8904_8dfacf4a0bb7.slice/crio-ba5a43bc0e652193d57130a8c9360249cf0c403f67e8aa97b04d2ae646840f95 WatchSource:0}: Error finding container ba5a43bc0e652193d57130a8c9360249cf0c403f67e8aa97b04d2ae646840f95: Status 404 returned error can't find the container with id ba5a43bc0e652193d57130a8c9360249cf0c403f67e8aa97b04d2ae646840f95
Sep 15 09:08:36.527951 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:36.527916    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff6d5cb8-jpxwh" event={"ID":"b26de61b-3350-4719-8904-8dfacf4a0bb7","Type":"ContainerStarted","Data":"f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3"}
Sep 15 09:08:36.528145 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:36.527962    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff6d5cb8-jpxwh" event={"ID":"b26de61b-3350-4719-8904-8dfacf4a0bb7","Type":"ContainerStarted","Data":"ba5a43bc0e652193d57130a8c9360249cf0c403f67e8aa97b04d2ae646840f95"}
Sep 15 09:08:36.549768 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:36.549715    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cff6d5cb8-jpxwh" podStartSLOduration=1.5496994929999999 podStartE2EDuration="1.549699493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:36.549205834 +0000 UTC m=+104.139030181" watchObservedRunningTime="2026-09-15 09:08:36.549699493 +0000 UTC m=+104.139523841"
Sep 15 09:08:38.589359 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:38.589318    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:38.589811 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:38.589434    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:38.594174 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:38.594150    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:39.543956 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:39.543927    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:08:45.925994 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:45.925940    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:45.926414 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:45.926017    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:45.930908 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:45.930884    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:46.574328 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:46.574297    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:08:46.621548 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:46.621514    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665c7c6c54-77ts7"]
Sep 15 09:08:47.572524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:47.572492    2555 generic.go:356] "Generic (PLEG): container finished" podID="cc60eeb8-97da-45c7-b698-3c135ab7f08e" containerID="777ae69c16b2bac91ee4ab45c5b9faa37a82174e0ff22d322c8a515393ae5f0a" exitCode=0
Sep 15 09:08:47.572934 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:47.572566    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tptsl" event={"ID":"cc60eeb8-97da-45c7-b698-3c135ab7f08e","Type":"ContainerDied","Data":"777ae69c16b2bac91ee4ab45c5b9faa37a82174e0ff22d322c8a515393ae5f0a"}
Sep 15 09:08:47.573052 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:47.573037    2555 scope.go:117] "RemoveContainer" containerID="777ae69c16b2bac91ee4ab45c5b9faa37a82174e0ff22d322c8a515393ae5f0a"
Sep 15 09:08:48.578966 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:08:48.578932    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tptsl" event={"ID":"cc60eeb8-97da-45c7-b698-3c135ab7f08e","Type":"ContainerStarted","Data":"3803b35a907cc061df99243d882484c90dffbecc4f52e9d1523a410c2eb9ea3e"}
Sep 15 09:09:03.652392 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:03.652358    2555 generic.go:356] "Generic (PLEG): container finished" podID="3300178a-eb71-4450-952d-5d66f2ba3a83" containerID="202f0b22b5192021619c4de34913fab0bdb428bdc2312c27b9013e91d0491be9" exitCode=0
Sep 15 09:09:03.652756 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:03.652405    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc" event={"ID":"3300178a-eb71-4450-952d-5d66f2ba3a83","Type":"ContainerDied","Data":"202f0b22b5192021619c4de34913fab0bdb428bdc2312c27b9013e91d0491be9"}
Sep 15 09:09:03.652756 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:03.652693    2555 scope.go:117] "RemoveContainer" containerID="202f0b22b5192021619c4de34913fab0bdb428bdc2312c27b9013e91d0491be9"
Sep 15 09:09:04.657629 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:04.657593    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-dxbgc" event={"ID":"3300178a-eb71-4450-952d-5d66f2ba3a83","Type":"ContainerStarted","Data":"3d4b65496e35dd8891bb24f91b57a05045e602e6be8c87851b6c4fb894764374"}
Sep 15 09:09:11.640999 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.640952    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-665c7c6c54-77ts7" podUID="2589f826-aeaa-4b0b-9c5f-5ccda871b865" containerName="console" containerID="cri-o://750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc" gracePeriod=15
Sep 15 09:09:11.877813 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.877789    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:09:11.992779 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.992737    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-serving-cert\") pod \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") "
Sep 15 09:09:11.992988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.992822    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltxrt\" (UniqueName: \"kubernetes.io/projected/2589f826-aeaa-4b0b-9c5f-5ccda871b865-kube-api-access-ltxrt\") pod \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") "
Sep 15 09:09:11.992988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.992864    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-oauth-config\") pod \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") "
Sep 15 09:09:11.992988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.992887    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-config\") pod \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") "
Sep 15 09:09:11.992988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.992923    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-service-ca\") pod \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") "
Sep 15 09:09:11.993219 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.993082    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-oauth-serving-cert\") pod \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\" (UID: \"2589f826-aeaa-4b0b-9c5f-5ccda871b865\") "
Sep 15 09:09:11.993336 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.993314    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-service-ca" (OuterVolumeSpecName: "service-ca") pod "2589f826-aeaa-4b0b-9c5f-5ccda871b865" (UID: "2589f826-aeaa-4b0b-9c5f-5ccda871b865"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:09:11.993393 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.993309    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-config" (OuterVolumeSpecName: "console-config") pod "2589f826-aeaa-4b0b-9c5f-5ccda871b865" (UID: "2589f826-aeaa-4b0b-9c5f-5ccda871b865"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:09:11.993441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.993386    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:09:11.993441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.993408    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-config\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:09:11.993441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.993375    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2589f826-aeaa-4b0b-9c5f-5ccda871b865" (UID: "2589f826-aeaa-4b0b-9c5f-5ccda871b865"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:09:11.995166 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.995137    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2589f826-aeaa-4b0b-9c5f-5ccda871b865" (UID: "2589f826-aeaa-4b0b-9c5f-5ccda871b865"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:09:11.995295 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.995273    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2589f826-aeaa-4b0b-9c5f-5ccda871b865" (UID: "2589f826-aeaa-4b0b-9c5f-5ccda871b865"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:09:11.995368 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:11.995348    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2589f826-aeaa-4b0b-9c5f-5ccda871b865-kube-api-access-ltxrt" (OuterVolumeSpecName: "kube-api-access-ltxrt") pod "2589f826-aeaa-4b0b-9c5f-5ccda871b865" (UID: "2589f826-aeaa-4b0b-9c5f-5ccda871b865"). InnerVolumeSpecName "kube-api-access-ltxrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:09:12.094083 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.094042    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltxrt\" (UniqueName: \"kubernetes.io/projected/2589f826-aeaa-4b0b-9c5f-5ccda871b865-kube-api-access-ltxrt\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:09:12.094083 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.094076    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-oauth-config\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:09:12.094083 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.094086    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2589f826-aeaa-4b0b-9c5f-5ccda871b865-oauth-serving-cert\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:09:12.094312 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.094094    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2589f826-aeaa-4b0b-9c5f-5ccda871b865-console-serving-cert\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:09:12.689275 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.689241    2555 generic.go:356] "Generic (PLEG): container finished" podID="2589f826-aeaa-4b0b-9c5f-5ccda871b865" containerID="750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc" exitCode=0
Sep 15 09:09:12.689706 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.689282    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665c7c6c54-77ts7"
Sep 15 09:09:12.689706 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.689329    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665c7c6c54-77ts7" event={"ID":"2589f826-aeaa-4b0b-9c5f-5ccda871b865","Type":"ContainerDied","Data":"750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc"}
Sep 15 09:09:12.689706 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.689379    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665c7c6c54-77ts7" event={"ID":"2589f826-aeaa-4b0b-9c5f-5ccda871b865","Type":"ContainerDied","Data":"02f38710d58304a94e6152c1333aa2067eb539bbb2905a8e50c32a1c93780a06"}
Sep 15 09:09:12.689706 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.689401    2555 scope.go:117] "RemoveContainer" containerID="750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc"
Sep 15 09:09:12.698951 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.698931    2555 scope.go:117] "RemoveContainer" containerID="750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc"
Sep 15 09:09:12.699241 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:09:12.699222    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc\": container with ID starting with 750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc not found: ID does not exist" containerID="750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc"
Sep 15 09:09:12.699278 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.699250    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc"} err="failed to get container status \"750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc\": rpc error: code = NotFound desc = could not find container \"750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc\": container with ID starting with 750274f6ebe8387b0f2d831c5cecdeeda2a35c294e869e6ca2d3827b6637a4bc not found: ID does not exist"
Sep 15 09:09:12.711006 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.710978    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665c7c6c54-77ts7"]
Sep 15 09:09:12.714569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.714548    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-665c7c6c54-77ts7"]
Sep 15 09:09:12.953146 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:12.953062    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2589f826-aeaa-4b0b-9c5f-5ccda871b865" path="/var/lib/kubelet/pods/2589f826-aeaa-4b0b-9c5f-5ccda871b865/volumes"
Sep 15 09:09:40.000389 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.000358    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:09:40.000824 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.000651    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2589f826-aeaa-4b0b-9c5f-5ccda871b865" containerName="console"
Sep 15 09:09:40.000824 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.000662    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2589f826-aeaa-4b0b-9c5f-5ccda871b865" containerName="console"
Sep 15 09:09:40.000824 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.000710    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2589f826-aeaa-4b0b-9c5f-5ccda871b865" containerName="console"
Sep 15 09:09:40.008210 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.008177    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.012373 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.012344    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 09:09:40.012527 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.012349    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 09:09:40.012527 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.012426    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 09:09:40.012677 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.012650    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 09:09:40.012745 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.012693    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 09:09:40.012745 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.012711    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bvhtn\""
Sep 15 09:09:40.012864 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.012712    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 09:09:40.012864 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.012714    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 09:09:40.012972 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.012942    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 09:09:40.017804 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.017782    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 09:09:40.019154 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.019132    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:09:40.100154 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100112    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100154 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100158    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100154 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100177    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-web-config\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100234    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmwws\" (UniqueName: \"kubernetes.io/projected/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-kube-api-access-kmwws\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100272    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-config-out\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100293    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100314    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-config-volume\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100416    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100457    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100508    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100530    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100550    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.100635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.100566    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.201768 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.201740    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.201958 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.201774    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.201958 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.201800    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.201958 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.201825    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.201958 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.201874    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.201958 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.201894    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.201958 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.201912    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-web-config\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.202270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.201970    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmwws\" (UniqueName: \"kubernetes.io/projected/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-kube-api-access-kmwws\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.202270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.202032    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-config-out\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.202270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.202061    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.202270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.202106    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-config-volume\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.202270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.202159    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.202270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.202195    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.202702 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.202651    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.202799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.202781    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.205243 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.204824    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.205243 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.204829    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.205243 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.204929    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.205243 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.205144    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.205243 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.205184    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-config-out\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.205485 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.205267    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.205485 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.205313    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-config-volume\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.205763 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.205744    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-web-config\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.206338 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.206318    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.206919 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.206902    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.209960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.209941    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmwws\" (UniqueName: \"kubernetes.io/projected/f9a62c5d-12ba-4fae-8d47-bcdc23cfba15-kube-api-access-kmwws\") pod \"alertmanager-main-0\" (UID: \"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.320068 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.319970    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:09:40.599774 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.599746    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:09:40.602365 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:09:40.602337    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a62c5d_12ba_4fae_8d47_bcdc23cfba15.slice/crio-dc32cf84866af57accdebfea9fc430eb6bc50cd97c8f8dbcebbf7d1312888ddb WatchSource:0}: Error finding container dc32cf84866af57accdebfea9fc430eb6bc50cd97c8f8dbcebbf7d1312888ddb: Status 404 returned error can't find the container with id dc32cf84866af57accdebfea9fc430eb6bc50cd97c8f8dbcebbf7d1312888ddb
Sep 15 09:09:40.799808 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.799769    2555 generic.go:356] "Generic (PLEG): container finished" podID="f9a62c5d-12ba-4fae-8d47-bcdc23cfba15" containerID="3afd4cb5cd91e687052a4ac1742774333bfc2f522063d9551886e46abbb492e6" exitCode=0
Sep 15 09:09:40.799990 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.799812    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15","Type":"ContainerDied","Data":"3afd4cb5cd91e687052a4ac1742774333bfc2f522063d9551886e46abbb492e6"}
Sep 15 09:09:40.799990 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:40.799889    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15","Type":"ContainerStarted","Data":"dc32cf84866af57accdebfea9fc430eb6bc50cd97c8f8dbcebbf7d1312888ddb"}
Sep 15 09:09:42.811737 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:42.811702    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15","Type":"ContainerStarted","Data":"4a849c8ae1e630d8e7cfbb52d5d739631ae3cd9a278775af74b456846e3b8e5e"}
Sep 15 09:09:42.812127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:42.811796    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15","Type":"ContainerStarted","Data":"5ab0323e6db1131d28093e4ddc0229ea100f178ad01c7a008aa55b816865585b"}
Sep 15 09:09:42.812127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:42.811823    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15","Type":"ContainerStarted","Data":"0cb2d893df1f14af67c7f4feefee64166c8ae70f929faf03d0b17499df02de35"}
Sep 15 09:09:42.812127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:42.811871    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15","Type":"ContainerStarted","Data":"dd8b446f38daf2dbd9f44ee88e116ae5c5618600bebffeb63c48b1562c8b6402"}
Sep 15 09:09:42.812127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:42.811906    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15","Type":"ContainerStarted","Data":"f8e9e01ff758fad3a9446924e7bcc19be2ed5ea5723b81fa485e56660eeea32a"}
Sep 15 09:09:43.818673 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:43.818634    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9a62c5d-12ba-4fae-8d47-bcdc23cfba15","Type":"ContainerStarted","Data":"80acfdef848b034f480033a51ddcf28c04aa9a51c93f4e357c90b07e044d8b3f"}
Sep 15 09:09:43.847963 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:43.847869    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.380294993 podStartE2EDuration="4.84782748s" totalImagesPullingTime="2.451541577s" totalInitContainerRuntime="15.99091ms" isStatefulPod=false podCreationTimestamp="2026-09-15 09:09:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:09:43.84491477 +0000 UTC m=+171.434739118" watchObservedRunningTime="2026-09-15 09:09:43.84782748 +0000 UTC m=+171.437651828"
Sep 15 09:09:56.421141 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.421103    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c49cb5859-72fr9"]
Sep 15 09:09:56.424854 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.424826    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.435099 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.435077    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c49cb5859-72fr9"]
Sep 15 09:09:56.540335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.540300    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-oauth-config\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.540335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.540339    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8sbd\" (UniqueName: \"kubernetes.io/projected/de16d0fb-ad61-42e9-b58f-44951f915f9f-kube-api-access-j8sbd\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.540537 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.540402    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-trusted-ca-bundle\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.540537 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.540450    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-serving-cert\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.540537 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.540486    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-config\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.540537 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.540531    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-service-ca\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.540658 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.540565    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-oauth-serving-cert\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.641509 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.641460    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8sbd\" (UniqueName: \"kubernetes.io/projected/de16d0fb-ad61-42e9-b58f-44951f915f9f-kube-api-access-j8sbd\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.641509 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.641515    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-trusted-ca-bundle\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.641720 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.641543    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-serving-cert\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.641756 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.641723    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-config\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.641799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.641778    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-service-ca\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.641870 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.641830    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-oauth-serving-cert\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.641931 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.641896    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-oauth-config\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.642475 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.642446    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-config\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.642587 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.642477    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-oauth-serving-cert\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.642652 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.642603    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-service-ca\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.642652 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.642606    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-trusted-ca-bundle\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.644096 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.644073    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-serving-cert\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.644367 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.644347    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-oauth-config\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.650381 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.650358    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8sbd\" (UniqueName: \"kubernetes.io/projected/de16d0fb-ad61-42e9-b58f-44951f915f9f-kube-api-access-j8sbd\") pod \"console-6c49cb5859-72fr9\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") " pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:56.735073 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:56.735035    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:09:57.007353 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:57.007330    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c49cb5859-72fr9"]
Sep 15 09:09:57.009819 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:09:57.009789    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde16d0fb_ad61_42e9_b58f_44951f915f9f.slice/crio-03b553e6884f9fbe27defc0e0bad6600d9c3ae11251d5e8664ccf0c201d7f4ab WatchSource:0}: Error finding container 03b553e6884f9fbe27defc0e0bad6600d9c3ae11251d5e8664ccf0c201d7f4ab: Status 404 returned error can't find the container with id 03b553e6884f9fbe27defc0e0bad6600d9c3ae11251d5e8664ccf0c201d7f4ab
Sep 15 09:09:57.876145 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:57.876110    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c49cb5859-72fr9" event={"ID":"de16d0fb-ad61-42e9-b58f-44951f915f9f","Type":"ContainerStarted","Data":"c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e"}
Sep 15 09:09:57.876612 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:57.876159    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c49cb5859-72fr9" event={"ID":"de16d0fb-ad61-42e9-b58f-44951f915f9f","Type":"ContainerStarted","Data":"03b553e6884f9fbe27defc0e0bad6600d9c3ae11251d5e8664ccf0c201d7f4ab"}
Sep 15 09:09:57.895501 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:09:57.895450    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c49cb5859-72fr9" podStartSLOduration=1.8954068469999998 podStartE2EDuration="1.895406847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:09:57.894109027 +0000 UTC m=+185.483933375" watchObservedRunningTime="2026-09-15 09:09:57.895406847 +0000 UTC m=+185.485231194"
Sep 15 09:10:06.736095 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:06.736053    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:10:06.736495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:06.736120    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:10:06.740952 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:06.740931    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:10:06.916369 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:06.916341    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:10:06.961780 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:06.961746    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cff6d5cb8-jpxwh"]
Sep 15 09:10:31.987747 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:31.987684    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cff6d5cb8-jpxwh" podUID="b26de61b-3350-4719-8904-8dfacf4a0bb7" containerName="console" containerID="cri-o://f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3" gracePeriod=15
Sep 15 09:10:32.235495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.235471    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:10:32.335362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335275    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-config\") pod \"b26de61b-3350-4719-8904-8dfacf4a0bb7\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") "
Sep 15 09:10:32.335362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335316    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-trusted-ca-bundle\") pod \"b26de61b-3350-4719-8904-8dfacf4a0bb7\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") "
Sep 15 09:10:32.335362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335335    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-oauth-config\") pod \"b26de61b-3350-4719-8904-8dfacf4a0bb7\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") "
Sep 15 09:10:32.335362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335363    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-service-ca\") pod \"b26de61b-3350-4719-8904-8dfacf4a0bb7\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") "
Sep 15 09:10:32.335673 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335398    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-oauth-serving-cert\") pod \"b26de61b-3350-4719-8904-8dfacf4a0bb7\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") "
Sep 15 09:10:32.335673 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335429    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-serving-cert\") pod \"b26de61b-3350-4719-8904-8dfacf4a0bb7\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") "
Sep 15 09:10:32.335673 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335472    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7bqw\" (UniqueName: \"kubernetes.io/projected/b26de61b-3350-4719-8904-8dfacf4a0bb7-kube-api-access-x7bqw\") pod \"b26de61b-3350-4719-8904-8dfacf4a0bb7\" (UID: \"b26de61b-3350-4719-8904-8dfacf4a0bb7\") "
Sep 15 09:10:32.335882 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335794    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-config" (OuterVolumeSpecName: "console-config") pod "b26de61b-3350-4719-8904-8dfacf4a0bb7" (UID: "b26de61b-3350-4719-8904-8dfacf4a0bb7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:10:32.335971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335940    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-service-ca" (OuterVolumeSpecName: "service-ca") pod "b26de61b-3350-4719-8904-8dfacf4a0bb7" (UID: "b26de61b-3350-4719-8904-8dfacf4a0bb7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:10:32.335971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.335950    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b26de61b-3350-4719-8904-8dfacf4a0bb7" (UID: "b26de61b-3350-4719-8904-8dfacf4a0bb7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:10:32.336093 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.336002    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b26de61b-3350-4719-8904-8dfacf4a0bb7" (UID: "b26de61b-3350-4719-8904-8dfacf4a0bb7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:10:32.337598 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.337566    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b26de61b-3350-4719-8904-8dfacf4a0bb7" (UID: "b26de61b-3350-4719-8904-8dfacf4a0bb7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:10:32.337697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.337659    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b26de61b-3350-4719-8904-8dfacf4a0bb7-kube-api-access-x7bqw" (OuterVolumeSpecName: "kube-api-access-x7bqw") pod "b26de61b-3350-4719-8904-8dfacf4a0bb7" (UID: "b26de61b-3350-4719-8904-8dfacf4a0bb7"). InnerVolumeSpecName "kube-api-access-x7bqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:10:32.337697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.337669    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b26de61b-3350-4719-8904-8dfacf4a0bb7" (UID: "b26de61b-3350-4719-8904-8dfacf4a0bb7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:10:32.436711 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.436667    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7bqw\" (UniqueName: \"kubernetes.io/projected/b26de61b-3350-4719-8904-8dfacf4a0bb7-kube-api-access-x7bqw\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:10:32.436711 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.436705    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-config\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:10:32.436711 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.436715    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-trusted-ca-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:10:32.436711 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.436724    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-oauth-config\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:10:32.436994 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.436733    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:10:32.436994 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.436743    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b26de61b-3350-4719-8904-8dfacf4a0bb7-oauth-serving-cert\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:10:32.436994 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:32.436753    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b26de61b-3350-4719-8904-8dfacf4a0bb7-console-serving-cert\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:10:33.013794 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:33.013757    2555 generic.go:356] "Generic (PLEG): container finished" podID="b26de61b-3350-4719-8904-8dfacf4a0bb7" containerID="f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3" exitCode=0
Sep 15 09:10:33.013794 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:33.013797    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cff6d5cb8-jpxwh"
Sep 15 09:10:33.014223 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:33.013809    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff6d5cb8-jpxwh" event={"ID":"b26de61b-3350-4719-8904-8dfacf4a0bb7","Type":"ContainerDied","Data":"f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3"}
Sep 15 09:10:33.014223 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:33.013875    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cff6d5cb8-jpxwh" event={"ID":"b26de61b-3350-4719-8904-8dfacf4a0bb7","Type":"ContainerDied","Data":"ba5a43bc0e652193d57130a8c9360249cf0c403f67e8aa97b04d2ae646840f95"}
Sep 15 09:10:33.014223 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:33.013898    2555 scope.go:117] "RemoveContainer" containerID="f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3"
Sep 15 09:10:33.021704 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:33.021682    2555 scope.go:117] "RemoveContainer" containerID="f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3"
Sep 15 09:10:33.022025 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:10:33.022002    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3\": container with ID starting with f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3 not found: ID does not exist" containerID="f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3"
Sep 15 09:10:33.022139 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:33.022044    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3"} err="failed to get container status \"f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3\": rpc error: code = NotFound desc = could not find container \"f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3\": container with ID starting with f2eca5ab866393933a1500c7468054e6631241af38ea67190ef4964f34ee8ef3 not found: ID does not exist"
Sep 15 09:10:33.032652 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:33.032624    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cff6d5cb8-jpxwh"]
Sep 15 09:10:33.035917 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:33.035886    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cff6d5cb8-jpxwh"]
Sep 15 09:10:34.953221 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:34.953181    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b26de61b-3350-4719-8904-8dfacf4a0bb7" path="/var/lib/kubelet/pods/b26de61b-3350-4719-8904-8dfacf4a0bb7/volumes"
Sep 15 09:10:48.049212 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.049173    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"]
Sep 15 09:10:48.049800 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.049679    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b26de61b-3350-4719-8904-8dfacf4a0bb7" containerName="console"
Sep 15 09:10:48.049800 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.049699    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b26de61b-3350-4719-8904-8dfacf4a0bb7" containerName="console"
Sep 15 09:10:48.049800 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.049786    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b26de61b-3350-4719-8904-8dfacf4a0bb7" containerName="console"
Sep 15 09:10:48.052866 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.052831    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.055556 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.055529    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:10:48.055556 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.055544    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:10:48.056518 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.056497    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prhnb\""
Sep 15 09:10:48.062959 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.062937    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"]
Sep 15 09:10:48.168634 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.168591    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.168803 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.168649    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.168803 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.168759    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbg7q\" (UniqueName: \"kubernetes.io/projected/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-kube-api-access-sbg7q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.270197 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.270157    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.270379 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.270231    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbg7q\" (UniqueName: \"kubernetes.io/projected/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-kube-api-access-sbg7q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.270379 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.270280    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.270629 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.270608    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.270698 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.270659    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.279223 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.279200    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbg7q\" (UniqueName: \"kubernetes.io/projected/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-kube-api-access-sbg7q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.362736 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.362649    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:10:48.636239 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:48.636174    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"]
Sep 15 09:10:48.638525 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:10:48.638499    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc33028_3f4e_4cbf_8b18_1a9fff8a59e7.slice/crio-160ebe6147c42c376b8b5b5fc855ce332ee48c1622ab599da9a55b19fd2e4967 WatchSource:0}: Error finding container 160ebe6147c42c376b8b5b5fc855ce332ee48c1622ab599da9a55b19fd2e4967: Status 404 returned error can't find the container with id 160ebe6147c42c376b8b5b5fc855ce332ee48c1622ab599da9a55b19fd2e4967
Sep 15 09:10:49.078139 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:49.078105    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw" event={"ID":"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7","Type":"ContainerStarted","Data":"160ebe6147c42c376b8b5b5fc855ce332ee48c1622ab599da9a55b19fd2e4967"}
Sep 15 09:10:56.111627 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:56.111590    2555 generic.go:356] "Generic (PLEG): container finished" podID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerID="9a468e2d3e786241cce8e240c69a3a9f78098e9fefbf43c02b271c67df3a1da2" exitCode=0
Sep 15 09:10:56.112144 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:56.111674    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw" event={"ID":"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7","Type":"ContainerDied","Data":"9a468e2d3e786241cce8e240c69a3a9f78098e9fefbf43c02b271c67df3a1da2"}
Sep 15 09:10:59.126814 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:59.126776    2555 generic.go:356] "Generic (PLEG): container finished" podID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerID="1f482c99fbae7e52ab0a68a5cebe60253c9a49769cf3e5d19f7161f3a300b674" exitCode=0
Sep 15 09:10:59.127187 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:10:59.126871    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw" event={"ID":"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7","Type":"ContainerDied","Data":"1f482c99fbae7e52ab0a68a5cebe60253c9a49769cf3e5d19f7161f3a300b674"}
Sep 15 09:11:08.167001 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:08.166958    2555 generic.go:356] "Generic (PLEG): container finished" podID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerID="dd5e2d30cfacb504a74b61928657729938e2859cd8b405192b3d6d8fc4725b9a" exitCode=0
Sep 15 09:11:08.167402 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:08.167038    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw" event={"ID":"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7","Type":"ContainerDied","Data":"dd5e2d30cfacb504a74b61928657729938e2859cd8b405192b3d6d8fc4725b9a"}
Sep 15 09:11:09.330570 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.330532    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:11:09.457278 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.457186    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-util\") pod \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") "
Sep 15 09:11:09.457278 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.457227    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-bundle\") pod \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") "
Sep 15 09:11:09.457567 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.457303    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbg7q\" (UniqueName: \"kubernetes.io/projected/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-kube-api-access-sbg7q\") pod \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\" (UID: \"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7\") "
Sep 15 09:11:09.457915 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.457889    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-bundle" (OuterVolumeSpecName: "bundle") pod "3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" (UID: "3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:11:09.459526 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.459503    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-kube-api-access-sbg7q" (OuterVolumeSpecName: "kube-api-access-sbg7q") pod "3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" (UID: "3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7"). InnerVolumeSpecName "kube-api-access-sbg7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:11:09.461781 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.461756    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-util" (OuterVolumeSpecName: "util") pod "3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" (UID: "3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:11:09.558168 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.558131    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbg7q\" (UniqueName: \"kubernetes.io/projected/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-kube-api-access-sbg7q\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:11:09.558168 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.558160    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-util\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:11:09.558168 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:09.558169    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:11:10.178095 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:10.178063    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw" event={"ID":"3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7","Type":"ContainerDied","Data":"160ebe6147c42c376b8b5b5fc855ce332ee48c1622ab599da9a55b19fd2e4967"}
Sep 15 09:11:10.178095 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:10.178091    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rbsxw"
Sep 15 09:11:10.178340 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:10.178112    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="160ebe6147c42c376b8b5b5fc855ce332ee48c1622ab599da9a55b19fd2e4967"
Sep 15 09:11:16.099032 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.098955    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"]
Sep 15 09:11:16.099453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.099268    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerName="extract"
Sep 15 09:11:16.099453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.099279    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerName="extract"
Sep 15 09:11:16.099453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.099289    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerName="util"
Sep 15 09:11:16.099453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.099294    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerName="util"
Sep 15 09:11:16.099453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.099300    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerName="pull"
Sep 15 09:11:16.099453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.099305    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerName="pull"
Sep 15 09:11:16.099453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.099356    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc33028-3f4e-4cbf-8b18-1a9fff8a59e7" containerName="extract"
Sep 15 09:11:16.101182 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.101166    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"
Sep 15 09:11:16.103749 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.103724    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:11:16.103904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.103784    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6xtns\""
Sep 15 09:11:16.103904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.103787    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 15 09:11:16.105261 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.105243    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e6b4573-82ca-42b5-8ac2-5710f434e4df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f4jgz\" (UID: \"4e6b4573-82ca-42b5-8ac2-5710f434e4df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"
Sep 15 09:11:16.105351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.105294    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ws99\" (UniqueName: \"kubernetes.io/projected/4e6b4573-82ca-42b5-8ac2-5710f434e4df-kube-api-access-9ws99\") pod \"cert-manager-operator-controller-manager-55c444bf86-f4jgz\" (UID: \"4e6b4573-82ca-42b5-8ac2-5710f434e4df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"
Sep 15 09:11:16.112717 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.112697    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"]
Sep 15 09:11:16.205789 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.205753    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ws99\" (UniqueName: \"kubernetes.io/projected/4e6b4573-82ca-42b5-8ac2-5710f434e4df-kube-api-access-9ws99\") pod \"cert-manager-operator-controller-manager-55c444bf86-f4jgz\" (UID: \"4e6b4573-82ca-42b5-8ac2-5710f434e4df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"
Sep 15 09:11:16.205975 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.205813    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e6b4573-82ca-42b5-8ac2-5710f434e4df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f4jgz\" (UID: \"4e6b4573-82ca-42b5-8ac2-5710f434e4df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"
Sep 15 09:11:16.206184 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.206168    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e6b4573-82ca-42b5-8ac2-5710f434e4df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f4jgz\" (UID: \"4e6b4573-82ca-42b5-8ac2-5710f434e4df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"
Sep 15 09:11:16.214634 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.214599    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ws99\" (UniqueName: \"kubernetes.io/projected/4e6b4573-82ca-42b5-8ac2-5710f434e4df-kube-api-access-9ws99\") pod \"cert-manager-operator-controller-manager-55c444bf86-f4jgz\" (UID: \"4e6b4573-82ca-42b5-8ac2-5710f434e4df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"
Sep 15 09:11:16.410397 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.410295    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"
Sep 15 09:11:16.686989 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:16.686962    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz"]
Sep 15 09:11:16.689093 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:11:16.689066    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6b4573_82ca_42b5_8ac2_5710f434e4df.slice/crio-d4716ceb10be45104f4eb46a0ed790246060f1f14cd1fbcde48070bdd3f7f8f2 WatchSource:0}: Error finding container d4716ceb10be45104f4eb46a0ed790246060f1f14cd1fbcde48070bdd3f7f8f2: Status 404 returned error can't find the container with id d4716ceb10be45104f4eb46a0ed790246060f1f14cd1fbcde48070bdd3f7f8f2
Sep 15 09:11:17.207080 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:17.207042    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz" event={"ID":"4e6b4573-82ca-42b5-8ac2-5710f434e4df","Type":"ContainerStarted","Data":"d4716ceb10be45104f4eb46a0ed790246060f1f14cd1fbcde48070bdd3f7f8f2"}
Sep 15 09:11:19.219404 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:19.219371    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz" event={"ID":"4e6b4573-82ca-42b5-8ac2-5710f434e4df","Type":"ContainerStarted","Data":"4c582bfe22c8cb1a8d31bcf78e123eff801f7085ceda90dd417b968d7e0f96f5"}
Sep 15 09:11:19.244432 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:19.244376    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f4jgz" podStartSLOduration=0.972940859 podStartE2EDuration="3.244360905s" totalImagesPullingTime="2.271420046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:11:19.241815696 +0000 UTC m=+266.831640046" watchObservedRunningTime="2026-09-15 09:11:19.244360905 +0000 UTC m=+266.834185296"
Sep 15 09:11:19.879367 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:19.879316    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wnw6s"]
Sep 15 09:11:19.881616 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:19.881595    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:19.885338 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:19.885316    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 09:11:19.885441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:19.885354    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 09:11:19.897064 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:19.897044    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wnw6s"]
Sep 15 09:11:19.932958 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:19.932926    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22bfca1a-adc6-47e3-986b-f3eb1bba3d2d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wnw6s\" (UID: \"22bfca1a-adc6-47e3-986b-f3eb1bba3d2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:19.933109 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:19.932989    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcdd4\" (UniqueName: \"kubernetes.io/projected/22bfca1a-adc6-47e3-986b-f3eb1bba3d2d-kube-api-access-gcdd4\") pod \"cert-manager-webhook-6486ffd997-wnw6s\" (UID: \"22bfca1a-adc6-47e3-986b-f3eb1bba3d2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:20.033969 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.033928    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22bfca1a-adc6-47e3-986b-f3eb1bba3d2d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wnw6s\" (UID: \"22bfca1a-adc6-47e3-986b-f3eb1bba3d2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:20.034143 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.034061    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcdd4\" (UniqueName: \"kubernetes.io/projected/22bfca1a-adc6-47e3-986b-f3eb1bba3d2d-kube-api-access-gcdd4\") pod \"cert-manager-webhook-6486ffd997-wnw6s\" (UID: \"22bfca1a-adc6-47e3-986b-f3eb1bba3d2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:20.042470 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.042447    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcdd4\" (UniqueName: \"kubernetes.io/projected/22bfca1a-adc6-47e3-986b-f3eb1bba3d2d-kube-api-access-gcdd4\") pod \"cert-manager-webhook-6486ffd997-wnw6s\" (UID: \"22bfca1a-adc6-47e3-986b-f3eb1bba3d2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:20.042572 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.042490    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22bfca1a-adc6-47e3-986b-f3eb1bba3d2d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wnw6s\" (UID: \"22bfca1a-adc6-47e3-986b-f3eb1bba3d2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:20.199165 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.199091    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:20.333968 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.333922    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"]
Sep 15 09:11:20.336745 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.336727    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.339758 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.339734    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:11:20.339888 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.339840    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prhnb\""
Sep 15 09:11:20.339888 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.339859    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:11:20.346304 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.346283    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"]
Sep 15 09:11:20.436129 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.436098    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.436297 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.436138    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6bc5\" (UniqueName: \"kubernetes.io/projected/b84f86d3-4691-4872-9bdb-5f73252f2a67-kube-api-access-k6bc5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.436297 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.436164    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.469862 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.469819    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wnw6s"]
Sep 15 09:11:20.473257 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:11:20.473227    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22bfca1a_adc6_47e3_986b_f3eb1bba3d2d.slice/crio-9c33dc99163952ca499a12d7c0d2117931a47015d4ce2f1daa0da73b1e93c110 WatchSource:0}: Error finding container 9c33dc99163952ca499a12d7c0d2117931a47015d4ce2f1daa0da73b1e93c110: Status 404 returned error can't find the container with id 9c33dc99163952ca499a12d7c0d2117931a47015d4ce2f1daa0da73b1e93c110
Sep 15 09:11:20.536883 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.536838    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.536995 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.536904    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6bc5\" (UniqueName: \"kubernetes.io/projected/b84f86d3-4691-4872-9bdb-5f73252f2a67-kube-api-access-k6bc5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.536995 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.536932    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.537205 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.537188    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.537244 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.537228    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.546095 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.546070    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6bc5\" (UniqueName: \"kubernetes.io/projected/b84f86d3-4691-4872-9bdb-5f73252f2a67-kube-api-access-k6bc5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.647384 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.647351    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:20.915059 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:20.915034    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"]
Sep 15 09:11:20.917388 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:11:20.917359    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb84f86d3_4691_4872_9bdb_5f73252f2a67.slice/crio-fadc3564fc35a5cd46477aed9496223a4ed08af1d103dceb8ff08470ead5c71d WatchSource:0}: Error finding container fadc3564fc35a5cd46477aed9496223a4ed08af1d103dceb8ff08470ead5c71d: Status 404 returned error can't find the container with id fadc3564fc35a5cd46477aed9496223a4ed08af1d103dceb8ff08470ead5c71d
Sep 15 09:11:21.232060 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:21.232024    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s" event={"ID":"22bfca1a-adc6-47e3-986b-f3eb1bba3d2d","Type":"ContainerStarted","Data":"9c33dc99163952ca499a12d7c0d2117931a47015d4ce2f1daa0da73b1e93c110"}
Sep 15 09:11:21.233807 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:21.233776    2555 generic.go:356] "Generic (PLEG): container finished" podID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerID="0131a2f3252eac87305d7f8a739332f517debff08dee30390791752d656e57c8" exitCode=0
Sep 15 09:11:21.233966 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:21.233817    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf" event={"ID":"b84f86d3-4691-4872-9bdb-5f73252f2a67","Type":"ContainerDied","Data":"0131a2f3252eac87305d7f8a739332f517debff08dee30390791752d656e57c8"}
Sep 15 09:11:21.233966 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:21.233873    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf" event={"ID":"b84f86d3-4691-4872-9bdb-5f73252f2a67","Type":"ContainerStarted","Data":"fadc3564fc35a5cd46477aed9496223a4ed08af1d103dceb8ff08470ead5c71d"}
Sep 15 09:11:24.251818 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:24.251783    2555 generic.go:356] "Generic (PLEG): container finished" podID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerID="6adbe7cc4d5320d2b53ee4af22654e5334009820d6962a1a04198f74e95ae0c5" exitCode=0
Sep 15 09:11:24.252264 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:24.251839    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf" event={"ID":"b84f86d3-4691-4872-9bdb-5f73252f2a67","Type":"ContainerDied","Data":"6adbe7cc4d5320d2b53ee4af22654e5334009820d6962a1a04198f74e95ae0c5"}
Sep 15 09:11:24.253599 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:24.253568    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s" event={"ID":"22bfca1a-adc6-47e3-986b-f3eb1bba3d2d","Type":"ContainerStarted","Data":"ea9e327ef9c108526774f5c237dd4387e48937fefbdb3277f57b2833a4c2514c"}
Sep 15 09:11:24.253699 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:24.253634    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:24.287498 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:24.287448    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s" podStartSLOduration=2.001700553 podStartE2EDuration="5.287433016s" totalImagesPullingTime="3.285732463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:11:24.285323926 +0000 UTC m=+271.875148285" watchObservedRunningTime="2026-09-15 09:11:24.287433016 +0000 UTC m=+271.877257364"
Sep 15 09:11:25.259863 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:25.259822    2555 generic.go:356] "Generic (PLEG): container finished" podID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerID="4e7f9010c4a245b1c5db6c1b2c6509c5dbbf8a4f05fcac488964a2c91806e04e" exitCode=0
Sep 15 09:11:25.260307 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:25.259910    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf" event={"ID":"b84f86d3-4691-4872-9bdb-5f73252f2a67","Type":"ContainerDied","Data":"4e7f9010c4a245b1c5db6c1b2c6509c5dbbf8a4f05fcac488964a2c91806e04e"}
Sep 15 09:11:26.387836 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.387813    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:26.484163 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.484125    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6bc5\" (UniqueName: \"kubernetes.io/projected/b84f86d3-4691-4872-9bdb-5f73252f2a67-kube-api-access-k6bc5\") pod \"b84f86d3-4691-4872-9bdb-5f73252f2a67\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") "
Sep 15 09:11:26.484421 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.484182    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-util\") pod \"b84f86d3-4691-4872-9bdb-5f73252f2a67\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") "
Sep 15 09:11:26.484421 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.484220    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-bundle\") pod \"b84f86d3-4691-4872-9bdb-5f73252f2a67\" (UID: \"b84f86d3-4691-4872-9bdb-5f73252f2a67\") "
Sep 15 09:11:26.484656 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.484634    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-bundle" (OuterVolumeSpecName: "bundle") pod "b84f86d3-4691-4872-9bdb-5f73252f2a67" (UID: "b84f86d3-4691-4872-9bdb-5f73252f2a67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:11:26.486328 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.486299    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b84f86d3-4691-4872-9bdb-5f73252f2a67-kube-api-access-k6bc5" (OuterVolumeSpecName: "kube-api-access-k6bc5") pod "b84f86d3-4691-4872-9bdb-5f73252f2a67" (UID: "b84f86d3-4691-4872-9bdb-5f73252f2a67"). InnerVolumeSpecName "kube-api-access-k6bc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:11:26.488963 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.488930    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-util" (OuterVolumeSpecName: "util") pod "b84f86d3-4691-4872-9bdb-5f73252f2a67" (UID: "b84f86d3-4691-4872-9bdb-5f73252f2a67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:11:26.584964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.584839    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:11:26.584964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.584905    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6bc5\" (UniqueName: \"kubernetes.io/projected/b84f86d3-4691-4872-9bdb-5f73252f2a67-kube-api-access-k6bc5\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:11:26.584964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:26.584919    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b84f86d3-4691-4872-9bdb-5f73252f2a67-util\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:11:27.270945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:27.270915    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf"
Sep 15 09:11:27.271126 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:27.270913    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqg6qf" event={"ID":"b84f86d3-4691-4872-9bdb-5f73252f2a67","Type":"ContainerDied","Data":"fadc3564fc35a5cd46477aed9496223a4ed08af1d103dceb8ff08470ead5c71d"}
Sep 15 09:11:27.271126 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:27.271043    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fadc3564fc35a5cd46477aed9496223a4ed08af1d103dceb8ff08470ead5c71d"
Sep 15 09:11:30.262669 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:30.262639    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wnw6s"
Sep 15 09:11:31.327934 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.327896    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x6kqd"]
Sep 15 09:11:31.328395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.328383    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerName="util"
Sep 15 09:11:31.328464 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.328402    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerName="util"
Sep 15 09:11:31.328464 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.328420    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerName="extract"
Sep 15 09:11:31.328464 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.328429    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerName="extract"
Sep 15 09:11:31.328464 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.328447    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerName="pull"
Sep 15 09:11:31.328464 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.328456    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerName="pull"
Sep 15 09:11:31.328701 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.328533    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b84f86d3-4691-4872-9bdb-5f73252f2a67" containerName="extract"
Sep 15 09:11:31.332445 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.332425    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x6kqd"
Sep 15 09:11:31.335138 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.335117    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-l45hg\""
Sep 15 09:11:31.340275 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.340254    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x6kqd"]
Sep 15 09:11:31.426002 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.425961    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8knsf\" (UniqueName: \"kubernetes.io/projected/47183441-f597-4d96-bb7a-a2396138ac6c-kube-api-access-8knsf\") pod \"cert-manager-55b4d954d5-x6kqd\" (UID: \"47183441-f597-4d96-bb7a-a2396138ac6c\") " pod="cert-manager/cert-manager-55b4d954d5-x6kqd"
Sep 15 09:11:31.426160 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.426090    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47183441-f597-4d96-bb7a-a2396138ac6c-bound-sa-token\") pod \"cert-manager-55b4d954d5-x6kqd\" (UID: \"47183441-f597-4d96-bb7a-a2396138ac6c\") " pod="cert-manager/cert-manager-55b4d954d5-x6kqd"
Sep 15 09:11:31.526946 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.526907    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47183441-f597-4d96-bb7a-a2396138ac6c-bound-sa-token\") pod \"cert-manager-55b4d954d5-x6kqd\" (UID: \"47183441-f597-4d96-bb7a-a2396138ac6c\") " pod="cert-manager/cert-manager-55b4d954d5-x6kqd"
Sep 15 09:11:31.527117 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.526962    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8knsf\" (UniqueName: \"kubernetes.io/projected/47183441-f597-4d96-bb7a-a2396138ac6c-kube-api-access-8knsf\") pod \"cert-manager-55b4d954d5-x6kqd\" (UID: \"47183441-f597-4d96-bb7a-a2396138ac6c\") " pod="cert-manager/cert-manager-55b4d954d5-x6kqd"
Sep 15 09:11:31.535135 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.535105    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47183441-f597-4d96-bb7a-a2396138ac6c-bound-sa-token\") pod \"cert-manager-55b4d954d5-x6kqd\" (UID: \"47183441-f597-4d96-bb7a-a2396138ac6c\") " pod="cert-manager/cert-manager-55b4d954d5-x6kqd"
Sep 15 09:11:31.535243 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.535210    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8knsf\" (UniqueName: \"kubernetes.io/projected/47183441-f597-4d96-bb7a-a2396138ac6c-kube-api-access-8knsf\") pod \"cert-manager-55b4d954d5-x6kqd\" (UID: \"47183441-f597-4d96-bb7a-a2396138ac6c\") " pod="cert-manager/cert-manager-55b4d954d5-x6kqd"
Sep 15 09:11:31.641811 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.641723    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x6kqd"
Sep 15 09:11:31.917037 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:31.916958    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x6kqd"]
Sep 15 09:11:31.919963 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:11:31.919935    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47183441_f597_4d96_bb7a_a2396138ac6c.slice/crio-e918bdd49d1597553d096a4880c41450a79895c504d4dba274e7272aba6c70b7 WatchSource:0}: Error finding container e918bdd49d1597553d096a4880c41450a79895c504d4dba274e7272aba6c70b7: Status 404 returned error can't find the container with id e918bdd49d1597553d096a4880c41450a79895c504d4dba274e7272aba6c70b7
Sep 15 09:11:32.301510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:32.301471    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x6kqd" event={"ID":"47183441-f597-4d96-bb7a-a2396138ac6c","Type":"ContainerStarted","Data":"242e510cdbe90da57b32bde894d84373a5781ff4afececee1fdbb4a7273b1a26"}
Sep 15 09:11:32.301510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:32.301514    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x6kqd" event={"ID":"47183441-f597-4d96-bb7a-a2396138ac6c","Type":"ContainerStarted","Data":"e918bdd49d1597553d096a4880c41450a79895c504d4dba274e7272aba6c70b7"}
Sep 15 09:11:32.320238 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:32.320188    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-x6kqd" podStartSLOduration=1.320175117 podStartE2EDuration="1.320175117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:11:32.319070461 +0000 UTC m=+279.908894808" watchObservedRunningTime="2026-09-15 09:11:32.320175117 +0000 UTC m=+279.909999465"
Sep 15 09:11:32.917363 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:32.917329    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"]
Sep 15 09:11:32.920788 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:32.920771    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"
Sep 15 09:11:32.923402 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:32.923381    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 09:11:32.923504 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:32.923405    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:11:32.924417 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:32.924402    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9lpzt\""
Sep 15 09:11:32.929186 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:32.929166    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"]
Sep 15 09:11:33.041338 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:33.041307    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c98f\" (UniqueName: \"kubernetes.io/projected/1e26e945-7226-43a8-a22d-9896876ae368-kube-api-access-9c98f\") pod \"openshift-lws-operator-fd8ccff4c-2crpb\" (UID: \"1e26e945-7226-43a8-a22d-9896876ae368\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"
Sep 15 09:11:33.041338 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:33.041346    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e26e945-7226-43a8-a22d-9896876ae368-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2crpb\" (UID: \"1e26e945-7226-43a8-a22d-9896876ae368\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"
Sep 15 09:11:33.141881 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:33.141829    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c98f\" (UniqueName: \"kubernetes.io/projected/1e26e945-7226-43a8-a22d-9896876ae368-kube-api-access-9c98f\") pod \"openshift-lws-operator-fd8ccff4c-2crpb\" (UID: \"1e26e945-7226-43a8-a22d-9896876ae368\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"
Sep 15 09:11:33.142048 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:33.141894    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e26e945-7226-43a8-a22d-9896876ae368-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2crpb\" (UID: \"1e26e945-7226-43a8-a22d-9896876ae368\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"
Sep 15 09:11:33.142253 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:33.142237    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e26e945-7226-43a8-a22d-9896876ae368-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2crpb\" (UID: \"1e26e945-7226-43a8-a22d-9896876ae368\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"
Sep 15 09:11:33.150905 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:33.150877    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c98f\" (UniqueName: \"kubernetes.io/projected/1e26e945-7226-43a8-a22d-9896876ae368-kube-api-access-9c98f\") pod \"openshift-lws-operator-fd8ccff4c-2crpb\" (UID: \"1e26e945-7226-43a8-a22d-9896876ae368\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"
Sep 15 09:11:33.230816 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:33.230783    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"
Sep 15 09:11:33.503472 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:33.503446    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb"]
Sep 15 09:11:33.505236 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:11:33.505203    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e26e945_7226_43a8_a22d_9896876ae368.slice/crio-3a944822b748a3c623f62accf419bbbd2ddb3831f325abe4f892fa260482a337 WatchSource:0}: Error finding container 3a944822b748a3c623f62accf419bbbd2ddb3831f325abe4f892fa260482a337: Status 404 returned error can't find the container with id 3a944822b748a3c623f62accf419bbbd2ddb3831f325abe4f892fa260482a337
Sep 15 09:11:34.315288 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:34.315254    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb" event={"ID":"1e26e945-7226-43a8-a22d-9896876ae368","Type":"ContainerStarted","Data":"3a944822b748a3c623f62accf419bbbd2ddb3831f325abe4f892fa260482a337"}
Sep 15 09:11:36.326547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:36.326513    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb" event={"ID":"1e26e945-7226-43a8-a22d-9896876ae368","Type":"ContainerStarted","Data":"8ab7cd3590152935fdb24ae60edf0c26b7466b2b94db76aad3741017b87a158e"}
Sep 15 09:11:36.362005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:36.361956    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2crpb" podStartSLOduration=2.186077027 podStartE2EDuration="4.361941904s" totalImagesPullingTime="2.175864877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:11:36.356841883 +0000 UTC m=+283.946666242" watchObservedRunningTime="2026-09-15 09:11:36.361941904 +0000 UTC m=+283.951766253"
Sep 15 09:11:41.694917 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.694883    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"]
Sep 15 09:11:41.701192 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.699171    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:41.702475 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.702451    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:11:41.702592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.702475    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:11:41.703364 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.703349    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prhnb\""
Sep 15 09:11:41.706528 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.706502    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"]
Sep 15 09:11:41.821087 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.821051    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zq6\" (UniqueName: \"kubernetes.io/projected/9e94c71e-a605-4af5-9165-05aaf30211f7-kube-api-access-79zq6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:41.821087 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.821090    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:41.821302 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.821178    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:41.922404 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.922367    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:41.922545 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.922451    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zq6\" (UniqueName: \"kubernetes.io/projected/9e94c71e-a605-4af5-9165-05aaf30211f7-kube-api-access-79zq6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:41.922545 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.922486    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:41.922774 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.922754    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:41.922818 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.922790    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:41.930064 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:41.930029    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zq6\" (UniqueName: \"kubernetes.io/projected/9e94c71e-a605-4af5-9165-05aaf30211f7-kube-api-access-79zq6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:42.011163 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:42.011123    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:42.279541 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:42.279387    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"]
Sep 15 09:11:42.282083 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:11:42.282046    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e94c71e_a605_4af5_9165_05aaf30211f7.slice/crio-fd4bec853a2cd042ced893615130575bd1ed80cdcbf7d61c83fa8b8493d8f15f WatchSource:0}: Error finding container fd4bec853a2cd042ced893615130575bd1ed80cdcbf7d61c83fa8b8493d8f15f: Status 404 returned error can't find the container with id fd4bec853a2cd042ced893615130575bd1ed80cdcbf7d61c83fa8b8493d8f15f
Sep 15 09:11:42.352959 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:42.352927    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv" event={"ID":"9e94c71e-a605-4af5-9165-05aaf30211f7","Type":"ContainerStarted","Data":"52df1cd7f48dd01e6af4a22e3e57eb70f5eba7d30d8fd6fcf6c01c90c56934b9"}
Sep 15 09:11:42.353110 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:42.352984    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv" event={"ID":"9e94c71e-a605-4af5-9165-05aaf30211f7","Type":"ContainerStarted","Data":"fd4bec853a2cd042ced893615130575bd1ed80cdcbf7d61c83fa8b8493d8f15f"}
Sep 15 09:11:43.358404 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:43.358370    2555 generic.go:356] "Generic (PLEG): container finished" podID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerID="52df1cd7f48dd01e6af4a22e3e57eb70f5eba7d30d8fd6fcf6c01c90c56934b9" exitCode=0
Sep 15 09:11:43.358758 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:43.358416    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv" event={"ID":"9e94c71e-a605-4af5-9165-05aaf30211f7","Type":"ContainerDied","Data":"52df1cd7f48dd01e6af4a22e3e57eb70f5eba7d30d8fd6fcf6c01c90c56934b9"}
Sep 15 09:11:44.364654 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:44.364623    2555 generic.go:356] "Generic (PLEG): container finished" podID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerID="6e9783261e8104cffa0b8fc5fe13915673a6cc38c86435e3b9702422ad8bf022" exitCode=0
Sep 15 09:11:44.365056 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:44.364705    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv" event={"ID":"9e94c71e-a605-4af5-9165-05aaf30211f7","Type":"ContainerDied","Data":"6e9783261e8104cffa0b8fc5fe13915673a6cc38c86435e3b9702422ad8bf022"}
Sep 15 09:11:45.371609 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:45.371575    2555 generic.go:356] "Generic (PLEG): container finished" podID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerID="5b1ee91128655194f0c3393d2f9a9102a2f91ab835d74864f27f6bee7d21ffbe" exitCode=0
Sep 15 09:11:45.371609 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:45.371612    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv" event={"ID":"9e94c71e-a605-4af5-9165-05aaf30211f7","Type":"ContainerDied","Data":"5b1ee91128655194f0c3393d2f9a9102a2f91ab835d74864f27f6bee7d21ffbe"}
Sep 15 09:11:46.494451 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.494428    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:46.558860 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.558824    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79zq6\" (UniqueName: \"kubernetes.io/projected/9e94c71e-a605-4af5-9165-05aaf30211f7-kube-api-access-79zq6\") pod \"9e94c71e-a605-4af5-9165-05aaf30211f7\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") "
Sep 15 09:11:46.559015 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.558904    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-util\") pod \"9e94c71e-a605-4af5-9165-05aaf30211f7\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") "
Sep 15 09:11:46.559015 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.558993    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-bundle\") pod \"9e94c71e-a605-4af5-9165-05aaf30211f7\" (UID: \"9e94c71e-a605-4af5-9165-05aaf30211f7\") "
Sep 15 09:11:46.559631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.559604    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-bundle" (OuterVolumeSpecName: "bundle") pod "9e94c71e-a605-4af5-9165-05aaf30211f7" (UID: "9e94c71e-a605-4af5-9165-05aaf30211f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:11:46.560905 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.560878    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e94c71e-a605-4af5-9165-05aaf30211f7-kube-api-access-79zq6" (OuterVolumeSpecName: "kube-api-access-79zq6") pod "9e94c71e-a605-4af5-9165-05aaf30211f7" (UID: "9e94c71e-a605-4af5-9165-05aaf30211f7"). InnerVolumeSpecName "kube-api-access-79zq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:11:46.564436 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.564413    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-util" (OuterVolumeSpecName: "util") pod "9e94c71e-a605-4af5-9165-05aaf30211f7" (UID: "9e94c71e-a605-4af5-9165-05aaf30211f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:11:46.659974 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.659884    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79zq6\" (UniqueName: \"kubernetes.io/projected/9e94c71e-a605-4af5-9165-05aaf30211f7-kube-api-access-79zq6\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:11:46.659974 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.659915    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-util\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:11:46.659974 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:46.659924    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e94c71e-a605-4af5-9165-05aaf30211f7-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:11:47.381975 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:47.381935    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv" event={"ID":"9e94c71e-a605-4af5-9165-05aaf30211f7","Type":"ContainerDied","Data":"fd4bec853a2cd042ced893615130575bd1ed80cdcbf7d61c83fa8b8493d8f15f"}
Sep 15 09:11:47.382124 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:47.381993    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd4bec853a2cd042ced893615130575bd1ed80cdcbf7d61c83fa8b8493d8f15f"
Sep 15 09:11:47.382124 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:47.381950    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrssvv"
Sep 15 09:11:52.782908 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:52.782882    2555 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 09:11:56.151480 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.151443    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"]
Sep 15 09:11:56.152982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.151761    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerName="extract"
Sep 15 09:11:56.152982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.151772    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerName="extract"
Sep 15 09:11:56.152982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.151780    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerName="util"
Sep 15 09:11:56.152982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.151787    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerName="util"
Sep 15 09:11:56.152982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.151802    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerName="pull"
Sep 15 09:11:56.152982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.151806    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerName="pull"
Sep 15 09:11:56.152982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.151878    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e94c71e-a605-4af5-9165-05aaf30211f7" containerName="extract"
Sep 15 09:11:56.154622 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.154597    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.157493 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.157462    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:11:56.157602 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.157552    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:11:56.157602 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.157568    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prhnb\""
Sep 15 09:11:56.163909 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.163884    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"]
Sep 15 09:11:56.244065 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.244010    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.244243 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.244133    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p527\" (UniqueName: \"kubernetes.io/projected/b7448a76-0fb0-4681-94fe-c1d710a29489-kube-api-access-7p527\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.244243 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.244191    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.344737 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.344698    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p527\" (UniqueName: \"kubernetes.io/projected/b7448a76-0fb0-4681-94fe-c1d710a29489-kube-api-access-7p527\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.344894 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.344752    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.344894 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.344787    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.345112 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.345094    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.345166 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.345141    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.353672 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.353653    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p527\" (UniqueName: \"kubernetes.io/projected/b7448a76-0fb0-4681-94fe-c1d710a29489-kube-api-access-7p527\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.464735 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.464653    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:11:56.738171 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:56.738144    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"]
Sep 15 09:11:56.739239 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:11:56.739213    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7448a76_0fb0_4681_94fe_c1d710a29489.slice/crio-6b22ef5fc6d04d414c586df5181acd29985fe658f30c3bb436921f650df9bb1a WatchSource:0}: Error finding container 6b22ef5fc6d04d414c586df5181acd29985fe658f30c3bb436921f650df9bb1a: Status 404 returned error can't find the container with id 6b22ef5fc6d04d414c586df5181acd29985fe658f30c3bb436921f650df9bb1a
Sep 15 09:11:57.439977 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:57.439942    2555 generic.go:356] "Generic (PLEG): container finished" podID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerID="3470f70be1e82dd6f8df315e1088a7ca306b01e72576373fd5d15581d924db1d" exitCode=0
Sep 15 09:11:57.440393 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:57.440028    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh" event={"ID":"b7448a76-0fb0-4681-94fe-c1d710a29489","Type":"ContainerDied","Data":"3470f70be1e82dd6f8df315e1088a7ca306b01e72576373fd5d15581d924db1d"}
Sep 15 09:11:57.440393 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:57.440079    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh" event={"ID":"b7448a76-0fb0-4681-94fe-c1d710a29489","Type":"ContainerStarted","Data":"6b22ef5fc6d04d414c586df5181acd29985fe658f30c3bb436921f650df9bb1a"}
Sep 15 09:11:57.440540 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:57.440524    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:11:58.259502 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.259428    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"]
Sep 15 09:11:58.262015 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.261996    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.264806 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.264784    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 09:11:58.266046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.266017    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 09:11:58.266117 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.266093    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 09:11:58.266247 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.266226    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9l42l\""
Sep 15 09:11:58.266292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.266266    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 09:11:58.285918 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.285891    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"]
Sep 15 09:11:58.364012 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.363985    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzpb9\" (UniqueName: \"kubernetes.io/projected/b109500a-e462-45de-b13b-ed55f8d86f6c-kube-api-access-qzpb9\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.364158 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.364027    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b109500a-e462-45de-b13b-ed55f8d86f6c-webhook-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.364158 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.364053    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b109500a-e462-45de-b13b-ed55f8d86f6c-tmp\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.364158 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.364083    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b109500a-e462-45de-b13b-ed55f8d86f6c-manifests\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.364158 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.364111    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b109500a-e462-45de-b13b-ed55f8d86f6c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.446601 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.446569    2555 generic.go:356] "Generic (PLEG): container finished" podID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerID="1091a101bc01936839e067b6786cfdc6b61165825bc592be1cebbf54eb82adfa" exitCode=0
Sep 15 09:11:58.446977 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.446651    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh" event={"ID":"b7448a76-0fb0-4681-94fe-c1d710a29489","Type":"ContainerDied","Data":"1091a101bc01936839e067b6786cfdc6b61165825bc592be1cebbf54eb82adfa"}
Sep 15 09:11:58.465474 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.465450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b109500a-e462-45de-b13b-ed55f8d86f6c-tmp\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.465575 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.465478    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b109500a-e462-45de-b13b-ed55f8d86f6c-manifests\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.465575 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.465509    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b109500a-e462-45de-b13b-ed55f8d86f6c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.465685 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.465594    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzpb9\" (UniqueName: \"kubernetes.io/projected/b109500a-e462-45de-b13b-ed55f8d86f6c-kube-api-access-qzpb9\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.465685 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.465664    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b109500a-e462-45de-b13b-ed55f8d86f6c-webhook-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.466302 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.466276    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b109500a-e462-45de-b13b-ed55f8d86f6c-manifests\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.467904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.467882    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b109500a-e462-45de-b13b-ed55f8d86f6c-tmp\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.468041 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.468024    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b109500a-e462-45de-b13b-ed55f8d86f6c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.468286 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.468270    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b109500a-e462-45de-b13b-ed55f8d86f6c-webhook-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.474100 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.474081    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzpb9\" (UniqueName: \"kubernetes.io/projected/b109500a-e462-45de-b13b-ed55f8d86f6c-kube-api-access-qzpb9\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-j9zf8\" (UID: \"b109500a-e462-45de-b13b-ed55f8d86f6c\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.571873 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.571828    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:11:58.874309 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:58.874283    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"]
Sep 15 09:11:58.875751 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:11:58.875719    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb109500a_e462_45de_b13b_ed55f8d86f6c.slice/crio-36d2cab8ad56266944ef144caa71e34318ee1a4a63412a4e521c06e1344de564 WatchSource:0}: Error finding container 36d2cab8ad56266944ef144caa71e34318ee1a4a63412a4e521c06e1344de564: Status 404 returned error can't find the container with id 36d2cab8ad56266944ef144caa71e34318ee1a4a63412a4e521c06e1344de564
Sep 15 09:11:59.453356 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:59.453316    2555 generic.go:356] "Generic (PLEG): container finished" podID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerID="b74cff984f6610edf73170e840ebba837a428ec698ac9068e0b43b93fc09b2ed" exitCode=0
Sep 15 09:11:59.453777 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:59.453355    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh" event={"ID":"b7448a76-0fb0-4681-94fe-c1d710a29489","Type":"ContainerDied","Data":"b74cff984f6610edf73170e840ebba837a428ec698ac9068e0b43b93fc09b2ed"}
Sep 15 09:11:59.454807 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:11:59.454779    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8" event={"ID":"b109500a-e462-45de-b13b-ed55f8d86f6c","Type":"ContainerStarted","Data":"36d2cab8ad56266944ef144caa71e34318ee1a4a63412a4e521c06e1344de564"}
Sep 15 09:12:01.143933 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.143902    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:12:01.293176 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.293136    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-bundle\") pod \"b7448a76-0fb0-4681-94fe-c1d710a29489\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") "
Sep 15 09:12:01.293362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.293235    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p527\" (UniqueName: \"kubernetes.io/projected/b7448a76-0fb0-4681-94fe-c1d710a29489-kube-api-access-7p527\") pod \"b7448a76-0fb0-4681-94fe-c1d710a29489\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") "
Sep 15 09:12:01.293362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.293269    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-util\") pod \"b7448a76-0fb0-4681-94fe-c1d710a29489\" (UID: \"b7448a76-0fb0-4681-94fe-c1d710a29489\") "
Sep 15 09:12:01.294167 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.294135    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-bundle" (OuterVolumeSpecName: "bundle") pod "b7448a76-0fb0-4681-94fe-c1d710a29489" (UID: "b7448a76-0fb0-4681-94fe-c1d710a29489"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:12:01.295746 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.295717    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7448a76-0fb0-4681-94fe-c1d710a29489-kube-api-access-7p527" (OuterVolumeSpecName: "kube-api-access-7p527") pod "b7448a76-0fb0-4681-94fe-c1d710a29489" (UID: "b7448a76-0fb0-4681-94fe-c1d710a29489"). InnerVolumeSpecName "kube-api-access-7p527". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:12:01.299562 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.299520    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-util" (OuterVolumeSpecName: "util") pod "b7448a76-0fb0-4681-94fe-c1d710a29489" (UID: "b7448a76-0fb0-4681-94fe-c1d710a29489"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:12:01.394306 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.394222    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p527\" (UniqueName: \"kubernetes.io/projected/b7448a76-0fb0-4681-94fe-c1d710a29489-kube-api-access-7p527\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:01.394306 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.394260    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-util\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:01.394306 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.394273    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7448a76-0fb0-4681-94fe-c1d710a29489-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:01.468348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.468317    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh"
Sep 15 09:12:01.468348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.468336    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wdddh" event={"ID":"b7448a76-0fb0-4681-94fe-c1d710a29489","Type":"ContainerDied","Data":"6b22ef5fc6d04d414c586df5181acd29985fe658f30c3bb436921f650df9bb1a"}
Sep 15 09:12:01.468592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:01.468384    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b22ef5fc6d04d414c586df5181acd29985fe658f30c3bb436921f650df9bb1a"
Sep 15 09:12:02.476129 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:02.476094    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8" event={"ID":"b109500a-e462-45de-b13b-ed55f8d86f6c","Type":"ContainerStarted","Data":"efe8dee8885a104719ca760d36c77d0990b20440038dba8debf55ece14e34ec0"}
Sep 15 09:12:03.483247 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:03.483212    2555 generic.go:356] "Generic (PLEG): container finished" podID="b109500a-e462-45de-b13b-ed55f8d86f6c" containerID="efe8dee8885a104719ca760d36c77d0990b20440038dba8debf55ece14e34ec0" exitCode=0
Sep 15 09:12:03.483648 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:03.483309    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8" event={"ID":"b109500a-e462-45de-b13b-ed55f8d86f6c","Type":"ContainerDied","Data":"efe8dee8885a104719ca760d36c77d0990b20440038dba8debf55ece14e34ec0"}
Sep 15 09:12:04.492031 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:04.491989    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8" event={"ID":"b109500a-e462-45de-b13b-ed55f8d86f6c","Type":"ContainerStarted","Data":"b829e624a3b3ee4d9101e15724718c1426e6e364885faf767506ddeeb4b6c919"}
Sep 15 09:12:04.492518 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:04.492201    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:12:04.514087 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:04.514026    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8" podStartSLOduration=1.894744642 podStartE2EDuration="6.514006286s" totalImagesPullingTime="3.565528346s" totalInitContainerRuntime="1.053733298s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:11:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:04.512353293 +0000 UTC m=+312.102177652" watchObservedRunningTime="2026-09-15 09:12:04.514006286 +0000 UTC m=+312.103830635"
Sep 15 09:12:15.498714 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:15.498679    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-j9zf8"
Sep 15 09:12:18.270479 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.270434    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"]
Sep 15 09:12:18.270841 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.270791    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerName="pull"
Sep 15 09:12:18.270841 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.270803    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerName="pull"
Sep 15 09:12:18.270841 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.270813    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerName="extract"
Sep 15 09:12:18.270841 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.270819    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerName="extract"
Sep 15 09:12:18.270841 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.270837    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerName="util"
Sep 15 09:12:18.270841 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.270856    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerName="util"
Sep 15 09:12:18.271061 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.270921    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7448a76-0fb0-4681-94fe-c1d710a29489" containerName="extract"
Sep 15 09:12:18.273465 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.273447    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.278281 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.278258    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 09:12:18.278386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.278278    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 09:12:18.278830 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.278811    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 09:12:18.278934 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.278811    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rcndh\""
Sep 15 09:12:18.278993 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.278971    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 09:12:18.296075 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.296054    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"]
Sep 15 09:12:18.335090 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.335060    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489ca57d-8eed-47be-83ba-bd1571102daf-tls-certs\") pod \"kube-auth-proxy-5d5b88c986-dfz4g\" (UID: \"489ca57d-8eed-47be-83ba-bd1571102daf\") " pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.335250 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.335118    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c47r\" (UniqueName: \"kubernetes.io/projected/489ca57d-8eed-47be-83ba-bd1571102daf-kube-api-access-2c47r\") pod \"kube-auth-proxy-5d5b88c986-dfz4g\" (UID: \"489ca57d-8eed-47be-83ba-bd1571102daf\") " pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.335321 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.335248    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489ca57d-8eed-47be-83ba-bd1571102daf-tmp\") pod \"kube-auth-proxy-5d5b88c986-dfz4g\" (UID: \"489ca57d-8eed-47be-83ba-bd1571102daf\") " pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.436338 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.436303    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c47r\" (UniqueName: \"kubernetes.io/projected/489ca57d-8eed-47be-83ba-bd1571102daf-kube-api-access-2c47r\") pod \"kube-auth-proxy-5d5b88c986-dfz4g\" (UID: \"489ca57d-8eed-47be-83ba-bd1571102daf\") " pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.436484 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.436366    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489ca57d-8eed-47be-83ba-bd1571102daf-tmp\") pod \"kube-auth-proxy-5d5b88c986-dfz4g\" (UID: \"489ca57d-8eed-47be-83ba-bd1571102daf\") " pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.436484 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.436422    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489ca57d-8eed-47be-83ba-bd1571102daf-tls-certs\") pod \"kube-auth-proxy-5d5b88c986-dfz4g\" (UID: \"489ca57d-8eed-47be-83ba-bd1571102daf\") " pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.438603 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.438572    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489ca57d-8eed-47be-83ba-bd1571102daf-tmp\") pod \"kube-auth-proxy-5d5b88c986-dfz4g\" (UID: \"489ca57d-8eed-47be-83ba-bd1571102daf\") " pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.438805 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.438787    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489ca57d-8eed-47be-83ba-bd1571102daf-tls-certs\") pod \"kube-auth-proxy-5d5b88c986-dfz4g\" (UID: \"489ca57d-8eed-47be-83ba-bd1571102daf\") " pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.449634 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.449604    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c47r\" (UniqueName: \"kubernetes.io/projected/489ca57d-8eed-47be-83ba-bd1571102daf-kube-api-access-2c47r\") pod \"kube-auth-proxy-5d5b88c986-dfz4g\" (UID: \"489ca57d-8eed-47be-83ba-bd1571102daf\") " pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.583979 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.583892    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"
Sep 15 09:12:18.855411 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:18.855386    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g"]
Sep 15 09:12:18.857475 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:12:18.857449    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489ca57d_8eed_47be_83ba_bd1571102daf.slice/crio-194d4f26d0f14b6a4b2f5022771b1d0104ffcd77e9a3a071b93c5431a18f3e1f WatchSource:0}: Error finding container 194d4f26d0f14b6a4b2f5022771b1d0104ffcd77e9a3a071b93c5431a18f3e1f: Status 404 returned error can't find the container with id 194d4f26d0f14b6a4b2f5022771b1d0104ffcd77e9a3a071b93c5431a18f3e1f
Sep 15 09:12:19.567426 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.567368    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g" event={"ID":"489ca57d-8eed-47be-83ba-bd1571102daf","Type":"ContainerStarted","Data":"194d4f26d0f14b6a4b2f5022771b1d0104ffcd77e9a3a071b93c5431a18f3e1f"}
Sep 15 09:12:19.630815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.630689    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"]
Sep 15 09:12:19.633557 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.633532    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.637671 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.636129    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 09:12:19.637671 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.636214    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 09:12:19.637671 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.636130    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2fcvz\""
Sep 15 09:12:19.637671 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.636509    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 09:12:19.637671 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.636517    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 09:12:19.650969 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.650945    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"]
Sep 15 09:12:19.750335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.749741    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzf5f\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-kube-api-access-lzf5f\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.750335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.749814    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.750335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.749882    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.750335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.749939    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.750335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.750014    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.750335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.750049    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.750335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.750085    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.850795 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.850703    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzf5f\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-kube-api-access-lzf5f\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.850795 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.850764    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.851046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.850800    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.851046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.850857    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.851046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.850919    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.851046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.850942    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.851046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.850963    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.851644 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.851612    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.855032 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.854983    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.855155 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.855048    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.855454 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.855431    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.856390 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.856348    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.861208 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.861162    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzf5f\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-kube-api-access-lzf5f\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.862092 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.862052    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ddjq5\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:19.947864 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:19.947808    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:20.238714 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:20.238686    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"]
Sep 15 09:12:21.587660 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:12:21.587627    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96aa0df2_4b01_4e0b_aba1_3ac0a59b07e3.slice/crio-2f5b15c59b85ee24e134b518054803553e5179cb5fceb9badcb16a5d5ab1b751 WatchSource:0}: Error finding container 2f5b15c59b85ee24e134b518054803553e5179cb5fceb9badcb16a5d5ab1b751: Status 404 returned error can't find the container with id 2f5b15c59b85ee24e134b518054803553e5179cb5fceb9badcb16a5d5ab1b751
Sep 15 09:12:22.587142 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:22.587103    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g" event={"ID":"489ca57d-8eed-47be-83ba-bd1571102daf","Type":"ContainerStarted","Data":"a5263d692eff2f45563132868fdbdb3f42d28066cd22647fd6c2d8be9afb8424"}
Sep 15 09:12:22.588690 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:22.588657    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5" event={"ID":"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3","Type":"ContainerStarted","Data":"2f5b15c59b85ee24e134b518054803553e5179cb5fceb9badcb16a5d5ab1b751"}
Sep 15 09:12:22.604972 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:22.604918    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g" podStartSLOduration=1.842928497 podStartE2EDuration="4.604898552s" totalImagesPullingTime="2.761970055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:22.603301497 +0000 UTC m=+330.193125856" watchObservedRunningTime="2026-09-15 09:12:22.604898552 +0000 UTC m=+330.194722902"
Sep 15 09:12:23.977219 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:23.977174    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 09:12:23.977474 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:23.977267    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 09:12:24.601486 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:24.601419    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5" event={"ID":"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3","Type":"ContainerStarted","Data":"6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d"}
Sep 15 09:12:24.601742 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:24.601646    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:24.631036 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:24.630981    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5" podStartSLOduration=3.243853248 podStartE2EDuration="5.630964239s" totalImagesPullingTime="2.387110991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:24.623137817 +0000 UTC m=+332.212962186" watchObservedRunningTime="2026-09-15 09:12:24.630964239 +0000 UTC m=+332.220788586"
Sep 15 09:12:25.608265 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:25.608233    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:38.228339 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.228302    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qc974"]
Sep 15 09:12:38.235503 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.235482    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:12:38.241866 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.238916    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 15 09:12:38.244899 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.243375    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cxzqg\""
Sep 15 09:12:38.250521 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.250447    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qc974"]
Sep 15 09:12:38.253874 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.253832    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"]
Sep 15 09:12:38.256838 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.256821    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:38.259208 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.259188    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 15 09:12:38.259296 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.259223    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k77dl\""
Sep 15 09:12:38.271381 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.271359    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"]
Sep 15 09:12:38.325143 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.325110    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6211768-4056-4db1-8b7c-6e0bd710d8f5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j7j96\" (UID: \"a6211768-4056-4db1-8b7c-6e0bd710d8f5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:38.325290 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.325164    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f7kf\" (UniqueName: \"kubernetes.io/projected/7dcc2ead-7733-47ea-b964-90b1d0f31d51-kube-api-access-6f7kf\") pod \"kserve-controller-manager-d6f4b65b8-qc974\" (UID: \"7dcc2ead-7733-47ea-b964-90b1d0f31d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:12:38.325290 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.325208    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r5z6\" (UniqueName: \"kubernetes.io/projected/a6211768-4056-4db1-8b7c-6e0bd710d8f5-kube-api-access-9r5z6\") pod \"llmisvc-controller-manager-777c6bd7d5-j7j96\" (UID: \"a6211768-4056-4db1-8b7c-6e0bd710d8f5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:38.325290 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.325282    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dcc2ead-7733-47ea-b964-90b1d0f31d51-cert\") pod \"kserve-controller-manager-d6f4b65b8-qc974\" (UID: \"7dcc2ead-7733-47ea-b964-90b1d0f31d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:12:38.426112 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.426072    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6211768-4056-4db1-8b7c-6e0bd710d8f5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j7j96\" (UID: \"a6211768-4056-4db1-8b7c-6e0bd710d8f5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:38.426268 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.426156    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f7kf\" (UniqueName: \"kubernetes.io/projected/7dcc2ead-7733-47ea-b964-90b1d0f31d51-kube-api-access-6f7kf\") pod \"kserve-controller-manager-d6f4b65b8-qc974\" (UID: \"7dcc2ead-7733-47ea-b964-90b1d0f31d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:12:38.426268 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.426190    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r5z6\" (UniqueName: \"kubernetes.io/projected/a6211768-4056-4db1-8b7c-6e0bd710d8f5-kube-api-access-9r5z6\") pod \"llmisvc-controller-manager-777c6bd7d5-j7j96\" (UID: \"a6211768-4056-4db1-8b7c-6e0bd710d8f5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:38.426268 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:12:38.426238    2555 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 15 09:12:38.426403 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.426268    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dcc2ead-7733-47ea-b964-90b1d0f31d51-cert\") pod \"kserve-controller-manager-d6f4b65b8-qc974\" (UID: \"7dcc2ead-7733-47ea-b964-90b1d0f31d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:12:38.426403 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:12:38.426304    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6211768-4056-4db1-8b7c-6e0bd710d8f5-cert podName:a6211768-4056-4db1-8b7c-6e0bd710d8f5 nodeName:}" failed. No retries permitted until 2026-09-15 09:12:38.926286143 +0000 UTC m=+346.516110488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6211768-4056-4db1-8b7c-6e0bd710d8f5-cert") pod "llmisvc-controller-manager-777c6bd7d5-j7j96" (UID: "a6211768-4056-4db1-8b7c-6e0bd710d8f5") : secret "llmisvc-webhook-server-cert" not found
Sep 15 09:12:38.428592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.428565    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dcc2ead-7733-47ea-b964-90b1d0f31d51-cert\") pod \"kserve-controller-manager-d6f4b65b8-qc974\" (UID: \"7dcc2ead-7733-47ea-b964-90b1d0f31d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:12:38.438273 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.438250    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r5z6\" (UniqueName: \"kubernetes.io/projected/a6211768-4056-4db1-8b7c-6e0bd710d8f5-kube-api-access-9r5z6\") pod \"llmisvc-controller-manager-777c6bd7d5-j7j96\" (UID: \"a6211768-4056-4db1-8b7c-6e0bd710d8f5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:38.438374 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.438357    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f7kf\" (UniqueName: \"kubernetes.io/projected/7dcc2ead-7733-47ea-b964-90b1d0f31d51-kube-api-access-6f7kf\") pod \"kserve-controller-manager-d6f4b65b8-qc974\" (UID: \"7dcc2ead-7733-47ea-b964-90b1d0f31d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:12:38.557374 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.557292    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:12:38.829430 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.829406    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qc974"]
Sep 15 09:12:38.831198 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:12:38.831177    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcc2ead_7733_47ea_b964_90b1d0f31d51.slice/crio-bc98aa9f115a4138cdc33c4f109df21aa0bd174db664baa2fa6d9d4a38b2cec8 WatchSource:0}: Error finding container bc98aa9f115a4138cdc33c4f109df21aa0bd174db664baa2fa6d9d4a38b2cec8: Status 404 returned error can't find the container with id bc98aa9f115a4138cdc33c4f109df21aa0bd174db664baa2fa6d9d4a38b2cec8
Sep 15 09:12:38.930425 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.930393    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6211768-4056-4db1-8b7c-6e0bd710d8f5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j7j96\" (UID: \"a6211768-4056-4db1-8b7c-6e0bd710d8f5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:38.932683 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:38.932653    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6211768-4056-4db1-8b7c-6e0bd710d8f5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j7j96\" (UID: \"a6211768-4056-4db1-8b7c-6e0bd710d8f5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:39.167313 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:39.167218    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:39.438419 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:39.438388    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"]
Sep 15 09:12:39.439988 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:12:39.439956    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda6211768_4056_4db1_8b7c_6e0bd710d8f5.slice/crio-acd5807757e5662477cb827feceb16a781451e31b3647b053da28e17194f68ca WatchSource:0}: Error finding container acd5807757e5662477cb827feceb16a781451e31b3647b053da28e17194f68ca: Status 404 returned error can't find the container with id acd5807757e5662477cb827feceb16a781451e31b3647b053da28e17194f68ca
Sep 15 09:12:39.681212 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:39.681175    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974" event={"ID":"7dcc2ead-7733-47ea-b964-90b1d0f31d51","Type":"ContainerStarted","Data":"bc98aa9f115a4138cdc33c4f109df21aa0bd174db664baa2fa6d9d4a38b2cec8"}
Sep 15 09:12:39.682479 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:39.682453    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96" event={"ID":"a6211768-4056-4db1-8b7c-6e0bd710d8f5","Type":"ContainerStarted","Data":"acd5807757e5662477cb827feceb16a781451e31b3647b053da28e17194f68ca"}
Sep 15 09:12:40.098808 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.098771    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"]
Sep 15 09:12:40.098979 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.098965    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5" podUID="96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" containerName="discovery" containerID="cri-o://6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d" gracePeriod=30
Sep 15 09:12:40.357655 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.357592    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:40.448254 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.448209    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzf5f\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-kube-api-access-lzf5f\") pod \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") "
Sep 15 09:12:40.448702 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.448279    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-dns-cert\") pod \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") "
Sep 15 09:12:40.448702 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.448314    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-kubeconfig\") pod \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") "
Sep 15 09:12:40.448702 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.448353    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-ca-configmap\") pod \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") "
Sep 15 09:12:40.448702 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.448389    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-token\") pod \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") "
Sep 15 09:12:40.448702 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.448414    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-local-certs\") pod \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") "
Sep 15 09:12:40.448702 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.448468    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-cacerts\") pod \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\" (UID: \"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3\") "
Sep 15 09:12:40.449612 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.449546    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" (UID: "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:12:40.451118 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.451070    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" (UID: "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:12:40.452410 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.452359    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" (UID: "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:12:40.452639 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.452618    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-local-certs" (OuterVolumeSpecName: "local-certs") pod "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" (UID: "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:12:40.452722 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.452635    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-cacerts" (OuterVolumeSpecName: "cacerts") pod "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" (UID: "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:12:40.453468 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.453421    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" (UID: "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:12:40.453563 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.453501    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-kube-api-access-lzf5f" (OuterVolumeSpecName: "kube-api-access-lzf5f") pod "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" (UID: "96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3"). InnerVolumeSpecName "kube-api-access-lzf5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:12:40.550325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.550199    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-token\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:40.550325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.550238    2555 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-local-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:40.550325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.550250    2555 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-cacerts\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:40.550325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.550264    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzf5f\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-kube-api-access-lzf5f\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:40.550325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.550280    2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-dns-cert\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:40.550325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.550294    2555 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-kubeconfig\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:40.550325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.550306    2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3-istio-csr-ca-configmap\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:12:40.690505 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.690410    2555 generic.go:356] "Generic (PLEG): container finished" podID="96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" containerID="6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d" exitCode=0
Sep 15 09:12:40.690505 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.690470    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5" event={"ID":"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3","Type":"ContainerDied","Data":"6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d"}
Sep 15 09:12:40.690733 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.690579    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5" event={"ID":"96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3","Type":"ContainerDied","Data":"2f5b15c59b85ee24e134b518054803553e5179cb5fceb9badcb16a5d5ab1b751"}
Sep 15 09:12:40.690733 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.690599    2555 scope.go:117] "RemoveContainer" containerID="6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d"
Sep 15 09:12:40.690733 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.690476    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"
Sep 15 09:12:40.714741 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.714709    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"]
Sep 15 09:12:40.719456 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.719423    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5"]
Sep 15 09:12:40.954662 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.954580    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" path="/var/lib/kubelet/pods/96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3/volumes"
Sep 15 09:12:40.980753 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.980732    2555 scope.go:117] "RemoveContainer" containerID="6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d"
Sep 15 09:12:40.981208 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:12:40.981186    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d\": container with ID starting with 6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d not found: ID does not exist" containerID="6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d"
Sep 15 09:12:40.981270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:40.981219    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d"} err="failed to get container status \"6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d\": rpc error: code = NotFound desc = could not find container \"6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d\": container with ID starting with 6aaffd32b14b5cfe3c1734b0259cd98a65be6ced9a023a4291ceecb0c291c68d not found: ID does not exist"
Sep 15 09:12:42.706366 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:42.706290    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974" event={"ID":"7dcc2ead-7733-47ea-b964-90b1d0f31d51","Type":"ContainerStarted","Data":"7f30885107338187ff9d25a95e8209a1c6f12b474310eb03f1d0486d71f92885"}
Sep 15 09:12:42.706832 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:42.706707    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:12:42.725743 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:42.725686    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974" podStartSLOduration=2.405107922 podStartE2EDuration="4.725670715s" totalImagesPullingTime="2.320562793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:42.723011828 +0000 UTC m=+350.312836177" watchObservedRunningTime="2026-09-15 09:12:42.725670715 +0000 UTC m=+350.315495063"
Sep 15 09:12:43.712493 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:43.712453    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96" event={"ID":"a6211768-4056-4db1-8b7c-6e0bd710d8f5","Type":"ContainerStarted","Data":"254d118e375618990e5374b8c9c676c457b8e58c69065ac8cf7674641209a8b9"}
Sep 15 09:12:43.712893 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:43.712610    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:12:43.730315 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:12:43.730275    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96" podStartSLOduration=2.311714974 podStartE2EDuration="5.730260096s" totalImagesPullingTime="3.418545122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:43.729623562 +0000 UTC m=+351.319447911" watchObservedRunningTime="2026-09-15 09:12:43.730260096 +0000 UTC m=+351.320084445"
Sep 15 09:13:13.718292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:13.718256    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qc974"
Sep 15 09:13:14.720321 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:14.720290    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7j96"
Sep 15 09:13:31.835759 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.835721    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d9cd795b-4xzgk"]
Sep 15 09:13:31.836175 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.836116    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" containerName="discovery"
Sep 15 09:13:31.836175 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.836129    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" containerName="discovery"
Sep 15 09:13:31.836248 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.836192    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="96aa0df2-4b01-4e0b-aba1-3ac0a59b07e3" containerName="discovery"
Sep 15 09:13:31.841143 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.841120    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:31.855746 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.855718    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d9cd795b-4xzgk"]
Sep 15 09:13:31.994120 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.994081    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4bd\" (UniqueName: \"kubernetes.io/projected/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-kube-api-access-jh4bd\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:31.994290 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.994132    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-trusted-ca-bundle\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:31.994290 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.994204    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-oauth-serving-cert\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:31.994290 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.994249    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-console-oauth-config\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:31.994290 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.994270    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-service-ca\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:31.994290 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.994288    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-console-config\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:31.994446 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:31.994340    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-console-serving-cert\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.095035 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.094949    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-oauth-serving-cert\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.095035 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.095013    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-console-oauth-config\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.095266 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.095045    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-service-ca\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.095324 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.095255    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-console-config\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.095324 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.095318    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-console-serving-cert\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.095430 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.095345    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4bd\" (UniqueName: \"kubernetes.io/projected/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-kube-api-access-jh4bd\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.095486 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.095449    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-trusted-ca-bundle\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.095842 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.095813    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-console-config\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.095842 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.095837    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-service-ca\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.096041 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.095813    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-oauth-serving-cert\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.096182 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.096163    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-trusted-ca-bundle\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.097541 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.097521    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-console-oauth-config\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.097708 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.097691    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-console-serving-cert\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.104929 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.104910    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4bd\" (UniqueName: \"kubernetes.io/projected/20030d8c-7d67-49ee-a2b6-64a66eeeff7f-kube-api-access-jh4bd\") pod \"console-75d9cd795b-4xzgk\" (UID: \"20030d8c-7d67-49ee-a2b6-64a66eeeff7f\") " pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.149946 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.149905    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:32.433498 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.433407    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d9cd795b-4xzgk"]
Sep 15 09:13:32.437795 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:13:32.437766    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20030d8c_7d67_49ee_a2b6_64a66eeeff7f.slice/crio-e687bf49bfcce7888367d78153d297e4c99a682d55edf24b33cb17fd833d565c WatchSource:0}: Error finding container e687bf49bfcce7888367d78153d297e4c99a682d55edf24b33cb17fd833d565c: Status 404 returned error can't find the container with id e687bf49bfcce7888367d78153d297e4c99a682d55edf24b33cb17fd833d565c
Sep 15 09:13:32.960020 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.959986    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d9cd795b-4xzgk" event={"ID":"20030d8c-7d67-49ee-a2b6-64a66eeeff7f","Type":"ContainerStarted","Data":"d1634755d63680a50afb001ff2881246a459ee4f50c997a12821245e022a7264"}
Sep 15 09:13:32.960020 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.960026    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d9cd795b-4xzgk" event={"ID":"20030d8c-7d67-49ee-a2b6-64a66eeeff7f","Type":"ContainerStarted","Data":"e687bf49bfcce7888367d78153d297e4c99a682d55edf24b33cb17fd833d565c"}
Sep 15 09:13:32.979144 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:32.979097    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d9cd795b-4xzgk" podStartSLOduration=1.979081734 podStartE2EDuration="1.979081734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:13:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:13:32.97778529 +0000 UTC m=+400.567609647" watchObservedRunningTime="2026-09-15 09:13:32.979081734 +0000 UTC m=+400.568906083"
Sep 15 09:13:33.896550 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:33.896510    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"]
Sep 15 09:13:33.900261 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:33.900240    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:33.902794 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:33.902770    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:13:33.903797 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:33.903779    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prhnb\""
Sep 15 09:13:33.903901 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:33.903784    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:13:33.909305 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:33.909283    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"]
Sep 15 09:13:33.994587 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:33.994546    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"]
Sep 15 09:13:33.998424 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:33.998407    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.006570 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.006540    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"]
Sep 15 09:13:34.010709 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.010688    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.010797 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.010719    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vbjt\" (UniqueName: \"kubernetes.io/projected/309215ac-4ebb-4aa2-bb97-93fccb34c536-kube-api-access-6vbjt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.010797 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.010753    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.098605 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.098572    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"]
Sep 15 09:13:34.102213 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.102190    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.110746 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.110719    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"]
Sep 15 09:13:34.111897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.111875    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52b2b\" (UniqueName: \"kubernetes.io/projected/55b4961f-77d9-4568-88ff-aa11a8986d54-kube-api-access-52b2b\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.112267 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.112231    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.112390 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.112285    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vbjt\" (UniqueName: \"kubernetes.io/projected/309215ac-4ebb-4aa2-bb97-93fccb34c536-kube-api-access-6vbjt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.112390 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.112319    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.112390 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.112383    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.112565 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.112500    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.112565 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.112544    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.112801 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.112784    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.123021 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.122996    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vbjt\" (UniqueName: \"kubernetes.io/projected/309215ac-4ebb-4aa2-bb97-93fccb34c536-kube-api-access-6vbjt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.194232 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.194156    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"]
Sep 15 09:13:34.197890 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.197869    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.205365 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.205335    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"]
Sep 15 09:13:34.210344 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.210319    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:34.213026 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.213002    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.213154 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.213045    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.213154 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.213102    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.213154 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.213135    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwldk\" (UniqueName: \"kubernetes.io/projected/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-kube-api-access-bwldk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.213698 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.213160    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.213698 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.213187    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52b2b\" (UniqueName: \"kubernetes.io/projected/55b4961f-77d9-4568-88ff-aa11a8986d54-kube-api-access-52b2b\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.213698 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.213394    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.213698 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.213426    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.225707 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.225676    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52b2b\" (UniqueName: \"kubernetes.io/projected/55b4961f-77d9-4568-88ff-aa11a8986d54-kube-api-access-52b2b\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.308054 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.308021    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:34.314494 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.314470    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.314575 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.314515    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.314631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.314571    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccwzh\" (UniqueName: \"kubernetes.io/projected/e92d1518-666c-4d54-90e4-51cba897001a-kube-api-access-ccwzh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.314631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.314600    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.314731 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.314630    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.314731 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.314677    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwldk\" (UniqueName: \"kubernetes.io/projected/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-kube-api-access-bwldk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.314961 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.314940    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.315115 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.315099    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.324249 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.324219    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwldk\" (UniqueName: \"kubernetes.io/projected/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-kube-api-access-bwldk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.412175 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.412143    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:34.415525 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.415501    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccwzh\" (UniqueName: \"kubernetes.io/projected/e92d1518-666c-4d54-90e4-51cba897001a-kube-api-access-ccwzh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.415715 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.415541    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.415715 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.415559    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.415962 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.415944    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.415962 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.415954    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.424142 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.424120    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccwzh\" (UniqueName: \"kubernetes.io/projected/e92d1518-666c-4d54-90e4-51cba897001a-kube-api-access-ccwzh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.490497 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.490457    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"]
Sep 15 09:13:34.492564 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:13:34.492522    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod309215ac_4ebb_4aa2_bb97_93fccb34c536.slice/crio-039825cb4d2616bc9c04ced79a78b3eba584876bf79bb92de14441d70c154959 WatchSource:0}: Error finding container 039825cb4d2616bc9c04ced79a78b3eba584876bf79bb92de14441d70c154959: Status 404 returned error can't find the container with id 039825cb4d2616bc9c04ced79a78b3eba584876bf79bb92de14441d70c154959
Sep 15 09:13:34.508388 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.508363    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:34.594053 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.593922    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"]
Sep 15 09:13:34.596563 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:13:34.596532    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b4961f_77d9_4568_88ff_aa11a8986d54.slice/crio-9112e39b342ad0662d6292a9edbef5fde3a023315671e3b9baedd7a93be62c13 WatchSource:0}: Error finding container 9112e39b342ad0662d6292a9edbef5fde3a023315671e3b9baedd7a93be62c13: Status 404 returned error can't find the container with id 9112e39b342ad0662d6292a9edbef5fde3a023315671e3b9baedd7a93be62c13
Sep 15 09:13:34.684899 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.684871    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"]
Sep 15 09:13:34.686704 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:13:34.686675    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb662bd0f_1bb3_4a69_9de7_1c9bc80ddd78.slice/crio-f01cef22bb837614948b4f504438e0a0db0f86accc5ea89b951c735ba225b2fc WatchSource:0}: Error finding container f01cef22bb837614948b4f504438e0a0db0f86accc5ea89b951c735ba225b2fc: Status 404 returned error can't find the container with id f01cef22bb837614948b4f504438e0a0db0f86accc5ea89b951c735ba225b2fc
Sep 15 09:13:34.784418 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.784388    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"]
Sep 15 09:13:34.785729 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:13:34.785703    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92d1518_666c_4d54_90e4_51cba897001a.slice/crio-9731028b4fcab770cd3983c56a3608fcc1d8efd6e281faafd070f643ff607d85 WatchSource:0}: Error finding container 9731028b4fcab770cd3983c56a3608fcc1d8efd6e281faafd070f643ff607d85: Status 404 returned error can't find the container with id 9731028b4fcab770cd3983c56a3608fcc1d8efd6e281faafd070f643ff607d85
Sep 15 09:13:34.971334 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.971299    2555 generic.go:356] "Generic (PLEG): container finished" podID="e92d1518-666c-4d54-90e4-51cba897001a" containerID="80086681caf526908a8071e32453b1c2d09cd8b330bc80c2b771189a80067708" exitCode=0
Sep 15 09:13:34.971468 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.971375    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4" event={"ID":"e92d1518-666c-4d54-90e4-51cba897001a","Type":"ContainerDied","Data":"80086681caf526908a8071e32453b1c2d09cd8b330bc80c2b771189a80067708"}
Sep 15 09:13:34.971468 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.971423    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4" event={"ID":"e92d1518-666c-4d54-90e4-51cba897001a","Type":"ContainerStarted","Data":"9731028b4fcab770cd3983c56a3608fcc1d8efd6e281faafd070f643ff607d85"}
Sep 15 09:13:34.973004 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.972981    2555 generic.go:356] "Generic (PLEG): container finished" podID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerID="e727f16dfd473eac136a78bfa6d5d46cec4bf5d1507eb128098c854dd6cd40b5" exitCode=0
Sep 15 09:13:34.973239 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.973156    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz" event={"ID":"309215ac-4ebb-4aa2-bb97-93fccb34c536","Type":"ContainerDied","Data":"e727f16dfd473eac136a78bfa6d5d46cec4bf5d1507eb128098c854dd6cd40b5"}
Sep 15 09:13:34.973239 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.973209    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz" event={"ID":"309215ac-4ebb-4aa2-bb97-93fccb34c536","Type":"ContainerStarted","Data":"039825cb4d2616bc9c04ced79a78b3eba584876bf79bb92de14441d70c154959"}
Sep 15 09:13:34.974748 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.974718    2555 generic.go:356] "Generic (PLEG): container finished" podID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerID="f5e033c5809c67ee73ccded8d2d392852117dd5ef115c22b38968762f0981ce8" exitCode=0
Sep 15 09:13:34.974876 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.974742    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82" event={"ID":"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78","Type":"ContainerDied","Data":"f5e033c5809c67ee73ccded8d2d392852117dd5ef115c22b38968762f0981ce8"}
Sep 15 09:13:34.974876 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.974780    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82" event={"ID":"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78","Type":"ContainerStarted","Data":"f01cef22bb837614948b4f504438e0a0db0f86accc5ea89b951c735ba225b2fc"}
Sep 15 09:13:34.976528 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.976512    2555 generic.go:356] "Generic (PLEG): container finished" podID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerID="9b537e2d3388cd6a298699281535aa80ab00b1b1a011577fcb7c522812415321" exitCode=0
Sep 15 09:13:34.976615 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.976595    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz" event={"ID":"55b4961f-77d9-4568-88ff-aa11a8986d54","Type":"ContainerDied","Data":"9b537e2d3388cd6a298699281535aa80ab00b1b1a011577fcb7c522812415321"}
Sep 15 09:13:34.976674 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:34.976633    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz" event={"ID":"55b4961f-77d9-4568-88ff-aa11a8986d54","Type":"ContainerStarted","Data":"9112e39b342ad0662d6292a9edbef5fde3a023315671e3b9baedd7a93be62c13"}
Sep 15 09:13:35.984423 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:35.984390    2555 generic.go:356] "Generic (PLEG): container finished" podID="e92d1518-666c-4d54-90e4-51cba897001a" containerID="9c918a537c6bf3c03e4ecc7465a9b0e006653b2a6971c7fee2bfc29173b38757" exitCode=0
Sep 15 09:13:35.984826 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:35.984474    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4" event={"ID":"e92d1518-666c-4d54-90e4-51cba897001a","Type":"ContainerDied","Data":"9c918a537c6bf3c03e4ecc7465a9b0e006653b2a6971c7fee2bfc29173b38757"}
Sep 15 09:13:35.986429 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:35.986406    2555 generic.go:356] "Generic (PLEG): container finished" podID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerID="766f43de0405cb87e84551adaea2bc434baded1a5c4569fd248b1ca4c4a8974e" exitCode=0
Sep 15 09:13:35.986519 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:35.986485    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz" event={"ID":"309215ac-4ebb-4aa2-bb97-93fccb34c536","Type":"ContainerDied","Data":"766f43de0405cb87e84551adaea2bc434baded1a5c4569fd248b1ca4c4a8974e"}
Sep 15 09:13:35.988463 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:35.988445    2555 generic.go:356] "Generic (PLEG): container finished" podID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerID="604b95cd05049b7edeb9a1af9c68cc22795933bc1aad5a0d5c927666ae0a8716" exitCode=0
Sep 15 09:13:35.988530 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:35.988501    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82" event={"ID":"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78","Type":"ContainerDied","Data":"604b95cd05049b7edeb9a1af9c68cc22795933bc1aad5a0d5c927666ae0a8716"}
Sep 15 09:13:36.996286 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:36.996250    2555 generic.go:356] "Generic (PLEG): container finished" podID="e92d1518-666c-4d54-90e4-51cba897001a" containerID="0a1f1a7d1c6c8dd7907f476e0963ff3b71bdee07c674a40a654be13fedb1a805" exitCode=0
Sep 15 09:13:36.996727 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:36.996330    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4" event={"ID":"e92d1518-666c-4d54-90e4-51cba897001a","Type":"ContainerDied","Data":"0a1f1a7d1c6c8dd7907f476e0963ff3b71bdee07c674a40a654be13fedb1a805"}
Sep 15 09:13:36.998375 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:36.998353    2555 generic.go:356] "Generic (PLEG): container finished" podID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerID="f44e5c409ef00eb00f4a3e3385fefcbb769c914d919a3a32af70165420c7daa0" exitCode=0
Sep 15 09:13:36.998495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:36.998434    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz" event={"ID":"309215ac-4ebb-4aa2-bb97-93fccb34c536","Type":"ContainerDied","Data":"f44e5c409ef00eb00f4a3e3385fefcbb769c914d919a3a32af70165420c7daa0"}
Sep 15 09:13:37.000547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:37.000522    2555 generic.go:356] "Generic (PLEG): container finished" podID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerID="df8508da0224ecf9584c48c990501b9242f2297c0101cd58b7db46904115345c" exitCode=0
Sep 15 09:13:37.000639 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:37.000579    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82" event={"ID":"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78","Type":"ContainerDied","Data":"df8508da0224ecf9584c48c990501b9242f2297c0101cd58b7db46904115345c"}
Sep 15 09:13:38.008045 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.008013    2555 generic.go:356] "Generic (PLEG): container finished" podID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerID="a855f26360cd9543408c24a87fe859bf5491767f8ecdb88756fdba4d7f2e057a" exitCode=0
Sep 15 09:13:38.008441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.008105    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz" event={"ID":"55b4961f-77d9-4568-88ff-aa11a8986d54","Type":"ContainerDied","Data":"a855f26360cd9543408c24a87fe859bf5491767f8ecdb88756fdba4d7f2e057a"}
Sep 15 09:13:38.156362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.156302    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:38.223210 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.223184    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:38.234609 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.234584    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:38.253206 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.253184    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-bundle\") pod \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") "
Sep 15 09:13:38.253332 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.253234    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwldk\" (UniqueName: \"kubernetes.io/projected/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-kube-api-access-bwldk\") pod \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") "
Sep 15 09:13:38.253332 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.253258    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-util\") pod \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\" (UID: \"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78\") "
Sep 15 09:13:38.253716 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.253689    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-bundle" (OuterVolumeSpecName: "bundle") pod "b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" (UID: "b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:13:38.255327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.255301    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-kube-api-access-bwldk" (OuterVolumeSpecName: "kube-api-access-bwldk") pod "b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" (UID: "b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78"). InnerVolumeSpecName "kube-api-access-bwldk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:13:38.258608 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.258583    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-util" (OuterVolumeSpecName: "util") pod "b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" (UID: "b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:13:38.354198 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354106    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-bundle\") pod \"309215ac-4ebb-4aa2-bb97-93fccb34c536\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") "
Sep 15 09:13:38.354198 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354146    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vbjt\" (UniqueName: \"kubernetes.io/projected/309215ac-4ebb-4aa2-bb97-93fccb34c536-kube-api-access-6vbjt\") pod \"309215ac-4ebb-4aa2-bb97-93fccb34c536\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") "
Sep 15 09:13:38.354198 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354164    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-bundle\") pod \"e92d1518-666c-4d54-90e4-51cba897001a\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") "
Sep 15 09:13:38.354540 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354246    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-util\") pod \"e92d1518-666c-4d54-90e4-51cba897001a\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") "
Sep 15 09:13:38.354540 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354303    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccwzh\" (UniqueName: \"kubernetes.io/projected/e92d1518-666c-4d54-90e4-51cba897001a-kube-api-access-ccwzh\") pod \"e92d1518-666c-4d54-90e4-51cba897001a\" (UID: \"e92d1518-666c-4d54-90e4-51cba897001a\") "
Sep 15 09:13:38.354540 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354332    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-util\") pod \"309215ac-4ebb-4aa2-bb97-93fccb34c536\" (UID: \"309215ac-4ebb-4aa2-bb97-93fccb34c536\") "
Sep 15 09:13:38.354689 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354582    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwldk\" (UniqueName: \"kubernetes.io/projected/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-kube-api-access-bwldk\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:38.354689 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354600    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-util\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:38.354689 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354614    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:38.354949 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.354920    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-bundle" (OuterVolumeSpecName: "bundle") pod "e92d1518-666c-4d54-90e4-51cba897001a" (UID: "e92d1518-666c-4d54-90e4-51cba897001a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:13:38.355124 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.355100    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-bundle" (OuterVolumeSpecName: "bundle") pod "309215ac-4ebb-4aa2-bb97-93fccb34c536" (UID: "309215ac-4ebb-4aa2-bb97-93fccb34c536"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:13:38.356345 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.356325    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/309215ac-4ebb-4aa2-bb97-93fccb34c536-kube-api-access-6vbjt" (OuterVolumeSpecName: "kube-api-access-6vbjt") pod "309215ac-4ebb-4aa2-bb97-93fccb34c536" (UID: "309215ac-4ebb-4aa2-bb97-93fccb34c536"). InnerVolumeSpecName "kube-api-access-6vbjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:13:38.356742 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.356724    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92d1518-666c-4d54-90e4-51cba897001a-kube-api-access-ccwzh" (OuterVolumeSpecName: "kube-api-access-ccwzh") pod "e92d1518-666c-4d54-90e4-51cba897001a" (UID: "e92d1518-666c-4d54-90e4-51cba897001a"). InnerVolumeSpecName "kube-api-access-ccwzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:13:38.360024 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.360004    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-util" (OuterVolumeSpecName: "util") pod "309215ac-4ebb-4aa2-bb97-93fccb34c536" (UID: "309215ac-4ebb-4aa2-bb97-93fccb34c536"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:13:38.360541 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.360520    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-util" (OuterVolumeSpecName: "util") pod "e92d1518-666c-4d54-90e4-51cba897001a" (UID: "e92d1518-666c-4d54-90e4-51cba897001a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:13:38.456105 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.456072    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccwzh\" (UniqueName: \"kubernetes.io/projected/e92d1518-666c-4d54-90e4-51cba897001a-kube-api-access-ccwzh\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:38.456105 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.456102    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-util\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:38.456105 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.456113    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/309215ac-4ebb-4aa2-bb97-93fccb34c536-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:38.456330 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.456122    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vbjt\" (UniqueName: \"kubernetes.io/projected/309215ac-4ebb-4aa2-bb97-93fccb34c536-kube-api-access-6vbjt\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:38.456330 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.456131    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:38.456330 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:38.456139    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e92d1518-666c-4d54-90e4-51cba897001a-util\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:39.014827 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.014790    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82" event={"ID":"b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78","Type":"ContainerDied","Data":"f01cef22bb837614948b4f504438e0a0db0f86accc5ea89b951c735ba225b2fc"}
Sep 15 09:13:39.014827 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.014798    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gnr82"
Sep 15 09:13:39.015202 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.014870    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f01cef22bb837614948b4f504438e0a0db0f86accc5ea89b951c735ba225b2fc"
Sep 15 09:13:39.017202 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.017176    2555 generic.go:356] "Generic (PLEG): container finished" podID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerID="f1ab3f7d74b381157f51aab435c5073f2374187653a869bf5bd7904d7018b5b4" exitCode=0
Sep 15 09:13:39.017318 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.017266    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz" event={"ID":"55b4961f-77d9-4568-88ff-aa11a8986d54","Type":"ContainerDied","Data":"f1ab3f7d74b381157f51aab435c5073f2374187653a869bf5bd7904d7018b5b4"}
Sep 15 09:13:39.019119 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.019095    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4"
Sep 15 09:13:39.019213 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.019104    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jhjh4" event={"ID":"e92d1518-666c-4d54-90e4-51cba897001a","Type":"ContainerDied","Data":"9731028b4fcab770cd3983c56a3608fcc1d8efd6e281faafd070f643ff607d85"}
Sep 15 09:13:39.019261 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.019224    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9731028b4fcab770cd3983c56a3608fcc1d8efd6e281faafd070f643ff607d85"
Sep 15 09:13:39.021206 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.021101    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz" event={"ID":"309215ac-4ebb-4aa2-bb97-93fccb34c536","Type":"ContainerDied","Data":"039825cb4d2616bc9c04ced79a78b3eba584876bf79bb92de14441d70c154959"}
Sep 15 09:13:39.021206 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.021137    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="039825cb4d2616bc9c04ced79a78b3eba584876bf79bb92de14441d70c154959"
Sep 15 09:13:39.021206 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:39.021148    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajskpz"
Sep 15 09:13:40.154924 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.154903    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:40.271102 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.271063    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-util\") pod \"55b4961f-77d9-4568-88ff-aa11a8986d54\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") "
Sep 15 09:13:40.271102 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.271106    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52b2b\" (UniqueName: \"kubernetes.io/projected/55b4961f-77d9-4568-88ff-aa11a8986d54-kube-api-access-52b2b\") pod \"55b4961f-77d9-4568-88ff-aa11a8986d54\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") "
Sep 15 09:13:40.271336 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.271130    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-bundle\") pod \"55b4961f-77d9-4568-88ff-aa11a8986d54\" (UID: \"55b4961f-77d9-4568-88ff-aa11a8986d54\") "
Sep 15 09:13:40.271755 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.271731    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-bundle" (OuterVolumeSpecName: "bundle") pod "55b4961f-77d9-4568-88ff-aa11a8986d54" (UID: "55b4961f-77d9-4568-88ff-aa11a8986d54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:13:40.273188 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.273157    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b4961f-77d9-4568-88ff-aa11a8986d54-kube-api-access-52b2b" (OuterVolumeSpecName: "kube-api-access-52b2b") pod "55b4961f-77d9-4568-88ff-aa11a8986d54" (UID: "55b4961f-77d9-4568-88ff-aa11a8986d54"). InnerVolumeSpecName "kube-api-access-52b2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:13:40.275625 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.275585    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-util" (OuterVolumeSpecName: "util") pod "55b4961f-77d9-4568-88ff-aa11a8986d54" (UID: "55b4961f-77d9-4568-88ff-aa11a8986d54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:13:40.372707 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.372671    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-util\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:40.372707 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.372703    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52b2b\" (UniqueName: \"kubernetes.io/projected/55b4961f-77d9-4568-88ff-aa11a8986d54-kube-api-access-52b2b\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:40.372707 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:40.372715    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55b4961f-77d9-4568-88ff-aa11a8986d54-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:13:41.033287 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:41.033262    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz"
Sep 15 09:13:41.033429 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:41.033264    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c42tjz" event={"ID":"55b4961f-77d9-4568-88ff-aa11a8986d54","Type":"ContainerDied","Data":"9112e39b342ad0662d6292a9edbef5fde3a023315671e3b9baedd7a93be62c13"}
Sep 15 09:13:41.033429 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:41.033378    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9112e39b342ad0662d6292a9edbef5fde3a023315671e3b9baedd7a93be62c13"
Sep 15 09:13:42.150791 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:42.150753    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:42.151204 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:42.150815    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:42.155633 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:42.155608    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:43.047619 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:43.047590    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d9cd795b-4xzgk"
Sep 15 09:13:43.097839 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:43.097808    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c49cb5859-72fr9"]
Sep 15 09:13:48.466135 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466103    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-8475h"]
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466459    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92d1518-666c-4d54-90e4-51cba897001a" containerName="util"
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466470    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92d1518-666c-4d54-90e4-51cba897001a" containerName="util"
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466479    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerName="extract"
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466485    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerName="extract"
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466495    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerName="util"
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466500    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerName="util"
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466507    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerName="util"
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466511    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerName="util"
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466519    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerName="extract"
Sep 15 09:13:48.466524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466524    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerName="extract"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466532    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerName="pull"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466537    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerName="pull"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466545    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerName="util"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466550    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerName="util"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466556    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerName="pull"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466560    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerName="pull"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466567    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92d1518-666c-4d54-90e4-51cba897001a" containerName="extract"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466571    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92d1518-666c-4d54-90e4-51cba897001a" containerName="extract"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466583    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92d1518-666c-4d54-90e4-51cba897001a" containerName="pull"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466588    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92d1518-666c-4d54-90e4-51cba897001a" containerName="pull"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466593    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerName="pull"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466599    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerName="pull"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466606    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerName="extract"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466611    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerName="extract"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466677    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="309215ac-4ebb-4aa2-bb97-93fccb34c536" containerName="extract"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466685    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="55b4961f-77d9-4568-88ff-aa11a8986d54" containerName="extract"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466694    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b662bd0f-1bb3-4a69-9de7-1c9bc80ddd78" containerName="extract"
Sep 15 09:13:48.466802 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.466700    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92d1518-666c-4d54-90e4-51cba897001a" containerName="extract"
Sep 15 09:13:48.469569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.469552    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-8475h"
Sep 15 09:13:48.471924 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.471901    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 09:13:48.472050 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.471902    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bn4nr\""
Sep 15 09:13:48.472050 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.471972    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 09:13:48.479734 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.479713    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-8475h"]
Sep 15 09:13:48.542863 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.542810    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9vds\" (UniqueName: \"kubernetes.io/projected/3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7-kube-api-access-d9vds\") pod \"authorino-operator-76b478bd78-8475h\" (UID: \"3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7\") " pod="kuadrant-system/authorino-operator-76b478bd78-8475h"
Sep 15 09:13:48.643771 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.643742    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9vds\" (UniqueName: \"kubernetes.io/projected/3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7-kube-api-access-d9vds\") pod \"authorino-operator-76b478bd78-8475h\" (UID: \"3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7\") " pod="kuadrant-system/authorino-operator-76b478bd78-8475h"
Sep 15 09:13:48.652580 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.652555    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9vds\" (UniqueName: \"kubernetes.io/projected/3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7-kube-api-access-d9vds\") pod \"authorino-operator-76b478bd78-8475h\" (UID: \"3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7\") " pod="kuadrant-system/authorino-operator-76b478bd78-8475h"
Sep 15 09:13:48.780037 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:48.780000    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-8475h"
Sep 15 09:13:49.053066 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:49.053041    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-8475h"]
Sep 15 09:13:49.055929 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:13:49.055900    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7b0a8a_764e_4322_b3ab_0aa869fbcbd7.slice/crio-2c25ed58ae6465e6f1d9e767258d1dc258065a3c65a2bd24a17012ac5a6d96f1 WatchSource:0}: Error finding container 2c25ed58ae6465e6f1d9e767258d1dc258065a3c65a2bd24a17012ac5a6d96f1: Status 404 returned error can't find the container with id 2c25ed58ae6465e6f1d9e767258d1dc258065a3c65a2bd24a17012ac5a6d96f1
Sep 15 09:13:49.075890 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:49.075858    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-8475h" event={"ID":"3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7","Type":"ContainerStarted","Data":"2c25ed58ae6465e6f1d9e767258d1dc258065a3c65a2bd24a17012ac5a6d96f1"}
Sep 15 09:13:50.664904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:50.664870    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"]
Sep 15 09:13:50.675351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:50.675315    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:13:50.677394 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:50.677361    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"]
Sep 15 09:13:50.678041 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:50.678011    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lb7bq\""
Sep 15 09:13:50.763957 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:50.763918    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xszxm\" (UniqueName: \"kubernetes.io/projected/7f21d9df-114d-4b5f-88d4-a2481e2c7e09-kube-api-access-xszxm\") pod \"limitador-operator-controller-manager-74495c69f8-mvjt6\" (UID: \"7f21d9df-114d-4b5f-88d4-a2481e2c7e09\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:13:50.864673 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:50.864636    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xszxm\" (UniqueName: \"kubernetes.io/projected/7f21d9df-114d-4b5f-88d4-a2481e2c7e09-kube-api-access-xszxm\") pod \"limitador-operator-controller-manager-74495c69f8-mvjt6\" (UID: \"7f21d9df-114d-4b5f-88d4-a2481e2c7e09\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:13:50.878814 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:50.878780    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xszxm\" (UniqueName: \"kubernetes.io/projected/7f21d9df-114d-4b5f-88d4-a2481e2c7e09-kube-api-access-xszxm\") pod \"limitador-operator-controller-manager-74495c69f8-mvjt6\" (UID: \"7f21d9df-114d-4b5f-88d4-a2481e2c7e09\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:13:50.991185 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:50.991152    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:13:51.431343 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:51.431316    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"]
Sep 15 09:13:51.433228 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:13:51.433204    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f21d9df_114d_4b5f_88d4_a2481e2c7e09.slice/crio-c971cc04a5ee45afd9fdf924a02177218d13868986cf3f040b9c2d1e1fc9ade2 WatchSource:0}: Error finding container c971cc04a5ee45afd9fdf924a02177218d13868986cf3f040b9c2d1e1fc9ade2: Status 404 returned error can't find the container with id c971cc04a5ee45afd9fdf924a02177218d13868986cf3f040b9c2d1e1fc9ade2
Sep 15 09:13:52.097640 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:52.097594    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6" event={"ID":"7f21d9df-114d-4b5f-88d4-a2481e2c7e09","Type":"ContainerStarted","Data":"c971cc04a5ee45afd9fdf924a02177218d13868986cf3f040b9c2d1e1fc9ade2"}
Sep 15 09:13:52.099537 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:52.099478    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-8475h" event={"ID":"3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7","Type":"ContainerStarted","Data":"5778d1136d5c0669bcec2302a8a14f98bebb1d68a16a2269f90c762709d139ec"}
Sep 15 09:13:52.099665 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:52.099632    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-8475h"
Sep 15 09:13:52.125650 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:52.125601    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-8475h" podStartSLOduration=1.972239161 podStartE2EDuration="4.125584081s" totalImagesPullingTime="2.15334492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:13:52.122959238 +0000 UTC m=+419.712783588" watchObservedRunningTime="2026-09-15 09:13:52.125584081 +0000 UTC m=+419.715408429"
Sep 15 09:13:53.106425 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:53.106381    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6" event={"ID":"7f21d9df-114d-4b5f-88d4-a2481e2c7e09","Type":"ContainerStarted","Data":"9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9"}
Sep 15 09:13:53.106880 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:53.106452    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:13:53.127475 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:53.127422    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6" podStartSLOduration=1.888819561 podStartE2EDuration="3.127403087s" totalImagesPullingTime="1.238583526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:13:53.126441904 +0000 UTC m=+420.716266251" watchObservedRunningTime="2026-09-15 09:13:53.127403087 +0000 UTC m=+420.717227436"
Sep 15 09:13:55.098783 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.098751    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"]
Sep 15 09:13:55.102263 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.102242    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:13:55.105637 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.105616    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mbtvw\""
Sep 15 09:13:55.116458 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.116436    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"]
Sep 15 09:13:55.203514 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.203468    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vts4t\" (UniqueName: \"kubernetes.io/projected/54422429-7ed6-44dc-bf71-556457631707-kube-api-access-vts4t\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" (UID: \"54422429-7ed6-44dc-bf71-556457631707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:13:55.203730 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.203529    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54422429-7ed6-44dc-bf71-556457631707-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" (UID: \"54422429-7ed6-44dc-bf71-556457631707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:13:55.304342 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.304304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54422429-7ed6-44dc-bf71-556457631707-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" (UID: \"54422429-7ed6-44dc-bf71-556457631707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:13:55.304487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.304402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts4t\" (UniqueName: \"kubernetes.io/projected/54422429-7ed6-44dc-bf71-556457631707-kube-api-access-vts4t\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" (UID: \"54422429-7ed6-44dc-bf71-556457631707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:13:55.304699 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.304677    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54422429-7ed6-44dc-bf71-556457631707-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" (UID: \"54422429-7ed6-44dc-bf71-556457631707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:13:55.312990 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.312972    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vts4t\" (UniqueName: \"kubernetes.io/projected/54422429-7ed6-44dc-bf71-556457631707-kube-api-access-vts4t\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" (UID: \"54422429-7ed6-44dc-bf71-556457631707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:13:55.412387 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.412292    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:13:55.690149 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:55.690122    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"]
Sep 15 09:13:55.692466 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:13:55.692435    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54422429_7ed6_44dc_bf71_556457631707.slice/crio-21a03208e4c3a3f3e0106e1687904583b361b595df9e2f62e860f14b9825b3e1 WatchSource:0}: Error finding container 21a03208e4c3a3f3e0106e1687904583b361b595df9e2f62e860f14b9825b3e1: Status 404 returned error can't find the container with id 21a03208e4c3a3f3e0106e1687904583b361b595df9e2f62e860f14b9825b3e1
Sep 15 09:13:56.124395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:56.124356    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw" event={"ID":"54422429-7ed6-44dc-bf71-556457631707","Type":"ContainerStarted","Data":"21a03208e4c3a3f3e0106e1687904583b361b595df9e2f62e860f14b9825b3e1"}
Sep 15 09:13:57.181144 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.181105    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"]
Sep 15 09:13:57.184959 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.184936    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"
Sep 15 09:13:57.187414 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.187388    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-znzw8\""
Sep 15 09:13:57.187563 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.187530    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 15 09:13:57.197815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.197780    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"]
Sep 15 09:13:57.221371 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.221336    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99v72\" (UniqueName: \"kubernetes.io/projected/ca67e4e6-d472-4cc6-a634-da8cf8f58ec2-kube-api-access-99v72\") pod \"dns-operator-controller-manager-7b84cd7c9c-224kr\" (UID: \"ca67e4e6-d472-4cc6-a634-da8cf8f58ec2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"
Sep 15 09:13:57.322693 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.322654    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99v72\" (UniqueName: \"kubernetes.io/projected/ca67e4e6-d472-4cc6-a634-da8cf8f58ec2-kube-api-access-99v72\") pod \"dns-operator-controller-manager-7b84cd7c9c-224kr\" (UID: \"ca67e4e6-d472-4cc6-a634-da8cf8f58ec2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"
Sep 15 09:13:57.334798 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.334765    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99v72\" (UniqueName: \"kubernetes.io/projected/ca67e4e6-d472-4cc6-a634-da8cf8f58ec2-kube-api-access-99v72\") pod \"dns-operator-controller-manager-7b84cd7c9c-224kr\" (UID: \"ca67e4e6-d472-4cc6-a634-da8cf8f58ec2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"
Sep 15 09:13:57.499089 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.499051    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"
Sep 15 09:13:57.782191 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:57.782148    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"]
Sep 15 09:13:57.784554 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:13:57.784521    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca67e4e6_d472_4cc6_a634_da8cf8f58ec2.slice/crio-8f11f59ca1f28f334cdd84f0496753ae9402e6dd3b1555f53eb8331f2deb3428 WatchSource:0}: Error finding container 8f11f59ca1f28f334cdd84f0496753ae9402e6dd3b1555f53eb8331f2deb3428: Status 404 returned error can't find the container with id 8f11f59ca1f28f334cdd84f0496753ae9402e6dd3b1555f53eb8331f2deb3428
Sep 15 09:13:58.141067 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:13:58.140978    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr" event={"ID":"ca67e4e6-d472-4cc6-a634-da8cf8f58ec2","Type":"ContainerStarted","Data":"8f11f59ca1f28f334cdd84f0496753ae9402e6dd3b1555f53eb8331f2deb3428"}
Sep 15 09:14:00.156744 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:00.156711    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw" event={"ID":"54422429-7ed6-44dc-bf71-556457631707","Type":"ContainerStarted","Data":"802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc"}
Sep 15 09:14:00.157123 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:00.156827    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:00.180866 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:00.180806    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw" podStartSLOduration=1.497571811 podStartE2EDuration="5.180791867s" totalImagesPullingTime="3.683220056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:00.177610197 +0000 UTC m=+427.767434545" watchObservedRunningTime="2026-09-15 09:14:00.180791867 +0000 UTC m=+427.770616214"
Sep 15 09:14:01.164077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:01.164040    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr" event={"ID":"ca67e4e6-d472-4cc6-a634-da8cf8f58ec2","Type":"ContainerStarted","Data":"2d38e4f6043ec0700403bf63ad73f9e90100590a7fd1cbaf16bc2b94fb7269a6"}
Sep 15 09:14:01.164547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:01.164131    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"
Sep 15 09:14:01.182339 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:01.182284    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr" podStartSLOduration=1.755209739 podStartE2EDuration="4.182267581s" totalImagesPullingTime="2.427057842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:01.179921644 +0000 UTC m=+428.769745991" watchObservedRunningTime="2026-09-15 09:14:01.182267581 +0000 UTC m=+428.772091928"
Sep 15 09:14:02.281248 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.281211    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"]
Sep 15 09:14:02.284827 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.284808    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.287333 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.287311    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 15 09:14:02.287421 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.287346    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 15 09:14:02.287455 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.287353    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zpms4\""
Sep 15 09:14:02.295608 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.295581    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"]
Sep 15 09:14:02.369752 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.369717    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4p5n\" (UniqueName: \"kubernetes.io/projected/6effc90f-5c92-49d2-b59f-967977bc70ee-kube-api-access-l4p5n\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.369933 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.369768    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6effc90f-5c92-49d2-b59f-967977bc70ee-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.369933 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.369884    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6effc90f-5c92-49d2-b59f-967977bc70ee-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.470999 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.470965    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6effc90f-5c92-49d2-b59f-967977bc70ee-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.471292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.471015    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4p5n\" (UniqueName: \"kubernetes.io/projected/6effc90f-5c92-49d2-b59f-967977bc70ee-kube-api-access-l4p5n\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.471292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.471039    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6effc90f-5c92-49d2-b59f-967977bc70ee-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.471292 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:02.471125    2555 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 15 09:14:02.471292 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:02.471208    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6effc90f-5c92-49d2-b59f-967977bc70ee-plugin-serving-cert podName:6effc90f-5c92-49d2-b59f-967977bc70ee nodeName:}" failed. No retries permitted until 2026-09-15 09:14:02.971185162 +0000 UTC m=+430.561009501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/6effc90f-5c92-49d2-b59f-967977bc70ee-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-6dtrg" (UID: "6effc90f-5c92-49d2-b59f-967977bc70ee") : secret "plugin-serving-cert" not found
Sep 15 09:14:02.471583 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.471565    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6effc90f-5c92-49d2-b59f-967977bc70ee-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.480063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.480039    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4p5n\" (UniqueName: \"kubernetes.io/projected/6effc90f-5c92-49d2-b59f-967977bc70ee-kube-api-access-l4p5n\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.976354 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.976320    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6effc90f-5c92-49d2-b59f-967977bc70ee-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:02.978740 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:02.978716    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6effc90f-5c92-49d2-b59f-967977bc70ee-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6dtrg\" (UID: \"6effc90f-5c92-49d2-b59f-967977bc70ee\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:03.109188 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:03.109160    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-8475h"
Sep 15 09:14:03.193585 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:03.193554    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"
Sep 15 09:14:03.464754 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:03.464727    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg"]
Sep 15 09:14:03.466319 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:14:03.466292    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6effc90f_5c92_49d2_b59f_967977bc70ee.slice/crio-65e990e9364917b39598eab63091a661b994d7dfc0362ac189ce308b1ed3aeaf WatchSource:0}: Error finding container 65e990e9364917b39598eab63091a661b994d7dfc0362ac189ce308b1ed3aeaf: Status 404 returned error can't find the container with id 65e990e9364917b39598eab63091a661b994d7dfc0362ac189ce308b1ed3aeaf
Sep 15 09:14:04.114841 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:04.114805    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:14:04.192052 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:04.192012    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg" event={"ID":"6effc90f-5c92-49d2-b59f-967977bc70ee","Type":"ContainerStarted","Data":"65e990e9364917b39598eab63091a661b994d7dfc0362ac189ce308b1ed3aeaf"}
Sep 15 09:14:08.117203 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.117155    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c49cb5859-72fr9" podUID="de16d0fb-ad61-42e9-b58f-44951f915f9f" containerName="console" containerID="cri-o://c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e" gracePeriod=15
Sep 15 09:14:08.220320 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.220275    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg" event={"ID":"6effc90f-5c92-49d2-b59f-967977bc70ee","Type":"ContainerStarted","Data":"f1231b0f954e388ffb85f18f39f23ba8eabf3cc939ae0910e59bd03517aad296"}
Sep 15 09:14:08.238305 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.238261    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6dtrg" podStartSLOduration=1.995269801 podStartE2EDuration="6.238239663s" totalImagesPullingTime="4.242969862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:08.236173996 +0000 UTC m=+435.825998349" watchObservedRunningTime="2026-09-15 09:14:08.238239663 +0000 UTC m=+435.828064010"
Sep 15 09:14:08.367342 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.367287    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:14:08.424891 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.424842    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-oauth-config\") pod \"de16d0fb-ad61-42e9-b58f-44951f915f9f\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") "
Sep 15 09:14:08.424891 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.424894    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-config\") pod \"de16d0fb-ad61-42e9-b58f-44951f915f9f\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") "
Sep 15 09:14:08.425084 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.425004    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-oauth-serving-cert\") pod \"de16d0fb-ad61-42e9-b58f-44951f915f9f\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") "
Sep 15 09:14:08.425084 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.425060    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-serving-cert\") pod \"de16d0fb-ad61-42e9-b58f-44951f915f9f\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") "
Sep 15 09:14:08.425178 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.425100    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-service-ca\") pod \"de16d0fb-ad61-42e9-b58f-44951f915f9f\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") "
Sep 15 09:14:08.425178 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.425123    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-trusted-ca-bundle\") pod \"de16d0fb-ad61-42e9-b58f-44951f915f9f\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") "
Sep 15 09:14:08.425178 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.425164    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8sbd\" (UniqueName: \"kubernetes.io/projected/de16d0fb-ad61-42e9-b58f-44951f915f9f-kube-api-access-j8sbd\") pod \"de16d0fb-ad61-42e9-b58f-44951f915f9f\" (UID: \"de16d0fb-ad61-42e9-b58f-44951f915f9f\") "
Sep 15 09:14:08.425329 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.425301    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-config" (OuterVolumeSpecName: "console-config") pod "de16d0fb-ad61-42e9-b58f-44951f915f9f" (UID: "de16d0fb-ad61-42e9-b58f-44951f915f9f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:14:08.425429 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.425410    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "de16d0fb-ad61-42e9-b58f-44951f915f9f" (UID: "de16d0fb-ad61-42e9-b58f-44951f915f9f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:14:08.425543 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.425522    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-service-ca" (OuterVolumeSpecName: "service-ca") pod "de16d0fb-ad61-42e9-b58f-44951f915f9f" (UID: "de16d0fb-ad61-42e9-b58f-44951f915f9f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:14:08.425596 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.425550    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "de16d0fb-ad61-42e9-b58f-44951f915f9f" (UID: "de16d0fb-ad61-42e9-b58f-44951f915f9f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:14:08.426941 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.426920    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "de16d0fb-ad61-42e9-b58f-44951f915f9f" (UID: "de16d0fb-ad61-42e9-b58f-44951f915f9f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:14:08.427096 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.427075    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "de16d0fb-ad61-42e9-b58f-44951f915f9f" (UID: "de16d0fb-ad61-42e9-b58f-44951f915f9f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:14:08.427190 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.427171    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de16d0fb-ad61-42e9-b58f-44951f915f9f-kube-api-access-j8sbd" (OuterVolumeSpecName: "kube-api-access-j8sbd") pod "de16d0fb-ad61-42e9-b58f-44951f915f9f" (UID: "de16d0fb-ad61-42e9-b58f-44951f915f9f"). InnerVolumeSpecName "kube-api-access-j8sbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:14:08.526832 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.526799    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8sbd\" (UniqueName: \"kubernetes.io/projected/de16d0fb-ad61-42e9-b58f-44951f915f9f-kube-api-access-j8sbd\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:08.526832 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.526825    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-oauth-config\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:08.526832 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.526834    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-config\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:08.527063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.526843    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-oauth-serving-cert\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:08.527063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.526864    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de16d0fb-ad61-42e9-b58f-44951f915f9f-console-serving-cert\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:08.527063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.526872    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:08.527063 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:08.526880    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de16d0fb-ad61-42e9-b58f-44951f915f9f-trusted-ca-bundle\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:09.227686 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:09.227652    2555 generic.go:356] "Generic (PLEG): container finished" podID="de16d0fb-ad61-42e9-b58f-44951f915f9f" containerID="c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e" exitCode=0
Sep 15 09:14:09.228182 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:09.227711    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c49cb5859-72fr9" event={"ID":"de16d0fb-ad61-42e9-b58f-44951f915f9f","Type":"ContainerDied","Data":"c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e"}
Sep 15 09:14:09.228182 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:09.227733    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c49cb5859-72fr9"
Sep 15 09:14:09.228182 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:09.227768    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c49cb5859-72fr9" event={"ID":"de16d0fb-ad61-42e9-b58f-44951f915f9f","Type":"ContainerDied","Data":"03b553e6884f9fbe27defc0e0bad6600d9c3ae11251d5e8664ccf0c201d7f4ab"}
Sep 15 09:14:09.228182 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:09.227792    2555 scope.go:117] "RemoveContainer" containerID="c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e"
Sep 15 09:14:09.237145 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:09.237125    2555 scope.go:117] "RemoveContainer" containerID="c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e"
Sep 15 09:14:09.237441 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:09.237419    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e\": container with ID starting with c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e not found: ID does not exist" containerID="c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e"
Sep 15 09:14:09.237513 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:09.237454    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e"} err="failed to get container status \"c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e\": rpc error: code = NotFound desc = could not find container \"c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e\": container with ID starting with c134c344d010fbf6f0dd62aaced54136c794a2b2049183be81d7e15194a0147e not found: ID does not exist"
Sep 15 09:14:09.249541 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:09.249515    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c49cb5859-72fr9"]
Sep 15 09:14:09.251815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:09.251795    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c49cb5859-72fr9"]
Sep 15 09:14:10.955005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:10.954974    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de16d0fb-ad61-42e9-b58f-44951f915f9f" path="/var/lib/kubelet/pods/de16d0fb-ad61-42e9-b58f-44951f915f9f/volumes"
Sep 15 09:14:11.167260 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:11.167223    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:12.177326 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:12.177290    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-224kr"
Sep 15 09:14:13.353029 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.352993    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"]
Sep 15 09:14:13.353486 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.353205    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw" podUID="54422429-7ed6-44dc-bf71-556457631707" containerName="manager" containerID="cri-o://802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc" gracePeriod=2
Sep 15 09:14:13.355424 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.355404    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"]
Sep 15 09:14:13.355785 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.355771    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de16d0fb-ad61-42e9-b58f-44951f915f9f" containerName="console"
Sep 15 09:14:13.355835 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.355786    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="de16d0fb-ad61-42e9-b58f-44951f915f9f" containerName="console"
Sep 15 09:14:13.355920 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.355897    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="de16d0fb-ad61-42e9-b58f-44951f915f9f" containerName="console"
Sep 15 09:14:13.360868 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.360826    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:13.367401 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.367375    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"]
Sep 15 09:14:13.375904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.375878    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"]
Sep 15 09:14:13.376976 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.376935    2555 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"54422429-7ed6-44dc-bf71-556457631707\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\": pods \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:13.379165 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.379129    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="54422429-7ed6-44dc-bf71-556457631707" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:13.381307 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.380917    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"]
Sep 15 09:14:13.381960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.381519    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54422429-7ed6-44dc-bf71-556457631707" containerName="manager"
Sep 15 09:14:13.381960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.381541    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="54422429-7ed6-44dc-bf71-556457631707" containerName="manager"
Sep 15 09:14:13.381960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.381651    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="54422429-7ed6-44dc-bf71-556457631707" containerName="manager"
Sep 15 09:14:13.384971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.384953    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"]
Sep 15 09:14:13.385074 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.385054    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:13.385123 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.385109    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" containerName="manager" containerID="cri-o://9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9" gracePeriod=2
Sep 15 09:14:13.397776 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.397751    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"]
Sep 15 09:14:13.403156 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.403130    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"]
Sep 15 09:14:13.410730 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.410687    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mvjt6\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:14:13.412697 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.412669    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="54422429-7ed6-44dc-bf71-556457631707" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:13.413820 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.413801    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"]
Sep 15 09:14:13.414186 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.414172    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" containerName="manager"
Sep 15 09:14:13.414267 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.414187    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" containerName="manager"
Sep 15 09:14:13.414302 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.414268    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" containerName="manager"
Sep 15 09:14:13.417209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.417193    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"
Sep 15 09:14:13.425383 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.425358    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"]
Sep 15 09:14:13.439694 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.439648    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mvjt6\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:14:13.469006 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.468973    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="54422429-7ed6-44dc-bf71-556457631707" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:13.469734 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.469711    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846cf322-31d2-4fad-a189-8e3966a2855f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xjl2x\" (UID: \"846cf322-31d2-4fad-a189-8e3966a2855f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:13.469780 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.469757    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2bc7fd-2df1-438c-a232-5fa2976f90da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-m26kb\" (UID: \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:13.469816 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.469777    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnhfh\" (UniqueName: \"kubernetes.io/projected/846cf322-31d2-4fad-a189-8e3966a2855f-kube-api-access-tnhfh\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xjl2x\" (UID: \"846cf322-31d2-4fad-a189-8e3966a2855f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:13.469871 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.469824    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx77d\" (UniqueName: \"kubernetes.io/projected/ac2bc7fd-2df1-438c-a232-5fa2976f90da-kube-api-access-dx77d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-m26kb\" (UID: \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:13.570449 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.570410    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skdmx\" (UniqueName: \"kubernetes.io/projected/3c6d0438-a48d-49aa-89e1-6c63de4ccee1-kube-api-access-skdmx\") pod \"limitador-operator-controller-manager-74495c69f8-mpwvb\" (UID: \"3c6d0438-a48d-49aa-89e1-6c63de4ccee1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"
Sep 15 09:14:13.570590 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.570473    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846cf322-31d2-4fad-a189-8e3966a2855f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xjl2x\" (UID: \"846cf322-31d2-4fad-a189-8e3966a2855f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:13.570590 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.570512    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2bc7fd-2df1-438c-a232-5fa2976f90da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-m26kb\" (UID: \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:13.570590 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.570536    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnhfh\" (UniqueName: \"kubernetes.io/projected/846cf322-31d2-4fad-a189-8e3966a2855f-kube-api-access-tnhfh\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xjl2x\" (UID: \"846cf322-31d2-4fad-a189-8e3966a2855f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:13.570590 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.570578    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx77d\" (UniqueName: \"kubernetes.io/projected/ac2bc7fd-2df1-438c-a232-5fa2976f90da-kube-api-access-dx77d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-m26kb\" (UID: \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:13.570932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.570907    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846cf322-31d2-4fad-a189-8e3966a2855f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xjl2x\" (UID: \"846cf322-31d2-4fad-a189-8e3966a2855f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:13.571201 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.571183    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2bc7fd-2df1-438c-a232-5fa2976f90da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-m26kb\" (UID: \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:13.581552 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.581532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx77d\" (UniqueName: \"kubernetes.io/projected/ac2bc7fd-2df1-438c-a232-5fa2976f90da-kube-api-access-dx77d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-m26kb\" (UID: \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:13.582025 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.581998    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnhfh\" (UniqueName: \"kubernetes.io/projected/846cf322-31d2-4fad-a189-8e3966a2855f-kube-api-access-tnhfh\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xjl2x\" (UID: \"846cf322-31d2-4fad-a189-8e3966a2855f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:13.625423 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.625400    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:13.627402 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.627386    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:14:13.627722 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.627700    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="54422429-7ed6-44dc-bf71-556457631707" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:13.629547 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.629527    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mvjt6\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:14:13.631174 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.631156    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mvjt6\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:14:13.632876 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:13.632842    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="54422429-7ed6-44dc-bf71-556457631707" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:13.671331 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.671295    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skdmx\" (UniqueName: \"kubernetes.io/projected/3c6d0438-a48d-49aa-89e1-6c63de4ccee1-kube-api-access-skdmx\") pod \"limitador-operator-controller-manager-74495c69f8-mpwvb\" (UID: \"3c6d0438-a48d-49aa-89e1-6c63de4ccee1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"
Sep 15 09:14:13.680672 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.680650    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skdmx\" (UniqueName: \"kubernetes.io/projected/3c6d0438-a48d-49aa-89e1-6c63de4ccee1-kube-api-access-skdmx\") pod \"limitador-operator-controller-manager-74495c69f8-mpwvb\" (UID: \"3c6d0438-a48d-49aa-89e1-6c63de4ccee1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"
Sep 15 09:14:13.772071 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.772038    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xszxm\" (UniqueName: \"kubernetes.io/projected/7f21d9df-114d-4b5f-88d4-a2481e2c7e09-kube-api-access-xszxm\") pod \"7f21d9df-114d-4b5f-88d4-a2481e2c7e09\" (UID: \"7f21d9df-114d-4b5f-88d4-a2481e2c7e09\") "
Sep 15 09:14:13.772237 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.772087    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vts4t\" (UniqueName: \"kubernetes.io/projected/54422429-7ed6-44dc-bf71-556457631707-kube-api-access-vts4t\") pod \"54422429-7ed6-44dc-bf71-556457631707\" (UID: \"54422429-7ed6-44dc-bf71-556457631707\") "
Sep 15 09:14:13.772237 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.772121    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54422429-7ed6-44dc-bf71-556457631707-extensions-socket-volume\") pod \"54422429-7ed6-44dc-bf71-556457631707\" (UID: \"54422429-7ed6-44dc-bf71-556457631707\") "
Sep 15 09:14:13.772659 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.772636    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54422429-7ed6-44dc-bf71-556457631707-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "54422429-7ed6-44dc-bf71-556457631707" (UID: "54422429-7ed6-44dc-bf71-556457631707"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:14:13.774288 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.774259    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f21d9df-114d-4b5f-88d4-a2481e2c7e09-kube-api-access-xszxm" (OuterVolumeSpecName: "kube-api-access-xszxm") pod "7f21d9df-114d-4b5f-88d4-a2481e2c7e09" (UID: "7f21d9df-114d-4b5f-88d4-a2481e2c7e09"). InnerVolumeSpecName "kube-api-access-xszxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:14:13.774410 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.774319    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54422429-7ed6-44dc-bf71-556457631707-kube-api-access-vts4t" (OuterVolumeSpecName: "kube-api-access-vts4t") pod "54422429-7ed6-44dc-bf71-556457631707" (UID: "54422429-7ed6-44dc-bf71-556457631707"). InnerVolumeSpecName "kube-api-access-vts4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:14:13.804525 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.804498    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:13.811536 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.811517    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:13.818407 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.818388    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"
Sep 15 09:14:13.873793 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.873722    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xszxm\" (UniqueName: \"kubernetes.io/projected/7f21d9df-114d-4b5f-88d4-a2481e2c7e09-kube-api-access-xszxm\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:13.873793 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.873750    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vts4t\" (UniqueName: \"kubernetes.io/projected/54422429-7ed6-44dc-bf71-556457631707-kube-api-access-vts4t\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:13.873793 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:13.873768    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54422429-7ed6-44dc-bf71-556457631707-extensions-socket-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:14.092134 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.092085    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"]
Sep 15 09:14:14.092535 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:14:14.092513    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846cf322_31d2_4fad_a189_8e3966a2855f.slice/crio-000c1b8de8ed3559abc1bfaaf84e925f7fb788c0a3861f9e50ff6802c93e2f2c WatchSource:0}: Error finding container 000c1b8de8ed3559abc1bfaaf84e925f7fb788c0a3861f9e50ff6802c93e2f2c: Status 404 returned error can't find the container with id 000c1b8de8ed3559abc1bfaaf84e925f7fb788c0a3861f9e50ff6802c93e2f2c
Sep 15 09:14:14.104827 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.104796    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"]
Sep 15 09:14:14.114277 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.114255    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"]
Sep 15 09:14:14.114397 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:14:14.114371    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2bc7fd_2df1_438c_a232_5fa2976f90da.slice/crio-eb7b2efdab38a190c06eb30664604b170cb8a38c18ae5334433b2b845d3c4a5f WatchSource:0}: Error finding container eb7b2efdab38a190c06eb30664604b170cb8a38c18ae5334433b2b845d3c4a5f: Status 404 returned error can't find the container with id eb7b2efdab38a190c06eb30664604b170cb8a38c18ae5334433b2b845d3c4a5f
Sep 15 09:14:14.262136 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.262096    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb" event={"ID":"ac2bc7fd-2df1-438c-a232-5fa2976f90da","Type":"ContainerStarted","Data":"d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931"}
Sep 15 09:14:14.262305 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.262169    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb" event={"ID":"ac2bc7fd-2df1-438c-a232-5fa2976f90da","Type":"ContainerStarted","Data":"eb7b2efdab38a190c06eb30664604b170cb8a38c18ae5334433b2b845d3c4a5f"}
Sep 15 09:14:14.262305 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.262217    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:14.264180 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.264156    2555 generic.go:356] "Generic (PLEG): container finished" podID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" containerID="9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9" exitCode=0
Sep 15 09:14:14.264299 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.264216    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:14:14.264299 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.264254    2555 scope.go:117] "RemoveContainer" containerID="9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9"
Sep 15 09:14:14.265084 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:14.265055    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mvjt6\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:14:14.266183 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.266160    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x" event={"ID":"846cf322-31d2-4fad-a189-8e3966a2855f","Type":"ContainerStarted","Data":"e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5"}
Sep 15 09:14:14.266292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.266214    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:14.266292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.266239    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x" event={"ID":"846cf322-31d2-4fad-a189-8e3966a2855f","Type":"ContainerStarted","Data":"000c1b8de8ed3559abc1bfaaf84e925f7fb788c0a3861f9e50ff6802c93e2f2c"}
Sep 15 09:14:14.267987 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.267966    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb" event={"ID":"3c6d0438-a48d-49aa-89e1-6c63de4ccee1","Type":"ContainerStarted","Data":"3d2cfa63918105ec4ee718ea357626dda9db712b7ed18a5cc9c39d64dad10c26"}
Sep 15 09:14:14.268075 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.268005    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb" event={"ID":"3c6d0438-a48d-49aa-89e1-6c63de4ccee1","Type":"ContainerStarted","Data":"138437dc07051260402f8aca1212ddc2670171900f3b28c73431c1c53e5f651f"}
Sep 15 09:14:14.268075 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.268026    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"
Sep 15 09:14:14.269526 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.269507    2555 generic.go:356] "Generic (PLEG): container finished" podID="54422429-7ed6-44dc-bf71-556457631707" containerID="802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc" exitCode=0
Sep 15 09:14:14.269593 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.269563    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:14.273907 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.273888    2555 scope.go:117] "RemoveContainer" containerID="9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9"
Sep 15 09:14:14.274180 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:14.274162    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9\": container with ID starting with 9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9 not found: ID does not exist" containerID="9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9"
Sep 15 09:14:14.274255 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.274187    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9"} err="failed to get container status \"9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9\": rpc error: code = NotFound desc = could not find container \"9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9\": container with ID starting with 9646900f23d0b740eeaab61574dd44981b9290d5dc2926729ee7c7b8c455a6b9 not found: ID does not exist"
Sep 15 09:14:14.274255 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.274203    2555 scope.go:117] "RemoveContainer" containerID="802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc"
Sep 15 09:14:14.283193 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.283171    2555 scope.go:117] "RemoveContainer" containerID="802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc"
Sep 15 09:14:14.283451 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:14.283433    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc\": container with ID starting with 802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc not found: ID does not exist" containerID="802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc"
Sep 15 09:14:14.283516 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.283458    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc"} err="failed to get container status \"802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc\": rpc error: code = NotFound desc = could not find container \"802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc\": container with ID starting with 802cd01fd821f0e1421896faacda5811375c28e0959730e24989066a94f758bc not found: ID does not exist"
Sep 15 09:14:14.320610 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.320557    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb" podStartSLOduration=1.320539071 podStartE2EDuration="1.320539071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:14.319962926 +0000 UTC m=+441.909787274" watchObservedRunningTime="2026-09-15 09:14:14.320539071 +0000 UTC m=+441.910363420"
Sep 15 09:14:14.323237 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:14.323208    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="54422429-7ed6-44dc-bf71-556457631707" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:14.325549 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:14.325529    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mvjt6\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvjt6"
Sep 15 09:14:14.356976 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.356930    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb" podStartSLOduration=1.3569151910000001 podStartE2EDuration="1.356915191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:14.355496311 +0000 UTC m=+441.945320652" watchObservedRunningTime="2026-09-15 09:14:14.356915191 +0000 UTC m=+441.946739540"
Sep 15 09:14:14.376825 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.376724    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x" podStartSLOduration=1.376705239 podStartE2EDuration="1.376705239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:14.374904922 +0000 UTC m=+441.964729269" watchObservedRunningTime="2026-09-15 09:14:14.376705239 +0000 UTC m=+441.966529589"
Sep 15 09:14:14.377282 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:14.377244    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xgjsw\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="54422429-7ed6-44dc-bf71-556457631707" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xgjsw"
Sep 15 09:14:14.955842 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.955808    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54422429-7ed6-44dc-bf71-556457631707" path="/var/lib/kubelet/pods/54422429-7ed6-44dc-bf71-556457631707/volumes"
Sep 15 09:14:14.956188 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:14.956173    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f21d9df-114d-4b5f-88d4-a2481e2c7e09" path="/var/lib/kubelet/pods/7f21d9df-114d-4b5f-88d4-a2481e2c7e09/volumes"
Sep 15 09:14:25.279248 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.279211    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:25.279700 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.279409    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:25.280042 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.280022    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mpwvb"
Sep 15 09:14:25.331607 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.331567    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"]
Sep 15 09:14:25.340204 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.340166    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb" podUID="ac2bc7fd-2df1-438c-a232-5fa2976f90da" containerName="manager" containerID="cri-o://d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931" gracePeriod=10
Sep 15 09:14:25.587620 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.587578    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:25.680046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.680015    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2bc7fd-2df1-438c-a232-5fa2976f90da-extensions-socket-volume\") pod \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\" (UID: \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\") "
Sep 15 09:14:25.680046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.680049    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx77d\" (UniqueName: \"kubernetes.io/projected/ac2bc7fd-2df1-438c-a232-5fa2976f90da-kube-api-access-dx77d\") pod \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\" (UID: \"ac2bc7fd-2df1-438c-a232-5fa2976f90da\") "
Sep 15 09:14:25.680458 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.680435    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2bc7fd-2df1-438c-a232-5fa2976f90da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac2bc7fd-2df1-438c-a232-5fa2976f90da" (UID: "ac2bc7fd-2df1-438c-a232-5fa2976f90da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:14:25.682125 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.682094    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2bc7fd-2df1-438c-a232-5fa2976f90da-kube-api-access-dx77d" (OuterVolumeSpecName: "kube-api-access-dx77d") pod "ac2bc7fd-2df1-438c-a232-5fa2976f90da" (UID: "ac2bc7fd-2df1-438c-a232-5fa2976f90da"). InnerVolumeSpecName "kube-api-access-dx77d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:14:25.704971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.704946    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"]
Sep 15 09:14:25.705342 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.705330    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2bc7fd-2df1-438c-a232-5fa2976f90da" containerName="manager"
Sep 15 09:14:25.705382 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.705343    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2bc7fd-2df1-438c-a232-5fa2976f90da" containerName="manager"
Sep 15 09:14:25.705435 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.705425    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2bc7fd-2df1-438c-a232-5fa2976f90da" containerName="manager"
Sep 15 09:14:25.707485 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.707469    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:25.723686 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.723659    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"]
Sep 15 09:14:25.781429 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.781393    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac2bc7fd-2df1-438c-a232-5fa2976f90da-extensions-socket-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:25.781429 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.781423    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx77d\" (UniqueName: \"kubernetes.io/projected/ac2bc7fd-2df1-438c-a232-5fa2976f90da-kube-api-access-dx77d\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:25.881960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.881838    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xt79l\" (UID: \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:25.882115 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.881967    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mvg2\" (UniqueName: \"kubernetes.io/projected/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-kube-api-access-8mvg2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xt79l\" (UID: \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:25.982697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.982663    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xt79l\" (UID: \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:25.982890 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.982711    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mvg2\" (UniqueName: \"kubernetes.io/projected/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-kube-api-access-8mvg2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xt79l\" (UID: \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:25.983074 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.983052    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xt79l\" (UID: \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:25.994941 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:25.994906    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mvg2\" (UniqueName: \"kubernetes.io/projected/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-kube-api-access-8mvg2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xt79l\" (UID: \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:26.017381 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.017353    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:26.297140 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.297098    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"]
Sep 15 09:14:26.298152 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:14:26.298124    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeaa045b_27a8_48d3_abd5_fc31cbb5ff08.slice/crio-fe691a0208e2795b125a73a80ff0f2db50d54f4a5bc0bd488f1ceec5e2b2c8f1 WatchSource:0}: Error finding container fe691a0208e2795b125a73a80ff0f2db50d54f4a5bc0bd488f1ceec5e2b2c8f1: Status 404 returned error can't find the container with id fe691a0208e2795b125a73a80ff0f2db50d54f4a5bc0bd488f1ceec5e2b2c8f1
Sep 15 09:14:26.348432 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.348402    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l" event={"ID":"deaa045b-27a8-48d3-abd5-fc31cbb5ff08","Type":"ContainerStarted","Data":"fe691a0208e2795b125a73a80ff0f2db50d54f4a5bc0bd488f1ceec5e2b2c8f1"}
Sep 15 09:14:26.349979 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.349955    2555 generic.go:356] "Generic (PLEG): container finished" podID="ac2bc7fd-2df1-438c-a232-5fa2976f90da" containerID="d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931" exitCode=0
Sep 15 09:14:26.350089 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.350002    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"
Sep 15 09:14:26.350089 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.350038    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb" event={"ID":"ac2bc7fd-2df1-438c-a232-5fa2976f90da","Type":"ContainerDied","Data":"d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931"}
Sep 15 09:14:26.350183 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.350088    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb" event={"ID":"ac2bc7fd-2df1-438c-a232-5fa2976f90da","Type":"ContainerDied","Data":"eb7b2efdab38a190c06eb30664604b170cb8a38c18ae5334433b2b845d3c4a5f"}
Sep 15 09:14:26.350183 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.350125    2555 scope.go:117] "RemoveContainer" containerID="d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931"
Sep 15 09:14:26.369981 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.369961    2555 scope.go:117] "RemoveContainer" containerID="d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931"
Sep 15 09:14:26.370266 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:26.370250    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931\": container with ID starting with d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931 not found: ID does not exist" containerID="d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931"
Sep 15 09:14:26.370324 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.370274    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931"} err="failed to get container status \"d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931\": rpc error: code = NotFound desc = could not find container \"d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931\": container with ID starting with d65605bded54b616c18ef7765aabd210ab51832437764d8641b4691dbec6f931 not found: ID does not exist"
Sep 15 09:14:26.384090 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.384069    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"]
Sep 15 09:14:26.400428 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.400404    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-m26kb"]
Sep 15 09:14:26.956077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:26.956043    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2bc7fd-2df1-438c-a232-5fa2976f90da" path="/var/lib/kubelet/pods/ac2bc7fd-2df1-438c-a232-5fa2976f90da/volumes"
Sep 15 09:14:27.358413 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:27.358378    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l" event={"ID":"deaa045b-27a8-48d3-abd5-fc31cbb5ff08","Type":"ContainerStarted","Data":"8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3"}
Sep 15 09:14:27.358826 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:27.358440    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:27.380420 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:27.380376    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l" podStartSLOduration=2.380360913 podStartE2EDuration="2.380360913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:27.378787676 +0000 UTC m=+454.968612023" watchObservedRunningTime="2026-09-15 09:14:27.380360913 +0000 UTC m=+454.970185261"
Sep 15 09:14:38.368714 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.368675    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:14:38.418680 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.418646    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"]
Sep 15 09:14:38.418953 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.418926    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x" podUID="846cf322-31d2-4fad-a189-8e3966a2855f" containerName="manager" containerID="cri-o://e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5" gracePeriod=10
Sep 15 09:14:38.668327 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.668299    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:38.689065 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.689039    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846cf322-31d2-4fad-a189-8e3966a2855f-extensions-socket-volume\") pod \"846cf322-31d2-4fad-a189-8e3966a2855f\" (UID: \"846cf322-31d2-4fad-a189-8e3966a2855f\") "
Sep 15 09:14:38.689199 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.689153    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnhfh\" (UniqueName: \"kubernetes.io/projected/846cf322-31d2-4fad-a189-8e3966a2855f-kube-api-access-tnhfh\") pod \"846cf322-31d2-4fad-a189-8e3966a2855f\" (UID: \"846cf322-31d2-4fad-a189-8e3966a2855f\") "
Sep 15 09:14:38.689460 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.689434    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846cf322-31d2-4fad-a189-8e3966a2855f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "846cf322-31d2-4fad-a189-8e3966a2855f" (UID: "846cf322-31d2-4fad-a189-8e3966a2855f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:14:38.691282 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.691258    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846cf322-31d2-4fad-a189-8e3966a2855f-kube-api-access-tnhfh" (OuterVolumeSpecName: "kube-api-access-tnhfh") pod "846cf322-31d2-4fad-a189-8e3966a2855f" (UID: "846cf322-31d2-4fad-a189-8e3966a2855f"). InnerVolumeSpecName "kube-api-access-tnhfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:14:38.790349 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.790319    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/846cf322-31d2-4fad-a189-8e3966a2855f-extensions-socket-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:38.790349 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:38.790342    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnhfh\" (UniqueName: \"kubernetes.io/projected/846cf322-31d2-4fad-a189-8e3966a2855f-kube-api-access-tnhfh\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:14:39.433174 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:39.433134    2555 generic.go:356] "Generic (PLEG): container finished" podID="846cf322-31d2-4fad-a189-8e3966a2855f" containerID="e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5" exitCode=0
Sep 15 09:14:39.433569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:39.433199    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"
Sep 15 09:14:39.433569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:39.433222    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x" event={"ID":"846cf322-31d2-4fad-a189-8e3966a2855f","Type":"ContainerDied","Data":"e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5"}
Sep 15 09:14:39.433569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:39.433304    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x" event={"ID":"846cf322-31d2-4fad-a189-8e3966a2855f","Type":"ContainerDied","Data":"000c1b8de8ed3559abc1bfaaf84e925f7fb788c0a3861f9e50ff6802c93e2f2c"}
Sep 15 09:14:39.433569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:39.433326    2555 scope.go:117] "RemoveContainer" containerID="e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5"
Sep 15 09:14:39.443009 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:39.442988    2555 scope.go:117] "RemoveContainer" containerID="e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5"
Sep 15 09:14:39.443276 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:14:39.443255    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5\": container with ID starting with e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5 not found: ID does not exist" containerID="e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5"
Sep 15 09:14:39.443335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:39.443283    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5"} err="failed to get container status \"e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5\": rpc error: code = NotFound desc = could not find container \"e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5\": container with ID starting with e84490487b5e68f37ed3fb6a22625d3d9baa81d7dc49170aaa6b6761f6019da5 not found: ID does not exist"
Sep 15 09:14:39.455599 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:39.455577    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"]
Sep 15 09:14:39.459360 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:39.459338    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xjl2x"]
Sep 15 09:14:40.955235 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:40.955194    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="846cf322-31d2-4fad-a189-8e3966a2855f" path="/var/lib/kubelet/pods/846cf322-31d2-4fad-a189-8e3966a2855f/volumes"
Sep 15 09:14:57.413876 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.413813    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-j98kx"]
Sep 15 09:14:57.414440 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.414417    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846cf322-31d2-4fad-a189-8e3966a2855f" containerName="manager"
Sep 15 09:14:57.414525 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.414443    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="846cf322-31d2-4fad-a189-8e3966a2855f" containerName="manager"
Sep 15 09:14:57.414579 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.414554    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="846cf322-31d2-4fad-a189-8e3966a2855f" containerName="manager"
Sep 15 09:14:57.419112 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.419090    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:14:57.422036 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.422003    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 09:14:57.425321 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.425290    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-j98kx"]
Sep 15 09:14:57.509248 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.509214    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-j98kx"]
Sep 15 09:14:57.557127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.557096    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252eac8e-41f0-4e83-9e7c-2fc632ada16e-config-file\") pod \"limitador-limitador-8588749977-j98kx\" (UID: \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\") " pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:14:57.557127 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.557128    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmsgl\" (UniqueName: \"kubernetes.io/projected/252eac8e-41f0-4e83-9e7c-2fc632ada16e-kube-api-access-nmsgl\") pod \"limitador-limitador-8588749977-j98kx\" (UID: \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\") " pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:14:57.658339 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.658296    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252eac8e-41f0-4e83-9e7c-2fc632ada16e-config-file\") pod \"limitador-limitador-8588749977-j98kx\" (UID: \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\") " pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:14:57.658339 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.658339    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmsgl\" (UniqueName: \"kubernetes.io/projected/252eac8e-41f0-4e83-9e7c-2fc632ada16e-kube-api-access-nmsgl\") pod \"limitador-limitador-8588749977-j98kx\" (UID: \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\") " pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:14:57.659077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.659057    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252eac8e-41f0-4e83-9e7c-2fc632ada16e-config-file\") pod \"limitador-limitador-8588749977-j98kx\" (UID: \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\") " pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:14:57.666492 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.666417    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmsgl\" (UniqueName: \"kubernetes.io/projected/252eac8e-41f0-4e83-9e7c-2fc632ada16e-kube-api-access-nmsgl\") pod \"limitador-limitador-8588749977-j98kx\" (UID: \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\") " pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:14:57.730867 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:57.730818    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:14:58.004942 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.004908    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-j98kx"]
Sep 15 09:14:58.006169 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:14:58.006140    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252eac8e_41f0_4e83_9e7c_2fc632ada16e.slice/crio-2f6e3b7d77924cb403c88afd1c6d4ebf2e002277df75773f720e30b66d959724 WatchSource:0}: Error finding container 2f6e3b7d77924cb403c88afd1c6d4ebf2e002277df75773f720e30b66d959724: Status 404 returned error can't find the container with id 2f6e3b7d77924cb403c88afd1c6d4ebf2e002277df75773f720e30b66d959724
Sep 15 09:14:58.203879 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.203831    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bw2x2"]
Sep 15 09:14:58.208591 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.208570    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2"
Sep 15 09:14:58.211334 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.211309    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xk55v\""
Sep 15 09:14:58.214058 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.214032    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bw2x2"]
Sep 15 09:14:58.265116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.265050    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8bd2\" (UniqueName: \"kubernetes.io/projected/0781aac2-3cc2-4ca7-895e-4f0273c8feed-kube-api-access-c8bd2\") pod \"authorino-7bcfd8f9cd-bw2x2\" (UID: \"0781aac2-3cc2-4ca7-895e-4f0273c8feed\") " pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2"
Sep 15 09:14:58.366321 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.366286    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8bd2\" (UniqueName: \"kubernetes.io/projected/0781aac2-3cc2-4ca7-895e-4f0273c8feed-kube-api-access-c8bd2\") pod \"authorino-7bcfd8f9cd-bw2x2\" (UID: \"0781aac2-3cc2-4ca7-895e-4f0273c8feed\") " pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2"
Sep 15 09:14:58.373774 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.373750    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8bd2\" (UniqueName: \"kubernetes.io/projected/0781aac2-3cc2-4ca7-895e-4f0273c8feed-kube-api-access-c8bd2\") pod \"authorino-7bcfd8f9cd-bw2x2\" (UID: \"0781aac2-3cc2-4ca7-895e-4f0273c8feed\") " pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2"
Sep 15 09:14:58.520219 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.520142    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2"
Sep 15 09:14:58.546523 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.546488    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-j98kx" event={"ID":"252eac8e-41f0-4e83-9e7c-2fc632ada16e","Type":"ContainerStarted","Data":"2f6e3b7d77924cb403c88afd1c6d4ebf2e002277df75773f720e30b66d959724"}
Sep 15 09:14:58.791907 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:58.791880    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bw2x2"]
Sep 15 09:14:58.927078 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:14:58.927046    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0781aac2_3cc2_4ca7_895e_4f0273c8feed.slice/crio-62ef0ff7f7c3c36cc6ceb6b6d477982067f348cb3685223c1653ab53e97eb6bf WatchSource:0}: Error finding container 62ef0ff7f7c3c36cc6ceb6b6d477982067f348cb3685223c1653ab53e97eb6bf: Status 404 returned error can't find the container with id 62ef0ff7f7c3c36cc6ceb6b6d477982067f348cb3685223c1653ab53e97eb6bf
Sep 15 09:14:59.555515 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:59.555474    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-j98kx" event={"ID":"252eac8e-41f0-4e83-9e7c-2fc632ada16e","Type":"ContainerStarted","Data":"dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe"}
Sep 15 09:14:59.555975 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:59.555672    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:14:59.556964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:59.556940    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2" event={"ID":"0781aac2-3cc2-4ca7-895e-4f0273c8feed","Type":"ContainerStarted","Data":"62ef0ff7f7c3c36cc6ceb6b6d477982067f348cb3685223c1653ab53e97eb6bf"}
Sep 15 09:14:59.572531 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:14:59.572480    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-j98kx" podStartSLOduration=1.592200818 podStartE2EDuration="2.572462719s" totalImagesPullingTime="980.261901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:59.571278467 +0000 UTC m=+487.161102815" watchObservedRunningTime="2026-09-15 09:14:59.572462719 +0000 UTC m=+487.162287067"
Sep 15 09:15:00.565219 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:00.565186    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2" event={"ID":"0781aac2-3cc2-4ca7-895e-4f0273c8feed","Type":"ContainerStarted","Data":"8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52"}
Sep 15 09:15:00.580483 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:00.580436    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2" podStartSLOduration=1.131148489 podStartE2EDuration="2.580418729s" totalImagesPullingTime="1.44927024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:00.578931842 +0000 UTC m=+488.168756190" watchObservedRunningTime="2026-09-15 09:15:00.580418729 +0000 UTC m=+488.170243081"
Sep 15 09:15:01.392195 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:01.392156    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bw2x2"]
Sep 15 09:15:02.579714 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:02.579673    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2" podUID="0781aac2-3cc2-4ca7-895e-4f0273c8feed" containerName="authorino" containerID="cri-o://8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52" gracePeriod=30
Sep 15 09:15:02.832163 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:02.832105    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2"
Sep 15 09:15:02.910537 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:02.910505    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8bd2\" (UniqueName: \"kubernetes.io/projected/0781aac2-3cc2-4ca7-895e-4f0273c8feed-kube-api-access-c8bd2\") pod \"0781aac2-3cc2-4ca7-895e-4f0273c8feed\" (UID: \"0781aac2-3cc2-4ca7-895e-4f0273c8feed\") "
Sep 15 09:15:02.912599 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:02.912560    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0781aac2-3cc2-4ca7-895e-4f0273c8feed-kube-api-access-c8bd2" (OuterVolumeSpecName: "kube-api-access-c8bd2") pod "0781aac2-3cc2-4ca7-895e-4f0273c8feed" (UID: "0781aac2-3cc2-4ca7-895e-4f0273c8feed"). InnerVolumeSpecName "kube-api-access-c8bd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:15:03.012003 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.011966    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8bd2\" (UniqueName: \"kubernetes.io/projected/0781aac2-3cc2-4ca7-895e-4f0273c8feed-kube-api-access-c8bd2\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:15:03.586640 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.586606    2555 generic.go:356] "Generic (PLEG): container finished" podID="0781aac2-3cc2-4ca7-895e-4f0273c8feed" containerID="8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52" exitCode=0
Sep 15 09:15:03.587137 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.586647    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2"
Sep 15 09:15:03.587137 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.586692    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2" event={"ID":"0781aac2-3cc2-4ca7-895e-4f0273c8feed","Type":"ContainerDied","Data":"8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52"}
Sep 15 09:15:03.587137 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.586734    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bw2x2" event={"ID":"0781aac2-3cc2-4ca7-895e-4f0273c8feed","Type":"ContainerDied","Data":"62ef0ff7f7c3c36cc6ceb6b6d477982067f348cb3685223c1653ab53e97eb6bf"}
Sep 15 09:15:03.587137 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.586755    2555 scope.go:117] "RemoveContainer" containerID="8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52"
Sep 15 09:15:03.595490 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.595468    2555 scope.go:117] "RemoveContainer" containerID="8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52"
Sep 15 09:15:03.595809 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:15:03.595789    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52\": container with ID starting with 8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52 not found: ID does not exist" containerID="8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52"
Sep 15 09:15:03.595895 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.595817    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52"} err="failed to get container status \"8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52\": rpc error: code = NotFound desc = could not find container \"8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52\": container with ID starting with 8b544340ca2b3535e0a645fe62b4b8169ebf1ad3a5f29f8cdd087a861e5b6b52 not found: ID does not exist"
Sep 15 09:15:03.602785 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.602759    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bw2x2"]
Sep 15 09:15:03.605860 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:03.605828    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bw2x2"]
Sep 15 09:15:04.955605 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:04.955571    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0781aac2-3cc2-4ca7-895e-4f0273c8feed" path="/var/lib/kubelet/pods/0781aac2-3cc2-4ca7-895e-4f0273c8feed/volumes"
Sep 15 09:15:10.394711 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:10.394674    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-j98kx"]
Sep 15 09:15:10.395254 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:10.394906    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-j98kx" podUID="252eac8e-41f0-4e83-9e7c-2fc632ada16e" containerName="limitador" containerID="cri-o://dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe" gracePeriod=30
Sep 15 09:15:10.395631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:10.395599    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:15:10.945436 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:10.945410    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:15:11.090735 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.090695    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252eac8e-41f0-4e83-9e7c-2fc632ada16e-config-file\") pod \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\" (UID: \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\") "
Sep 15 09:15:11.090944 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.090835    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmsgl\" (UniqueName: \"kubernetes.io/projected/252eac8e-41f0-4e83-9e7c-2fc632ada16e-kube-api-access-nmsgl\") pod \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\" (UID: \"252eac8e-41f0-4e83-9e7c-2fc632ada16e\") "
Sep 15 09:15:11.091173 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.091152    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252eac8e-41f0-4e83-9e7c-2fc632ada16e-config-file" (OuterVolumeSpecName: "config-file") pod "252eac8e-41f0-4e83-9e7c-2fc632ada16e" (UID: "252eac8e-41f0-4e83-9e7c-2fc632ada16e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:15:11.092817 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.092789    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252eac8e-41f0-4e83-9e7c-2fc632ada16e-kube-api-access-nmsgl" (OuterVolumeSpecName: "kube-api-access-nmsgl") pod "252eac8e-41f0-4e83-9e7c-2fc632ada16e" (UID: "252eac8e-41f0-4e83-9e7c-2fc632ada16e"). InnerVolumeSpecName "kube-api-access-nmsgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:15:11.191684 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.191653    2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252eac8e-41f0-4e83-9e7c-2fc632ada16e-config-file\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:15:11.191684 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.191681    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmsgl\" (UniqueName: \"kubernetes.io/projected/252eac8e-41f0-4e83-9e7c-2fc632ada16e-kube-api-access-nmsgl\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:15:11.633497 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.633461    2555 generic.go:356] "Generic (PLEG): container finished" podID="252eac8e-41f0-4e83-9e7c-2fc632ada16e" containerID="dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe" exitCode=0
Sep 15 09:15:11.633956 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.633506    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-j98kx"
Sep 15 09:15:11.633956 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.633544    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-j98kx" event={"ID":"252eac8e-41f0-4e83-9e7c-2fc632ada16e","Type":"ContainerDied","Data":"dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe"}
Sep 15 09:15:11.633956 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.633595    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-j98kx" event={"ID":"252eac8e-41f0-4e83-9e7c-2fc632ada16e","Type":"ContainerDied","Data":"2f6e3b7d77924cb403c88afd1c6d4ebf2e002277df75773f720e30b66d959724"}
Sep 15 09:15:11.633956 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.633622    2555 scope.go:117] "RemoveContainer" containerID="dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe"
Sep 15 09:15:11.643424 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.643406    2555 scope.go:117] "RemoveContainer" containerID="dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe"
Sep 15 09:15:11.643690 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:15:11.643674    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe\": container with ID starting with dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe not found: ID does not exist" containerID="dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe"
Sep 15 09:15:11.643729 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.643700    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe"} err="failed to get container status \"dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe\": rpc error: code = NotFound desc = could not find container \"dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe\": container with ID starting with dfacb27cf4a81481c4f214fe6e33398edc55207842ac74c3b39d22ed4aedaebe not found: ID does not exist"
Sep 15 09:15:11.655818 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.655796    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-j98kx"]
Sep 15 09:15:11.660912 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:11.660880    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-j98kx"]
Sep 15 09:15:12.954124 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:12.954089    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252eac8e-41f0-4e83-9e7c-2fc632ada16e" path="/var/lib/kubelet/pods/252eac8e-41f0-4e83-9e7c-2fc632ada16e/volumes"
Sep 15 09:15:13.175365 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.175334    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"]
Sep 15 09:15:13.175745 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.175730    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0781aac2-3cc2-4ca7-895e-4f0273c8feed" containerName="authorino"
Sep 15 09:15:13.175815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.175746    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0781aac2-3cc2-4ca7-895e-4f0273c8feed" containerName="authorino"
Sep 15 09:15:13.175815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.175764    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252eac8e-41f0-4e83-9e7c-2fc632ada16e" containerName="limitador"
Sep 15 09:15:13.175815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.175770    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="252eac8e-41f0-4e83-9e7c-2fc632ada16e" containerName="limitador"
Sep 15 09:15:13.176003 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.175834    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="252eac8e-41f0-4e83-9e7c-2fc632ada16e" containerName="limitador"
Sep 15 09:15:13.176003 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.175857    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0781aac2-3cc2-4ca7-895e-4f0273c8feed" containerName="authorino"
Sep 15 09:15:13.180221 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.180201    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:13.183808 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.183788    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dnmk5\""
Sep 15 09:15:13.183947 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.183788    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:15:13.184883 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.184863    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 09:15:13.186406 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.186387    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 15 09:15:13.200621 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.200600    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"]
Sep 15 09:15:13.310624 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.310586    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a966c6b-ef7d-4df0-8733-775f01e187ed-data\") pod \"postgres-69fb4594cf-k2hbq\" (UID: \"5a966c6b-ef7d-4df0-8733-775f01e187ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:13.310796 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.310714    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfgkc\" (UniqueName: \"kubernetes.io/projected/5a966c6b-ef7d-4df0-8733-775f01e187ed-kube-api-access-rfgkc\") pod \"postgres-69fb4594cf-k2hbq\" (UID: \"5a966c6b-ef7d-4df0-8733-775f01e187ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:13.411586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.411552    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfgkc\" (UniqueName: \"kubernetes.io/projected/5a966c6b-ef7d-4df0-8733-775f01e187ed-kube-api-access-rfgkc\") pod \"postgres-69fb4594cf-k2hbq\" (UID: \"5a966c6b-ef7d-4df0-8733-775f01e187ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:13.411730 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.411614    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a966c6b-ef7d-4df0-8733-775f01e187ed-data\") pod \"postgres-69fb4594cf-k2hbq\" (UID: \"5a966c6b-ef7d-4df0-8733-775f01e187ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:13.411980 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.411961    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a966c6b-ef7d-4df0-8733-775f01e187ed-data\") pod \"postgres-69fb4594cf-k2hbq\" (UID: \"5a966c6b-ef7d-4df0-8733-775f01e187ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:13.419351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.419329    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfgkc\" (UniqueName: \"kubernetes.io/projected/5a966c6b-ef7d-4df0-8733-775f01e187ed-kube-api-access-rfgkc\") pod \"postgres-69fb4594cf-k2hbq\" (UID: \"5a966c6b-ef7d-4df0-8733-775f01e187ed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:13.492428 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.492402    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:13.768712 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:13.762949    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"]
Sep 15 09:15:13.770586 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:15:13.770557    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a966c6b_ef7d_4df0_8733_775f01e187ed.slice/crio-f9a830bc77455da86885503a40f5195446372f63cb97c4975cb8303561c35a43 WatchSource:0}: Error finding container f9a830bc77455da86885503a40f5195446372f63cb97c4975cb8303561c35a43: Status 404 returned error can't find the container with id f9a830bc77455da86885503a40f5195446372f63cb97c4975cb8303561c35a43
Sep 15 09:15:14.654328 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:14.654288    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq" event={"ID":"5a966c6b-ef7d-4df0-8733-775f01e187ed","Type":"ContainerStarted","Data":"f9a830bc77455da86885503a40f5195446372f63cb97c4975cb8303561c35a43"}
Sep 15 09:15:16.671661 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:16.671626    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq" event={"ID":"5a966c6b-ef7d-4df0-8733-775f01e187ed","Type":"ContainerStarted","Data":"2a0836fa9e207f93d36889e60e4627f534ad072cb32a78007f27071a9bf7d6c5"}
Sep 15 09:15:16.672067 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:16.671739    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:16.690606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:16.690550    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq" podStartSLOduration=1.504601638 podStartE2EDuration="3.69053093s" totalImagesPullingTime="2.185929292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:16.686871107 +0000 UTC m=+504.276695450" watchObservedRunningTime="2026-09-15 09:15:16.69053093 +0000 UTC m=+504.280355278"
Sep 15 09:15:22.708447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:22.708416    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k2hbq"
Sep 15 09:15:30.258677 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.258638    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68f477c8c4-dzpd4"]
Sep 15 09:15:30.267209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.267183    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.269857 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.269826    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 09:15:30.270000 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.269903    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tsfjp\""
Sep 15 09:15:30.270000 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.269944    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 09:15:30.271002 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.270982    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 09:15:30.276260 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.276233    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68f477c8c4-dzpd4"]
Sep 15 09:15:30.356717 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.356689    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-webhook-cert\") pod \"maas-controller-68f477c8c4-dzpd4\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") " pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.356932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.356769    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2224g\" (UniqueName: \"kubernetes.io/projected/7ba30679-5668-4bb4-b05a-47743014c2d6-kube-api-access-2224g\") pod \"maas-controller-68f477c8c4-dzpd4\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") " pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.356932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.356807    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-metrics-certs\") pod \"maas-controller-68f477c8c4-dzpd4\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") " pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.457590 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.457553    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-webhook-cert\") pod \"maas-controller-68f477c8c4-dzpd4\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") " pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.457771 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.457599    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2224g\" (UniqueName: \"kubernetes.io/projected/7ba30679-5668-4bb4-b05a-47743014c2d6-kube-api-access-2224g\") pod \"maas-controller-68f477c8c4-dzpd4\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") " pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.457771 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.457716    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-metrics-certs\") pod \"maas-controller-68f477c8c4-dzpd4\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") " pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.460111 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.460087    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-webhook-cert\") pod \"maas-controller-68f477c8c4-dzpd4\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") " pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.460236 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.460133    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-metrics-certs\") pod \"maas-controller-68f477c8c4-dzpd4\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") " pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.465319 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.465288    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2224g\" (UniqueName: \"kubernetes.io/projected/7ba30679-5668-4bb4-b05a-47743014c2d6-kube-api-access-2224g\") pod \"maas-controller-68f477c8c4-dzpd4\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") " pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.579153 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.579062    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:30.851474 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:30.851442    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68f477c8c4-dzpd4"]
Sep 15 09:15:30.853042 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:15:30.853018    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba30679_5668_4bb4_b05a_47743014c2d6.slice/crio-ee99d7b62740baa16b73f0e0f4677a6a3c409fcfc712d9d3774984d2b2891acd WatchSource:0}: Error finding container ee99d7b62740baa16b73f0e0f4677a6a3c409fcfc712d9d3774984d2b2891acd: Status 404 returned error can't find the container with id ee99d7b62740baa16b73f0e0f4677a6a3c409fcfc712d9d3774984d2b2891acd
Sep 15 09:15:31.765907 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:31.765842    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f477c8c4-dzpd4" event={"ID":"7ba30679-5668-4bb4-b05a-47743014c2d6","Type":"ContainerStarted","Data":"ee99d7b62740baa16b73f0e0f4677a6a3c409fcfc712d9d3774984d2b2891acd"}
Sep 15 09:15:33.781831 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:33.781796    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f477c8c4-dzpd4" event={"ID":"7ba30679-5668-4bb4-b05a-47743014c2d6","Type":"ContainerStarted","Data":"32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020"}
Sep 15 09:15:33.782239 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:33.781885    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:33.804730 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:33.804674    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68f477c8c4-dzpd4" podStartSLOduration=1.316644508 podStartE2EDuration="3.80465184s" totalImagesPullingTime="2.488007332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:33.801963924 +0000 UTC m=+521.391788271" watchObservedRunningTime="2026-09-15 09:15:33.80465184 +0000 UTC m=+521.394476189"
Sep 15 09:15:44.766456 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:44.766415    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68f477c8c4-dzpd4"]
Sep 15 09:15:44.766917 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:44.766665    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68f477c8c4-dzpd4" podUID="7ba30679-5668-4bb4-b05a-47743014c2d6" containerName="manager" containerID="cri-o://32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020" gracePeriod=30
Sep 15 09:15:44.768623 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:44.768599    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:45.027200 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.027142    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:45.087632 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.087599    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-metrics-certs\") pod \"7ba30679-5668-4bb4-b05a-47743014c2d6\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") "
Sep 15 09:15:45.087792 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.087659    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2224g\" (UniqueName: \"kubernetes.io/projected/7ba30679-5668-4bb4-b05a-47743014c2d6-kube-api-access-2224g\") pod \"7ba30679-5668-4bb4-b05a-47743014c2d6\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") "
Sep 15 09:15:45.087792 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.087778    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-webhook-cert\") pod \"7ba30679-5668-4bb4-b05a-47743014c2d6\" (UID: \"7ba30679-5668-4bb4-b05a-47743014c2d6\") "
Sep 15 09:15:45.089895 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.089842    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba30679-5668-4bb4-b05a-47743014c2d6-kube-api-access-2224g" (OuterVolumeSpecName: "kube-api-access-2224g") pod "7ba30679-5668-4bb4-b05a-47743014c2d6" (UID: "7ba30679-5668-4bb4-b05a-47743014c2d6"). InnerVolumeSpecName "kube-api-access-2224g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:15:45.089997 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.089915    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7ba30679-5668-4bb4-b05a-47743014c2d6" (UID: "7ba30679-5668-4bb4-b05a-47743014c2d6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:15:45.089997 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.089938    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7ba30679-5668-4bb4-b05a-47743014c2d6" (UID: "7ba30679-5668-4bb4-b05a-47743014c2d6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:15:45.188674 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.188638    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:15:45.188674 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.188671    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2224g\" (UniqueName: \"kubernetes.io/projected/7ba30679-5668-4bb4-b05a-47743014c2d6-kube-api-access-2224g\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:15:45.188674 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.188682    2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ba30679-5668-4bb4-b05a-47743014c2d6-webhook-cert\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:15:45.851402 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.851371    2555 generic.go:356] "Generic (PLEG): container finished" podID="7ba30679-5668-4bb4-b05a-47743014c2d6" containerID="32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020" exitCode=0
Sep 15 09:15:45.851796 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.851416    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68f477c8c4-dzpd4"
Sep 15 09:15:45.851796 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.851460    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f477c8c4-dzpd4" event={"ID":"7ba30679-5668-4bb4-b05a-47743014c2d6","Type":"ContainerDied","Data":"32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020"}
Sep 15 09:15:45.851796 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.851517    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68f477c8c4-dzpd4" event={"ID":"7ba30679-5668-4bb4-b05a-47743014c2d6","Type":"ContainerDied","Data":"ee99d7b62740baa16b73f0e0f4677a6a3c409fcfc712d9d3774984d2b2891acd"}
Sep 15 09:15:45.851796 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.851544    2555 scope.go:117] "RemoveContainer" containerID="32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020"
Sep 15 09:15:45.861064 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.861042    2555 scope.go:117] "RemoveContainer" containerID="32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020"
Sep 15 09:15:45.861377 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:15:45.861358    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020\": container with ID starting with 32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020 not found: ID does not exist" containerID="32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020"
Sep 15 09:15:45.861446 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.861384    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020"} err="failed to get container status \"32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020\": rpc error: code = NotFound desc = could not find container \"32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020\": container with ID starting with 32691eaf008f1138a43786c43a515b950fa8b4c7416199786f0db7a8f8b1c020 not found: ID does not exist"
Sep 15 09:15:45.873692 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.873665    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68f477c8c4-dzpd4"]
Sep 15 09:15:45.876017 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:45.875981    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68f477c8c4-dzpd4"]
Sep 15 09:15:46.954133 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:15:46.954098    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba30679-5668-4bb4-b05a-47743014c2d6" path="/var/lib/kubelet/pods/7ba30679-5668-4bb4-b05a-47743014c2d6/volumes"
Sep 15 09:16:05.032411 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.032373    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"]
Sep 15 09:16:05.032941 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.032781    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba30679-5668-4bb4-b05a-47743014c2d6" containerName="manager"
Sep 15 09:16:05.032941 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.032793    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba30679-5668-4bb4-b05a-47743014c2d6" containerName="manager"
Sep 15 09:16:05.032941 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.032872    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba30679-5668-4bb4-b05a-47743014c2d6" containerName="manager"
Sep 15 09:16:05.037236 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.037218    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.039805 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.039780    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 09:16:05.040697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.040679    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 09:16:05.040826 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.040696    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ptrgq\""
Sep 15 09:16:05.046146 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.046119    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"]
Sep 15 09:16:05.169807 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.169766    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-maas-api-tls\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.169995 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.169825    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-metrics-certs\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.169995 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.169925    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp6vv\" (UniqueName: \"kubernetes.io/projected/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-kube-api-access-rp6vv\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.169995 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.169969    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-openshift-service-ca\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.270913 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.270840    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp6vv\" (UniqueName: \"kubernetes.io/projected/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-kube-api-access-rp6vv\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.271077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.270933    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-openshift-service-ca\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.271077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.271026    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-maas-api-tls\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.271191 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.271089    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-metrics-certs\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.271248 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:16:05.271186    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 15 09:16:05.271305 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:16:05.271274    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-maas-api-tls podName:ec7160ef-cd8e-42d2-9f99-f7a16c56229d nodeName:}" failed. No retries permitted until 2026-09-15 09:16:05.771251297 +0000 UTC m=+553.361075632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-maas-api-tls") pod "maas-api-f4884bd-s9zdp" (UID: "ec7160ef-cd8e-42d2-9f99-f7a16c56229d") : secret "maas-api-serving-cert" not found
Sep 15 09:16:05.271579 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.271557    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-openshift-service-ca\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.273568 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.273548    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-metrics-certs\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.279438 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.279410    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp6vv\" (UniqueName: \"kubernetes.io/projected/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-kube-api-access-rp6vv\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.503785 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.503750    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"]
Sep 15 09:16:05.507364 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.507342    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:05.509711 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.509689    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 09:16:05.509828 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.509795    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vblgr\""
Sep 15 09:16:05.515899 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.515876    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"]
Sep 15 09:16:05.674770 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.674729    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ddb13bf-48e5-4157-ab97-9a62b9465a4a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-gqczn\" (UID: \"5ddb13bf-48e5-4157-ab97-9a62b9465a4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:05.674993 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.674879    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj8df\" (UniqueName: \"kubernetes.io/projected/5ddb13bf-48e5-4157-ab97-9a62b9465a4a-kube-api-access-hj8df\") pod \"payload-pre-processing-59fbc47bf8-gqczn\" (UID: \"5ddb13bf-48e5-4157-ab97-9a62b9465a4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:05.775466 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.775382    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ddb13bf-48e5-4157-ab97-9a62b9465a4a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-gqczn\" (UID: \"5ddb13bf-48e5-4157-ab97-9a62b9465a4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:05.775635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.775462    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-maas-api-tls\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.775635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.775496    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj8df\" (UniqueName: \"kubernetes.io/projected/5ddb13bf-48e5-4157-ab97-9a62b9465a4a-kube-api-access-hj8df\") pod \"payload-pre-processing-59fbc47bf8-gqczn\" (UID: \"5ddb13bf-48e5-4157-ab97-9a62b9465a4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:05.776308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.776281    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ddb13bf-48e5-4157-ab97-9a62b9465a4a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-gqczn\" (UID: \"5ddb13bf-48e5-4157-ab97-9a62b9465a4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:05.778141 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.778111    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-maas-api-tls\") pod \"maas-api-f4884bd-s9zdp\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") " pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:05.786476 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.786456    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj8df\" (UniqueName: \"kubernetes.io/projected/5ddb13bf-48e5-4157-ab97-9a62b9465a4a-kube-api-access-hj8df\") pod \"payload-pre-processing-59fbc47bf8-gqczn\" (UID: \"5ddb13bf-48e5-4157-ab97-9a62b9465a4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:05.820054 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.820034    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:05.949307 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:05.949275    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:06.091061 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:06.091035    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"]
Sep 15 09:16:06.092321 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:16:06.092296    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ddb13bf_48e5_4157_ab97_9a62b9465a4a.slice/crio-9ce296c906b5ea0eebe8b9e4ed8c916cc1420f244df5f3bb9d5cbadfbb658da7 WatchSource:0}: Error finding container 9ce296c906b5ea0eebe8b9e4ed8c916cc1420f244df5f3bb9d5cbadfbb658da7: Status 404 returned error can't find the container with id 9ce296c906b5ea0eebe8b9e4ed8c916cc1420f244df5f3bb9d5cbadfbb658da7
Sep 15 09:16:06.229086 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:06.229060    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"]
Sep 15 09:16:06.230195 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:16:06.230167    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7160ef_cd8e_42d2_9f99_f7a16c56229d.slice/crio-0be10a4080293786a7a1e68f2c954a157c286d6602c08b69cf6a01864a219c67 WatchSource:0}: Error finding container 0be10a4080293786a7a1e68f2c954a157c286d6602c08b69cf6a01864a219c67: Status 404 returned error can't find the container with id 0be10a4080293786a7a1e68f2c954a157c286d6602c08b69cf6a01864a219c67
Sep 15 09:16:06.981156 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:06.981079    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp" event={"ID":"ec7160ef-cd8e-42d2-9f99-f7a16c56229d","Type":"ContainerStarted","Data":"0be10a4080293786a7a1e68f2c954a157c286d6602c08b69cf6a01864a219c67"}
Sep 15 09:16:06.982818 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:06.982788    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn" event={"ID":"5ddb13bf-48e5-4157-ab97-9a62b9465a4a","Type":"ContainerStarted","Data":"9ce296c906b5ea0eebe8b9e4ed8c916cc1420f244df5f3bb9d5cbadfbb658da7"}
Sep 15 09:16:07.992485 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:07.992443    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn" event={"ID":"5ddb13bf-48e5-4157-ab97-9a62b9465a4a","Type":"ContainerStarted","Data":"065f7dc7543c8dbafd28502987f6213489152f24a11834001e79488ed70b0e0b"}
Sep 15 09:16:07.992960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:07.992542    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:08.008970 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:08.008913    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn" podStartSLOduration=1.723372396 podStartE2EDuration="3.008896717s" totalImagesPullingTime="1.285524321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:08.008363428 +0000 UTC m=+555.598187770" watchObservedRunningTime="2026-09-15 09:16:08.008896717 +0000 UTC m=+555.598721068"
Sep 15 09:16:09.000246 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:09.000215    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp" event={"ID":"ec7160ef-cd8e-42d2-9f99-f7a16c56229d","Type":"ContainerStarted","Data":"3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d"}
Sep 15 09:16:09.000685 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:09.000296    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:09.019160 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:09.019100    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp" podStartSLOduration=2.072959123 podStartE2EDuration="4.019084215s" totalImagesPullingTime="1.946125092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:09.016621294 +0000 UTC m=+556.606445643" watchObservedRunningTime="2026-09-15 09:16:09.019084215 +0000 UTC m=+556.608908562"
Sep 15 09:16:15.012807 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:15.012778    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:16:19.002793 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:19.002763    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn"
Sep 15 09:16:34.413744 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.413708    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"]
Sep 15 09:16:34.417580 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.417561    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.421406 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.421387    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c6slb\""
Sep 15 09:16:34.421510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.421406    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 09:16:34.421510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.421407    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 15 09:16:34.421510 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.421437    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 09:16:34.427412 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.427388    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"]
Sep 15 09:16:34.543244 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.543209    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.543411 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.543273    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.543411 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.543324    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28h2f\" (UniqueName: \"kubernetes.io/projected/8b773126-9a7a-44a2-bf75-df877f87a1a5-kube-api-access-28h2f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.543411 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.543384    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b773126-9a7a-44a2-bf75-df877f87a1a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.543533 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.543431    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.543533 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.543466    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.644125 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.644093    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b773126-9a7a-44a2-bf75-df877f87a1a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.644304 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.644135    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.644304 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.644177    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.644304 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.644202    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.644304 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.644268    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.644304 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.644291    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28h2f\" (UniqueName: \"kubernetes.io/projected/8b773126-9a7a-44a2-bf75-df877f87a1a5-kube-api-access-28h2f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.644655 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.644635    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.644725 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.644686    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.644725 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.644686    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.646423 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.646404    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b773126-9a7a-44a2-bf75-df877f87a1a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.646629 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.646609    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b773126-9a7a-44a2-bf75-df877f87a1a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.653504 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.653480    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28h2f\" (UniqueName: \"kubernetes.io/projected/8b773126-9a7a-44a2-bf75-df877f87a1a5-kube-api-access-28h2f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh\" (UID: \"8b773126-9a7a-44a2-bf75-df877f87a1a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:34.728512 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:34.728481    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:35.007906 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:35.007878    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"]
Sep 15 09:16:35.009367 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:16:35.009337    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b773126_9a7a_44a2_bf75_df877f87a1a5.slice/crio-bfdfefabc88bc95d9caa9d60b9f4fe4f453cf6087c1418a6f8f477f5753ed460 WatchSource:0}: Error finding container bfdfefabc88bc95d9caa9d60b9f4fe4f453cf6087c1418a6f8f477f5753ed460: Status 404 returned error can't find the container with id bfdfefabc88bc95d9caa9d60b9f4fe4f453cf6087c1418a6f8f477f5753ed460
Sep 15 09:16:35.158804 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:35.158766    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh" event={"ID":"8b773126-9a7a-44a2-bf75-df877f87a1a5","Type":"ContainerStarted","Data":"bfdfefabc88bc95d9caa9d60b9f4fe4f453cf6087c1418a6f8f477f5753ed460"}
Sep 15 09:16:36.166118 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:36.166085    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh" event={"ID":"8b773126-9a7a-44a2-bf75-df877f87a1a5","Type":"ContainerStarted","Data":"a8ccbfb01bd9af91e8d367a4b1ed20b0eb95ced066e4588691bb7898d13ba006"}
Sep 15 09:16:36.183283 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:36.183237    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh" podStartSLOduration=1.161957492 podStartE2EDuration="2.183222469s" totalImagesPullingTime="1.021264977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:36.182165571 +0000 UTC m=+583.771989919" watchObservedRunningTime="2026-09-15 09:16:36.183222469 +0000 UTC m=+583.773046817"
Sep 15 09:16:44.728973 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:44.728932    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:44.729450 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:44.729023    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:44.741207 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:44.741181    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:45.231432 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:45.231401    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh"
Sep 15 09:16:58.201791 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.201751    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"]
Sep 15 09:16:58.205401 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.205379    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.208180 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.208160    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 15 09:16:58.215026 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.214996    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"]
Sep 15 09:16:58.253894 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.253868    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.254047 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.253900    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.254047 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.253918    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9fj6\" (UniqueName: \"kubernetes.io/projected/bab1112e-bd2c-4f8b-874b-1483edcf94e0-kube-api-access-w9fj6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.254047 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.253939    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.254239 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.254051    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.254239 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.254148    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab1112e-bd2c-4f8b-874b-1483edcf94e0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.355403 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.355362    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.355403 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.355402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.355609 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.355419    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9fj6\" (UniqueName: \"kubernetes.io/projected/bab1112e-bd2c-4f8b-874b-1483edcf94e0-kube-api-access-w9fj6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.355609 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.355551    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.355698 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.355605    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.355763 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.355729    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab1112e-bd2c-4f8b-874b-1483edcf94e0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.355887 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.355832    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.356003 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.355960    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.356091 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.356059    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.357748 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.357719    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab1112e-bd2c-4f8b-874b-1483edcf94e0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.358156 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.358127    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab1112e-bd2c-4f8b-874b-1483edcf94e0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.362769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.362746    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9fj6\" (UniqueName: \"kubernetes.io/projected/bab1112e-bd2c-4f8b-874b-1483edcf94e0-kube-api-access-w9fj6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4\" (UID: \"bab1112e-bd2c-4f8b-874b-1483edcf94e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.519165 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.519125    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:16:58.793681 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.793635    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"]
Sep 15 09:16:58.794982 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:16:58.794954    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab1112e_bd2c_4f8b_874b_1483edcf94e0.slice/crio-0f2be4392ec6d74b51f697a3f7150c53026e9461f9e797385510f84f21ee5869 WatchSource:0}: Error finding container 0f2be4392ec6d74b51f697a3f7150c53026e9461f9e797385510f84f21ee5869: Status 404 returned error can't find the container with id 0f2be4392ec6d74b51f697a3f7150c53026e9461f9e797385510f84f21ee5869
Sep 15 09:16:58.796470 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:58.796449    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:16:59.304998 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:59.304894    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4" event={"ID":"bab1112e-bd2c-4f8b-874b-1483edcf94e0","Type":"ContainerStarted","Data":"c0c69ae6e034ccd883147f5a75013b91a5852b292a8cae11a6bf6056cd0519c1"}
Sep 15 09:16:59.304998 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:59.304966    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4" event={"ID":"bab1112e-bd2c-4f8b-874b-1483edcf94e0","Type":"ContainerStarted","Data":"0f2be4392ec6d74b51f697a3f7150c53026e9461f9e797385510f84f21ee5869"}
Sep 15 09:16:59.325469 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:16:59.325415    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4" podStartSLOduration=1.092232634 podStartE2EDuration="1.325399538s" totalImagesPullingTime="233.166904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:59.322234469 +0000 UTC m=+606.912058816" watchObservedRunningTime="2026-09-15 09:16:59.325399538 +0000 UTC m=+606.915223887"
Sep 15 09:17:08.519456 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:08.519415    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:17:08.519949 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:08.519476    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:17:08.532227 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:08.532193    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:17:09.373171 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:09.373141    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4"
Sep 15 09:17:26.905025 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:26.904987    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"]
Sep 15 09:17:26.909275 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:26.909252    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:26.911746 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:26.911725    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 15 09:17:26.920628 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:26.920599    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"]
Sep 15 09:17:27.019558 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.019526    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f06d0df0-d958-44b8-9c50-0fc969da5e22-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.019723 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.019630    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.019723 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.019659    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.019804 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.019726    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.019804 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.019758    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkhwg\" (UniqueName: \"kubernetes.io/projected/f06d0df0-d958-44b8-9c50-0fc969da5e22-kube-api-access-bkhwg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.019885 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.019826    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.120440 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.120399    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.120440 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.120445    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkhwg\" (UniqueName: \"kubernetes.io/projected/f06d0df0-d958-44b8-9c50-0fc969da5e22-kube-api-access-bkhwg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.120659 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.120636    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.120717 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.120675    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f06d0df0-d958-44b8-9c50-0fc969da5e22-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.120812 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.120786    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.120904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.120815    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.120904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.120838    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.121517 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.121485    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.122215 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.122187    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.130737 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.129762    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkhwg\" (UniqueName: \"kubernetes.io/projected/f06d0df0-d958-44b8-9c50-0fc969da5e22-kube-api-access-bkhwg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.131250 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.131219    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f06d0df0-d958-44b8-9c50-0fc969da5e22-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.132194 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.132174    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f06d0df0-d958-44b8-9c50-0fc969da5e22-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh\" (UID: \"f06d0df0-d958-44b8-9c50-0fc969da5e22\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.222449 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.222405    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:27.494992 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:27.494963    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"]
Sep 15 09:17:27.496097 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:17:27.496072    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06d0df0_d958_44b8_9c50_0fc969da5e22.slice/crio-99a1f7c5607cbc2cad0cb673268d0f2ee63aece76dc95f09563cc8e524c2e0e2 WatchSource:0}: Error finding container 99a1f7c5607cbc2cad0cb673268d0f2ee63aece76dc95f09563cc8e524c2e0e2: Status 404 returned error can't find the container with id 99a1f7c5607cbc2cad0cb673268d0f2ee63aece76dc95f09563cc8e524c2e0e2
Sep 15 09:17:28.476427 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:28.476394    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh" event={"ID":"f06d0df0-d958-44b8-9c50-0fc969da5e22","Type":"ContainerStarted","Data":"947ba4eb505b34e33ef91da1ad18cc5a49b3ae5f61b3a10094960555fed2e052"}
Sep 15 09:17:28.476788 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:28.476446    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh" event={"ID":"f06d0df0-d958-44b8-9c50-0fc969da5e22","Type":"ContainerStarted","Data":"99a1f7c5607cbc2cad0cb673268d0f2ee63aece76dc95f09563cc8e524c2e0e2"}
Sep 15 09:17:28.497508 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:28.497454    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh" podStartSLOduration=2.298618608 podStartE2EDuration="2.497438598s" totalImagesPullingTime="198.81999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:28.494800348 +0000 UTC m=+636.084624734" watchObservedRunningTime="2026-09-15 09:17:28.497438598 +0000 UTC m=+636.087262993"
Sep 15 09:17:37.223100 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:37.223066    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:37.223504 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:37.223359    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:37.235696 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:37.235674    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:17:37.539376 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:17:37.539293    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh"
Sep 15 09:19:47.293524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.293489    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"]
Sep 15 09:19:47.297271 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.297240    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.299622 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.299592    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-ffb593-serving-cert\""
Sep 15 09:19:47.305509 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.305484    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"]
Sep 15 09:19:47.411189 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.411154    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.411361 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.411260    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.411361 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.411309    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-metrics-certs\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.411451 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.411378    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9phxh\" (UniqueName: \"kubernetes.io/projected/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-kube-api-access-9phxh\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.512754 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.512714    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-metrics-certs\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.512942 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.512775    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phxh\" (UniqueName: \"kubernetes.io/projected/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-kube-api-access-9phxh\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.512942 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.512827    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.512942 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.512883    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.513053 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:19:47.513016    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-serving-cert: secret "maas-api-e2e-worker-w0-ffb593-serving-cert" not found
Sep 15 09:19:47.513123 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:19:47.513109    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls podName:20f51f1a-9a52-4c55-8fe3-e4aa140cde96 nodeName:}" failed. No retries permitted until 2026-09-15 09:19:48.013086425 +0000 UTC m=+775.602910764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls") pod "maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk" (UID: "20f51f1a-9a52-4c55-8fe3-e4aa140cde96") : secret "maas-api-e2e-worker-w0-ffb593-serving-cert" not found
Sep 15 09:19:47.513506 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.513490    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.515268 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.515251    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-metrics-certs\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:47.523077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:47.523056    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9phxh\" (UniqueName: \"kubernetes.io/projected/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-kube-api-access-9phxh\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:48.019047 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.019012    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:48.019253 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:19:48.019174    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-serving-cert: secret "maas-api-e2e-worker-w0-ffb593-serving-cert" not found
Sep 15 09:19:48.019326 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:19:48.019257    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls podName:20f51f1a-9a52-4c55-8fe3-e4aa140cde96 nodeName:}" failed. No retries permitted until 2026-09-15 09:19:49.0192372 +0000 UTC m=+776.609061530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls") pod "maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk" (UID: "20f51f1a-9a52-4c55-8fe3-e4aa140cde96") : secret "maas-api-e2e-worker-w0-ffb593-serving-cert" not found
Sep 15 09:19:48.350514 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.350429    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"]
Sep 15 09:19:48.354553 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.354525    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.357644 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.357622    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-890f3e-serving-cert\""
Sep 15 09:19:48.365568 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.365542    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"]
Sep 15 09:19:48.523826 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.523777    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdg25\" (UniqueName: \"kubernetes.io/projected/55dca501-4caa-4327-9ab9-847537b30321-kube-api-access-qdg25\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.524000 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.523894    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-maas-api-tls\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.524000 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.523967    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-metrics-certs\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.524081 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.524023    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55dca501-4caa-4327-9ab9-847537b30321-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.625162 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.625072    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdg25\" (UniqueName: \"kubernetes.io/projected/55dca501-4caa-4327-9ab9-847537b30321-kube-api-access-qdg25\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.625162 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.625137    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-maas-api-tls\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.625356 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.625185    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-metrics-certs\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.625356 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.625225    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55dca501-4caa-4327-9ab9-847537b30321-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.625356 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:19:48.625313    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-serving-cert: secret "maas-api-e2e-worker-w4-890f3e-serving-cert" not found
Sep 15 09:19:48.625451 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:19:48.625417    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-maas-api-tls podName:55dca501-4caa-4327-9ab9-847537b30321 nodeName:}" failed. No retries permitted until 2026-09-15 09:19:49.125397331 +0000 UTC m=+776.715221666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-maas-api-tls") pod "maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7" (UID: "55dca501-4caa-4327-9ab9-847537b30321") : secret "maas-api-e2e-worker-w4-890f3e-serving-cert" not found
Sep 15 09:19:48.625915 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.625893    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55dca501-4caa-4327-9ab9-847537b30321-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.627592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.627564    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-metrics-certs\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:48.635531 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:48.635504    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdg25\" (UniqueName: \"kubernetes.io/projected/55dca501-4caa-4327-9ab9-847537b30321-kube-api-access-qdg25\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:49.030012 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.029967    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:49.032651 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.032623    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:49.111447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.111405    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:49.130836 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.130801    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-maas-api-tls\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:49.133308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.133259    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-maas-api-tls\") pod \"maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:49.153618 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.153582    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"]
Sep 15 09:19:49.159568 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.159541    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:19:49.162610 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.162586    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-890f3e-dockercfg-mcv9d\""
Sep 15 09:19:49.162610 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.162609    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-890f3e\""
Sep 15 09:19:49.169247 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.169224    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"]
Sep 15 09:19:49.269048 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.269010    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:49.333747 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.333711    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkrsl\" (UniqueName: \"kubernetes.io/projected/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-kube-api-access-pkrsl\") pod \"payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd\" (UID: \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:19:49.333912 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.333835    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd\" (UID: \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:19:49.393978 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.393953    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"]
Sep 15 09:19:49.395723 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:19:49.395693    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f51f1a_9a52_4c55_8fe3_e4aa140cde96.slice/crio-fd333c59a8a0cf6b7ba7b45081599e92c39243e84c675ae854742d4faafa88a3 WatchSource:0}: Error finding container fd333c59a8a0cf6b7ba7b45081599e92c39243e84c675ae854742d4faafa88a3: Status 404 returned error can't find the container with id fd333c59a8a0cf6b7ba7b45081599e92c39243e84c675ae854742d4faafa88a3
Sep 15 09:19:49.435065 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.435028    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd\" (UID: \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:19:49.435276 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.435161    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkrsl\" (UniqueName: \"kubernetes.io/projected/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-kube-api-access-pkrsl\") pod \"payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd\" (UID: \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:19:49.435734 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.435710    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd\" (UID: \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:19:49.443544 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.443516    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkrsl\" (UniqueName: \"kubernetes.io/projected/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-kube-api-access-pkrsl\") pod \"payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd\" (UID: \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:19:49.476357 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.476320    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:19:49.541067 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.540991    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"]
Sep 15 09:19:49.542976 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:19:49.542946    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55dca501_4caa_4327_9ab9_847537b30321.slice/crio-2226024151d293b0ffab305f3562b9241f8b08774b49dc6de48886001471845c WatchSource:0}: Error finding container 2226024151d293b0ffab305f3562b9241f8b08774b49dc6de48886001471845c: Status 404 returned error can't find the container with id 2226024151d293b0ffab305f3562b9241f8b08774b49dc6de48886001471845c
Sep 15 09:19:49.753008 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:49.752976    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"]
Sep 15 09:19:49.754534 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:19:49.754496    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd2894d_ca0e_4713_b4e8_224ec9e81bac.slice/crio-4a4b867cf7646cbb914f433ddfdda4b4831f1a70f10651e657de35869d7c5c1d WatchSource:0}: Error finding container 4a4b867cf7646cbb914f433ddfdda4b4831f1a70f10651e657de35869d7c5c1d: Status 404 returned error can't find the container with id 4a4b867cf7646cbb914f433ddfdda4b4831f1a70f10651e657de35869d7c5c1d
Sep 15 09:19:50.345007 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.344958    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd" event={"ID":"fdd2894d-ca0e-4713-b4e8-224ec9e81bac","Type":"ContainerStarted","Data":"cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017"}
Sep 15 09:19:50.345205 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.345016    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd" event={"ID":"fdd2894d-ca0e-4713-b4e8-224ec9e81bac","Type":"ContainerStarted","Data":"4a4b867cf7646cbb914f433ddfdda4b4831f1a70f10651e657de35869d7c5c1d"}
Sep 15 09:19:50.345205 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.345147    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:19:50.348116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.347358    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk" event={"ID":"20f51f1a-9a52-4c55-8fe3-e4aa140cde96","Type":"ContainerStarted","Data":"7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525"}
Sep 15 09:19:50.348116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.347405    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk" event={"ID":"20f51f1a-9a52-4c55-8fe3-e4aa140cde96","Type":"ContainerStarted","Data":"fd333c59a8a0cf6b7ba7b45081599e92c39243e84c675ae854742d4faafa88a3"}
Sep 15 09:19:50.348116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.347908    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:50.353863 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.350174    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7" event={"ID":"55dca501-4caa-4327-9ab9-847537b30321","Type":"ContainerStarted","Data":"47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf"}
Sep 15 09:19:50.353863 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.350220    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7" event={"ID":"55dca501-4caa-4327-9ab9-847537b30321","Type":"ContainerStarted","Data":"2226024151d293b0ffab305f3562b9241f8b08774b49dc6de48886001471845c"}
Sep 15 09:19:50.353863 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.350692    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:50.368220 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.368170    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd" podStartSLOduration=1.368141781 podStartE2EDuration="1.368141781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:50.368017623 +0000 UTC m=+777.957841973" watchObservedRunningTime="2026-09-15 09:19:50.368141781 +0000 UTC m=+777.957966130"
Sep 15 09:19:50.389548 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.389488    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk" podStartSLOduration=2.81060031 podStartE2EDuration="3.389473826s" totalImagesPullingTime="578.873516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:50.38701932 +0000 UTC m=+777.976843667" watchObservedRunningTime="2026-09-15 09:19:50.389473826 +0000 UTC m=+777.979298167"
Sep 15 09:19:50.405733 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:50.405684    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7" podStartSLOduration=2.009487446 podStartE2EDuration="2.40566351s" totalImagesPullingTime="396.176064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:50.402270921 +0000 UTC m=+777.992095270" watchObservedRunningTime="2026-09-15 09:19:50.40566351 +0000 UTC m=+777.995487859"
Sep 15 09:19:57.373010 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:57.372979    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:19:57.373461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:57.373366    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:19:58.384793 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.384759    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"]
Sep 15 09:19:58.388880 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.388837    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.391368 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.391346    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ca71c041-serving-cert\""
Sep 15 09:19:58.401049 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.401027    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"]
Sep 15 09:19:58.431036 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.431008    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-metrics-certs\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.431195 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.431044    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30a021f6-9162-432d-8797-5050cbf1153c-openshift-service-ca\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.431195 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.431104    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-maas-api-tls\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.431195 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.431130    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcb4w\" (UniqueName: \"kubernetes.io/projected/30a021f6-9162-432d-8797-5050cbf1153c-kube-api-access-dcb4w\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.532372 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.532337    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-metrics-certs\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.532372 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.532375    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30a021f6-9162-432d-8797-5050cbf1153c-openshift-service-ca\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.532666 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.532414    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-maas-api-tls\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.532666 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.532441    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcb4w\" (UniqueName: \"kubernetes.io/projected/30a021f6-9162-432d-8797-5050cbf1153c-kube-api-access-dcb4w\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.532666 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:19:58.532574    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-serving-cert: secret "maas-api-e2e-ait-ca71c041-serving-cert" not found
Sep 15 09:19:58.532666 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:19:58.532646    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-maas-api-tls podName:30a021f6-9162-432d-8797-5050cbf1153c nodeName:}" failed. No retries permitted until 2026-09-15 09:19:59.032625384 +0000 UTC m=+786.622449725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-maas-api-tls") pod "maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24" (UID: "30a021f6-9162-432d-8797-5050cbf1153c") : secret "maas-api-e2e-ait-ca71c041-serving-cert" not found
Sep 15 09:19:58.533253 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.533231    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30a021f6-9162-432d-8797-5050cbf1153c-openshift-service-ca\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.534882 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.534862    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-metrics-certs\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:58.540890 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:58.540869    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcb4w\" (UniqueName: \"kubernetes.io/projected/30a021f6-9162-432d-8797-5050cbf1153c-kube-api-access-dcb4w\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:59.037933 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.037895    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-maas-api-tls\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:59.040415 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.040380    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-maas-api-tls\") pod \"maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:59.163887 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.163838    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"]
Sep 15 09:19:59.167661 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.167639    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:19:59.170470 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.170446    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ca71c041\""
Sep 15 09:19:59.170573 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.170469    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ca71c041-dockercfg-9kkgr\""
Sep 15 09:19:59.180262 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.180235    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"]
Sep 15 09:19:59.240179 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.240145    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64\" (UID: \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:19:59.240350 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.240206    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b82vl\" (UniqueName: \"kubernetes.io/projected/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-kube-api-access-b82vl\") pod \"payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64\" (UID: \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:19:59.303338 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.303245    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:19:59.341686 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.341647    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64\" (UID: \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:19:59.341901 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.341708    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82vl\" (UniqueName: \"kubernetes.io/projected/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-kube-api-access-b82vl\") pod \"payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64\" (UID: \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:19:59.342370 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.342348    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64\" (UID: \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:19:59.350807 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.350777    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b82vl\" (UniqueName: \"kubernetes.io/projected/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-kube-api-access-b82vl\") pod \"payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64\" (UID: \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:19:59.479386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.479351    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:19:59.584331 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.584290    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"]
Sep 15 09:19:59.585739 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:19:59.585698    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a021f6_9162_432d_8797_5050cbf1153c.slice/crio-4cc41b88a28cbbe2cf2cc19f7fe1b26473d4bed868c185741af15b99f501173b WatchSource:0}: Error finding container 4cc41b88a28cbbe2cf2cc19f7fe1b26473d4bed868c185741af15b99f501173b: Status 404 returned error can't find the container with id 4cc41b88a28cbbe2cf2cc19f7fe1b26473d4bed868c185741af15b99f501173b
Sep 15 09:19:59.752780 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:19:59.752736    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"]
Sep 15 09:19:59.757113 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:19:59.757088    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9be08b_32f6_4ac2_9dbd_aed596ed9aca.slice/crio-af5d61d56fcbef8d2bc9b762c6fe26a300f3f531e56a2b7d3a077a50afb3b126 WatchSource:0}: Error finding container af5d61d56fcbef8d2bc9b762c6fe26a300f3f531e56a2b7d3a077a50afb3b126: Status 404 returned error can't find the container with id af5d61d56fcbef8d2bc9b762c6fe26a300f3f531e56a2b7d3a077a50afb3b126
Sep 15 09:20:00.425724 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:00.425633    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64" event={"ID":"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca","Type":"ContainerStarted","Data":"0a8935155c7ca2d9960595cc6a390b1118b66e52f03915abf741f5ccf0b2fb17"}
Sep 15 09:20:00.425724 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:00.425696    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64" event={"ID":"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca","Type":"ContainerStarted","Data":"af5d61d56fcbef8d2bc9b762c6fe26a300f3f531e56a2b7d3a077a50afb3b126"}
Sep 15 09:20:00.425724 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:00.425725    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:20:00.427530 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:00.427503    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24" event={"ID":"30a021f6-9162-432d-8797-5050cbf1153c","Type":"ContainerStarted","Data":"f81122055fe2c0d20167fcab9a23d0cf95749ac378b33768bbd128dea0f33dda"}
Sep 15 09:20:00.427652 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:00.427552    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24" event={"ID":"30a021f6-9162-432d-8797-5050cbf1153c","Type":"ContainerStarted","Data":"4cc41b88a28cbbe2cf2cc19f7fe1b26473d4bed868c185741af15b99f501173b"}
Sep 15 09:20:00.427652 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:00.427601    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:20:00.441526 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:00.441475    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64" podStartSLOduration=1.441460463 podStartE2EDuration="1.441460463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:00.440022568 +0000 UTC m=+788.029846940" watchObservedRunningTime="2026-09-15 09:20:00.441460463 +0000 UTC m=+788.031284811"
Sep 15 09:20:00.458942 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:00.458894    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24" podStartSLOduration=2.033756002 podStartE2EDuration="2.458879242s" totalImagesPullingTime="425.12324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:00.455664841 +0000 UTC m=+788.045489201" watchObservedRunningTime="2026-09-15 09:20:00.458879242 +0000 UTC m=+788.048703587"
Sep 15 09:20:01.361206 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:01.361167    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:20:06.439661 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:06.439631    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:20:11.435882 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:11.435832    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:20:17.968312 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:17.968222    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"]
Sep 15 09:20:17.972911 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:17.972886    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:17.975607 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:17.975585    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2430e2-serving-cert\""
Sep 15 09:20:17.981323 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:17.980989    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"]
Sep 15 09:20:18.126475 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.126438    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.126625 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.126604    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwqrk\" (UniqueName: \"kubernetes.io/projected/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-kube-api-access-hwqrk\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.126663 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.126656    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-metrics-certs\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.126714 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.126698    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-maas-api-tls\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.227676 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.227638    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqrk\" (UniqueName: \"kubernetes.io/projected/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-kube-api-access-hwqrk\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.227875 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.227703    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-metrics-certs\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.227875 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.227736    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-maas-api-tls\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.227875 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.227763    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.228047 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:20:18.227904    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-serving-cert: secret "maas-api-e2e-inf-b-2430e2-serving-cert" not found
Sep 15 09:20:18.228047 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:20:18.228004    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-maas-api-tls podName:acb1b2ab-e9a2-48b8-a584-9ecef7a19b40 nodeName:}" failed. No retries permitted until 2026-09-15 09:20:18.727981909 +0000 UTC m=+806.317806240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-maas-api-tls") pod "maas-api-e2e-inf-b-2430e2-57458f569-jzhsr" (UID: "acb1b2ab-e9a2-48b8-a584-9ecef7a19b40") : secret "maas-api-e2e-inf-b-2430e2-serving-cert" not found
Sep 15 09:20:18.228582 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.228560    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.230399 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.230377    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-metrics-certs\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.236411 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.236386    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwqrk\" (UniqueName: \"kubernetes.io/projected/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-kube-api-access-hwqrk\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.621321 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.621238    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"]
Sep 15 09:20:18.625087 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.625070    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:18.628122 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.628095    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-2430e2\""
Sep 15 09:20:18.628122 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.628115    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-2430e2-dockercfg-qvz9t\""
Sep 15 09:20:18.636659 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.636633    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"]
Sep 15 09:20:18.732147 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.732113    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb\" (UID: \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:18.732312 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.732163    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8ltl\" (UniqueName: \"kubernetes.io/projected/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-kube-api-access-k8ltl\") pod \"payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb\" (UID: \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:18.732312 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.732210    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-maas-api-tls\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.734567 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.734551    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-maas-api-tls\") pod \"maas-api-e2e-inf-b-2430e2-57458f569-jzhsr\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.832987 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.832946    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8ltl\" (UniqueName: \"kubernetes.io/projected/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-kube-api-access-k8ltl\") pod \"payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb\" (UID: \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:18.833176 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.833092    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb\" (UID: \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:18.833771 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.833751    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb\" (UID: \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:18.841243 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.841213    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8ltl\" (UniqueName: \"kubernetes.io/projected/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-kube-api-access-k8ltl\") pod \"payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb\" (UID: \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:18.885274 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.885207    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:18.938014 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:18.937963    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:19.165900 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:19.165841    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"]
Sep 15 09:20:19.167750 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:20:19.167726    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb1b2ab_e9a2_48b8_a584_9ecef7a19b40.slice/crio-102ff34053408adffc00eb02b9817b8cee4d6d2ba06ee5413df341b575fb1786 WatchSource:0}: Error finding container 102ff34053408adffc00eb02b9817b8cee4d6d2ba06ee5413df341b575fb1786: Status 404 returned error can't find the container with id 102ff34053408adffc00eb02b9817b8cee4d6d2ba06ee5413df341b575fb1786
Sep 15 09:20:19.226352 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:19.226324    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"]
Sep 15 09:20:19.227524 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:20:19.227502    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda622f5a_d6eb_4976_beaf_7f2cd33bd2e6.slice/crio-d005ab27618d80243aa7da09c29db3f2a7bb847fe3537c2d07a7803bb80001b0 WatchSource:0}: Error finding container d005ab27618d80243aa7da09c29db3f2a7bb847fe3537c2d07a7803bb80001b0: Status 404 returned error can't find the container with id d005ab27618d80243aa7da09c29db3f2a7bb847fe3537c2d07a7803bb80001b0
Sep 15 09:20:19.566440 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:19.566411    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr" event={"ID":"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40","Type":"ContainerStarted","Data":"102ff34053408adffc00eb02b9817b8cee4d6d2ba06ee5413df341b575fb1786"}
Sep 15 09:20:19.568499 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:19.568469    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb" event={"ID":"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6","Type":"ContainerStarted","Data":"740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104"}
Sep 15 09:20:19.568615 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:19.568525    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb" event={"ID":"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6","Type":"ContainerStarted","Data":"d005ab27618d80243aa7da09c29db3f2a7bb847fe3537c2d07a7803bb80001b0"}
Sep 15 09:20:19.568687 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:19.568653    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:19.589146 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:19.589079    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb" podStartSLOduration=1.589058776 podStartE2EDuration="1.589058776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:19.585580645 +0000 UTC m=+807.175404994" watchObservedRunningTime="2026-09-15 09:20:19.589058776 +0000 UTC m=+807.178883126"
Sep 15 09:20:20.577233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:20.577191    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr" event={"ID":"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40","Type":"ContainerStarted","Data":"d758042fb573852d47215371ac05eb1713c6b13fdd765952588568d0b983accb"}
Sep 15 09:20:20.597351 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:20.597304    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr" podStartSLOduration=3.2754302109999998 podStartE2EDuration="3.597289117s" totalImagesPullingTime="321.858906ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:20.59488155 +0000 UTC m=+808.184705899" watchObservedRunningTime="2026-09-15 09:20:20.597289117 +0000 UTC m=+808.187113466"
Sep 15 09:20:21.583586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:21.583550    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:25.316570 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.316530    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"]
Sep 15 09:20:25.317067 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.316858    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24" podUID="30a021f6-9162-432d-8797-5050cbf1153c" containerName="maas-api" containerID="cri-o://f81122055fe2c0d20167fcab9a23d0cf95749ac378b33768bbd128dea0f33dda" gracePeriod=30
Sep 15 09:20:25.380592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.380558    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"]
Sep 15 09:20:25.380821 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.380794    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64" podUID="ff9be08b-32f6-4ac2-9dbd-aed596ed9aca" containerName="payload-pre-processing" containerID="cri-o://0a8935155c7ca2d9960595cc6a390b1118b66e52f03915abf741f5ccf0b2fb17" gracePeriod=30
Sep 15 09:20:25.614013 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.613980    2555 generic.go:356] "Generic (PLEG): container finished" podID="30a021f6-9162-432d-8797-5050cbf1153c" containerID="f81122055fe2c0d20167fcab9a23d0cf95749ac378b33768bbd128dea0f33dda" exitCode=0
Sep 15 09:20:25.614169 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.614052    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24" event={"ID":"30a021f6-9162-432d-8797-5050cbf1153c","Type":"ContainerDied","Data":"f81122055fe2c0d20167fcab9a23d0cf95749ac378b33768bbd128dea0f33dda"}
Sep 15 09:20:25.616037 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.616009    2555 generic.go:356] "Generic (PLEG): container finished" podID="ff9be08b-32f6-4ac2-9dbd-aed596ed9aca" containerID="0a8935155c7ca2d9960595cc6a390b1118b66e52f03915abf741f5ccf0b2fb17" exitCode=0
Sep 15 09:20:25.616143 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.616084    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64" event={"ID":"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca","Type":"ContainerDied","Data":"0a8935155c7ca2d9960595cc6a390b1118b66e52f03915abf741f5ccf0b2fb17"}
Sep 15 09:20:25.641900 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.641874    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:20:25.675430 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.675404    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:20:25.805154 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.805122    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-plugins-config-volume\") pod \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\" (UID: \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\") "
Sep 15 09:20:25.805341 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.805195    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b82vl\" (UniqueName: \"kubernetes.io/projected/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-kube-api-access-b82vl\") pod \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\" (UID: \"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca\") "
Sep 15 09:20:25.805341 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.805217    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcb4w\" (UniqueName: \"kubernetes.io/projected/30a021f6-9162-432d-8797-5050cbf1153c-kube-api-access-dcb4w\") pod \"30a021f6-9162-432d-8797-5050cbf1153c\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") "
Sep 15 09:20:25.805341 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.805258    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-maas-api-tls\") pod \"30a021f6-9162-432d-8797-5050cbf1153c\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") "
Sep 15 09:20:25.805341 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.805276    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-metrics-certs\") pod \"30a021f6-9162-432d-8797-5050cbf1153c\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") "
Sep 15 09:20:25.805341 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.805299    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30a021f6-9162-432d-8797-5050cbf1153c-openshift-service-ca\") pod \"30a021f6-9162-432d-8797-5050cbf1153c\" (UID: \"30a021f6-9162-432d-8797-5050cbf1153c\") "
Sep 15 09:20:25.805685 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.805495    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff9be08b-32f6-4ac2-9dbd-aed596ed9aca" (UID: "ff9be08b-32f6-4ac2-9dbd-aed596ed9aca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:20:25.805745 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.805694    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-plugins-config-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:20:25.805793 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.805749    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30a021f6-9162-432d-8797-5050cbf1153c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "30a021f6-9162-432d-8797-5050cbf1153c" (UID: "30a021f6-9162-432d-8797-5050cbf1153c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:20:25.807491 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.807464    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-kube-api-access-b82vl" (OuterVolumeSpecName: "kube-api-access-b82vl") pod "ff9be08b-32f6-4ac2-9dbd-aed596ed9aca" (UID: "ff9be08b-32f6-4ac2-9dbd-aed596ed9aca"). InnerVolumeSpecName "kube-api-access-b82vl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:20:25.807611 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.807489    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "30a021f6-9162-432d-8797-5050cbf1153c" (UID: "30a021f6-9162-432d-8797-5050cbf1153c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:20:25.807706 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.807687    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30a021f6-9162-432d-8797-5050cbf1153c-kube-api-access-dcb4w" (OuterVolumeSpecName: "kube-api-access-dcb4w") pod "30a021f6-9162-432d-8797-5050cbf1153c" (UID: "30a021f6-9162-432d-8797-5050cbf1153c"). InnerVolumeSpecName "kube-api-access-dcb4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:20:25.807771 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.807755    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "30a021f6-9162-432d-8797-5050cbf1153c" (UID: "30a021f6-9162-432d-8797-5050cbf1153c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:20:25.906649 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.906564    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b82vl\" (UniqueName: \"kubernetes.io/projected/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca-kube-api-access-b82vl\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:20:25.906649 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.906595    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcb4w\" (UniqueName: \"kubernetes.io/projected/30a021f6-9162-432d-8797-5050cbf1153c-kube-api-access-dcb4w\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:20:25.906649 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.906605    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:20:25.906649 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.906615    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30a021f6-9162-432d-8797-5050cbf1153c-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:20:25.906649 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:25.906623    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30a021f6-9162-432d-8797-5050cbf1153c-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:20:26.624487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.624401    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"
Sep 15 09:20:26.624487 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.624439    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24" event={"ID":"30a021f6-9162-432d-8797-5050cbf1153c","Type":"ContainerDied","Data":"4cc41b88a28cbbe2cf2cc19f7fe1b26473d4bed868c185741af15b99f501173b"}
Sep 15 09:20:26.624996 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.624519    2555 scope.go:117] "RemoveContainer" containerID="f81122055fe2c0d20167fcab9a23d0cf95749ac378b33768bbd128dea0f33dda"
Sep 15 09:20:26.625913 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.625896    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"
Sep 15 09:20:26.625982 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.625888    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64" event={"ID":"ff9be08b-32f6-4ac2-9dbd-aed596ed9aca","Type":"ContainerDied","Data":"af5d61d56fcbef8d2bc9b762c6fe26a300f3f531e56a2b7d3a077a50afb3b126"}
Sep 15 09:20:26.635099 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.635073    2555 scope.go:117] "RemoveContainer" containerID="0a8935155c7ca2d9960595cc6a390b1118b66e52f03915abf741f5ccf0b2fb17"
Sep 15 09:20:26.658668 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.658639    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"]
Sep 15 09:20:26.672438 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.672408    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64"]
Sep 15 09:20:26.690288 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.690256    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"]
Sep 15 09:20:26.693794 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.693769    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ca71c041-6ccfd5d7d5-zzl24"]
Sep 15 09:20:26.957542 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.957456    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30a021f6-9162-432d-8797-5050cbf1153c" path="/var/lib/kubelet/pods/30a021f6-9162-432d-8797-5050cbf1153c/volumes"
Sep 15 09:20:26.957945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:26.957929    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff9be08b-32f6-4ac2-9dbd-aed596ed9aca" path="/var/lib/kubelet/pods/ff9be08b-32f6-4ac2-9dbd-aed596ed9aca/volumes"
Sep 15 09:20:27.596025 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:27.595993    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:20:30.579325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:30.579288    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:20:31.370110 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.370072    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"]
Sep 15 09:20:31.370803 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.370785    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff9be08b-32f6-4ac2-9dbd-aed596ed9aca" containerName="payload-pre-processing"
Sep 15 09:20:31.370870 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.370807    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff9be08b-32f6-4ac2-9dbd-aed596ed9aca" containerName="payload-pre-processing"
Sep 15 09:20:31.370923 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.370877    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30a021f6-9162-432d-8797-5050cbf1153c" containerName="maas-api"
Sep 15 09:20:31.370923 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.370888    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="30a021f6-9162-432d-8797-5050cbf1153c" containerName="maas-api"
Sep 15 09:20:31.371005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.370994    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff9be08b-32f6-4ac2-9dbd-aed596ed9aca" containerName="payload-pre-processing"
Sep 15 09:20:31.371041 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.371012    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="30a021f6-9162-432d-8797-5050cbf1153c" containerName="maas-api"
Sep 15 09:20:31.374884 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.374861    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.377348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.377284    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-0cec7519-serving-cert\""
Sep 15 09:20:31.386594 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.386570    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"]
Sep 15 09:20:31.564294 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.564248    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xndt\" (UniqueName: \"kubernetes.io/projected/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-kube-api-access-2xndt\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.564476 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.564308    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-openshift-service-ca\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.564476 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.564361    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-maas-api-tls\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.564476 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.564436    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-metrics-certs\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.666050 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.665951    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xndt\" (UniqueName: \"kubernetes.io/projected/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-kube-api-access-2xndt\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.666050 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.666006    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-openshift-service-ca\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.666530 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.666066    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-maas-api-tls\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.666530 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.666148    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-metrics-certs\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.666753 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.666730    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-openshift-service-ca\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.668635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.668609    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-metrics-certs\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.668635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.668628    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-maas-api-tls\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.674285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.674264    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xndt\" (UniqueName: \"kubernetes.io/projected/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-kube-api-access-2xndt\") pod \"maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.688171 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.688149    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:31.967133 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:31.967101    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"]
Sep 15 09:20:31.968497 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:20:31.968463    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfa4eee_49fa_4f5e_bc23_a2c4a37820f5.slice/crio-9375e9dcfeb4c4cd0abdc03ba7f5347b196c1b58b3188750332db4fe773a631a WatchSource:0}: Error finding container 9375e9dcfeb4c4cd0abdc03ba7f5347b196c1b58b3188750332db4fe773a631a: Status 404 returned error can't find the container with id 9375e9dcfeb4c4cd0abdc03ba7f5347b196c1b58b3188750332db4fe773a631a
Sep 15 09:20:32.676758 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:32.676672    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn" event={"ID":"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5","Type":"ContainerStarted","Data":"c4f00fcea8cbdb20084a25ae7358081fdd9f6b856604ccb243ec6a10ad4d9b50"}
Sep 15 09:20:32.676758 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:32.676736    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn" event={"ID":"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5","Type":"ContainerStarted","Data":"9375e9dcfeb4c4cd0abdc03ba7f5347b196c1b58b3188750332db4fe773a631a"}
Sep 15 09:20:32.677183 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:32.676788    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:20:32.696363 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:32.696294    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn" podStartSLOduration=1.394085525 podStartE2EDuration="1.69627913s" totalImagesPullingTime="302.193605ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:32.694281756 +0000 UTC m=+820.284106104" watchObservedRunningTime="2026-09-15 09:20:32.69627913 +0000 UTC m=+820.286103519"
Sep 15 09:20:38.688992 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:20:38.688960    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:21:00.636195 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:00.636146    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"]
Sep 15 09:21:00.636691 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:00.636594    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn" podUID="ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" containerName="maas-api" containerID="cri-o://c4f00fcea8cbdb20084a25ae7358081fdd9f6b856604ccb243ec6a10ad4d9b50" gracePeriod=30
Sep 15 09:21:00.858662 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:00.858622    2555 generic.go:356] "Generic (PLEG): container finished" podID="ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" containerID="c4f00fcea8cbdb20084a25ae7358081fdd9f6b856604ccb243ec6a10ad4d9b50" exitCode=0
Sep 15 09:21:00.858873 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:00.858664    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn" event={"ID":"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5","Type":"ContainerDied","Data":"c4f00fcea8cbdb20084a25ae7358081fdd9f6b856604ccb243ec6a10ad4d9b50"}
Sep 15 09:21:00.893818 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:00.893759    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:21:01.064907 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.064872    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xndt\" (UniqueName: \"kubernetes.io/projected/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-kube-api-access-2xndt\") pod \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") "
Sep 15 09:21:01.065071 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.064941    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-openshift-service-ca\") pod \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") "
Sep 15 09:21:01.065071 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.064998    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-metrics-certs\") pod \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") "
Sep 15 09:21:01.065071 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.065028    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-maas-api-tls\") pod \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\" (UID: \"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5\") "
Sep 15 09:21:01.065350 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.065319    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" (UID: "ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:01.067045 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.067015    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" (UID: "ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:21:01.067045 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.067026    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-kube-api-access-2xndt" (OuterVolumeSpecName: "kube-api-access-2xndt") pod "ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" (UID: "ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5"). InnerVolumeSpecName "kube-api-access-2xndt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:01.067177 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.067092    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" (UID: "ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:21:01.166797 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.166718    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xndt\" (UniqueName: \"kubernetes.io/projected/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-kube-api-access-2xndt\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:21:01.166797 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.166746    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:21:01.166797 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.166755    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:21:01.166797 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.166764    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:21:01.867044 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.867015    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"
Sep 15 09:21:01.867044 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.867030    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn" event={"ID":"ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5","Type":"ContainerDied","Data":"9375e9dcfeb4c4cd0abdc03ba7f5347b196c1b58b3188750332db4fe773a631a"}
Sep 15 09:21:01.867511 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.867092    2555 scope.go:117] "RemoveContainer" containerID="c4f00fcea8cbdb20084a25ae7358081fdd9f6b856604ccb243ec6a10ad4d9b50"
Sep 15 09:21:01.889644 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.889612    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"]
Sep 15 09:21:01.893771 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:01.893745    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0cec7519-59454bb747-r2fqn"]
Sep 15 09:21:02.957144 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:02.957108    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" path="/var/lib/kubelet/pods/ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5/volumes"
Sep 15 09:21:06.717583 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.717551    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"]
Sep 15 09:21:06.718056 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.718040    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" containerName="maas-api"
Sep 15 09:21:06.718056 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.718057    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" containerName="maas-api"
Sep 15 09:21:06.718144 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.718135    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebfa4eee-49fa-4f5e-bc23-a2c4a37820f5" containerName="maas-api"
Sep 15 09:21:06.722587 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.722570    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.726184 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.726161    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0da90685-serving-cert\""
Sep 15 09:21:06.740882 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.740836    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"]
Sep 15 09:21:06.817234 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.817193    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-maas-api-tls\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.817234 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.817236    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b342464c-2796-4a60-92fa-e87df2ea2cd7-openshift-service-ca\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.817435 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.817283    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmvv7\" (UniqueName: \"kubernetes.io/projected/b342464c-2796-4a60-92fa-e87df2ea2cd7-kube-api-access-qmvv7\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.817435 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.817403    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-metrics-certs\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.918498 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.918459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-metrics-certs\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.918689 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.918520    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-maas-api-tls\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.918689 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.918552    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b342464c-2796-4a60-92fa-e87df2ea2cd7-openshift-service-ca\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.918689 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.918606    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmvv7\" (UniqueName: \"kubernetes.io/projected/b342464c-2796-4a60-92fa-e87df2ea2cd7-kube-api-access-qmvv7\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.918689 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:21:06.918680    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-serving-cert: secret "maas-api-e2e-ait-0da90685-serving-cert" not found
Sep 15 09:21:06.918883 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:21:06.918772    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-maas-api-tls podName:b342464c-2796-4a60-92fa-e87df2ea2cd7 nodeName:}" failed. No retries permitted until 2026-09-15 09:21:07.41875408 +0000 UTC m=+855.008578406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-maas-api-tls") pod "maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt" (UID: "b342464c-2796-4a60-92fa-e87df2ea2cd7") : secret "maas-api-e2e-ait-0da90685-serving-cert" not found
Sep 15 09:21:06.919267 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.919247    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b342464c-2796-4a60-92fa-e87df2ea2cd7-openshift-service-ca\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.920893 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.920874    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-metrics-certs\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:06.929301 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:06.929277    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmvv7\" (UniqueName: \"kubernetes.io/projected/b342464c-2796-4a60-92fa-e87df2ea2cd7-kube-api-access-qmvv7\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:07.423016 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:07.422981    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-maas-api-tls\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:07.425317 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:07.425286    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-maas-api-tls\") pod \"maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:07.633101 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:07.633062    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:07.907156 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:07.907124    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"]
Sep 15 09:21:07.908188 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:21:07.908162    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb342464c_2796_4a60_92fa_e87df2ea2cd7.slice/crio-13ad2861732d0f0e3299234fcc61db85f12e3c8ab30113319a5b0a5911ed494e WatchSource:0}: Error finding container 13ad2861732d0f0e3299234fcc61db85f12e3c8ab30113319a5b0a5911ed494e: Status 404 returned error can't find the container with id 13ad2861732d0f0e3299234fcc61db85f12e3c8ab30113319a5b0a5911ed494e
Sep 15 09:21:08.910623 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:08.910537    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt" event={"ID":"b342464c-2796-4a60-92fa-e87df2ea2cd7","Type":"ContainerStarted","Data":"531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6"}
Sep 15 09:21:08.910623 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:08.910593    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt" event={"ID":"b342464c-2796-4a60-92fa-e87df2ea2cd7","Type":"ContainerStarted","Data":"13ad2861732d0f0e3299234fcc61db85f12e3c8ab30113319a5b0a5911ed494e"}
Sep 15 09:21:08.910623 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:08.910621    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:08.929752 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:08.929699    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt" podStartSLOduration=2.291197545 podStartE2EDuration="2.9296824s" totalImagesPullingTime="638.484855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:08.926745357 +0000 UTC m=+856.516569730" watchObservedRunningTime="2026-09-15 09:21:08.9296824 +0000 UTC m=+856.519506747"
Sep 15 09:21:14.921769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:14.921735    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:36.697484 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:36.697449    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"]
Sep 15 09:21:36.698001 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:36.697662    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt" podUID="b342464c-2796-4a60-92fa-e87df2ea2cd7" containerName="maas-api" containerID="cri-o://531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6" gracePeriod=30
Sep 15 09:21:36.966620 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:36.966552    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:37.089469 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.089439    2555 generic.go:356] "Generic (PLEG): container finished" podID="b342464c-2796-4a60-92fa-e87df2ea2cd7" containerID="531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6" exitCode=0
Sep 15 09:21:37.089607 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.089485    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"
Sep 15 09:21:37.089607 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.089511    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt" event={"ID":"b342464c-2796-4a60-92fa-e87df2ea2cd7","Type":"ContainerDied","Data":"531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6"}
Sep 15 09:21:37.089607 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.089556    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt" event={"ID":"b342464c-2796-4a60-92fa-e87df2ea2cd7","Type":"ContainerDied","Data":"13ad2861732d0f0e3299234fcc61db85f12e3c8ab30113319a5b0a5911ed494e"}
Sep 15 09:21:37.089607 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.089578    2555 scope.go:117] "RemoveContainer" containerID="531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6"
Sep 15 09:21:37.099181 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.099156    2555 scope.go:117] "RemoveContainer" containerID="531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6"
Sep 15 09:21:37.099432 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:21:37.099413    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6\": container with ID starting with 531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6 not found: ID does not exist" containerID="531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6"
Sep 15 09:21:37.099478 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.099440    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6"} err="failed to get container status \"531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6\": rpc error: code = NotFound desc = could not find container \"531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6\": container with ID starting with 531b499e66aca19d353ad23a82a2eda4d9d7dac2e4d6f28b7cbf5debcb2d4aa6 not found: ID does not exist"
Sep 15 09:21:37.126858 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.126820    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmvv7\" (UniqueName: \"kubernetes.io/projected/b342464c-2796-4a60-92fa-e87df2ea2cd7-kube-api-access-qmvv7\") pod \"b342464c-2796-4a60-92fa-e87df2ea2cd7\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") "
Sep 15 09:21:37.127029 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.127008    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-metrics-certs\") pod \"b342464c-2796-4a60-92fa-e87df2ea2cd7\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") "
Sep 15 09:21:37.127076 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.127057    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-maas-api-tls\") pod \"b342464c-2796-4a60-92fa-e87df2ea2cd7\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") "
Sep 15 09:21:37.127130 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.127084    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b342464c-2796-4a60-92fa-e87df2ea2cd7-openshift-service-ca\") pod \"b342464c-2796-4a60-92fa-e87df2ea2cd7\" (UID: \"b342464c-2796-4a60-92fa-e87df2ea2cd7\") "
Sep 15 09:21:37.127525 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.127496    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b342464c-2796-4a60-92fa-e87df2ea2cd7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b342464c-2796-4a60-92fa-e87df2ea2cd7" (UID: "b342464c-2796-4a60-92fa-e87df2ea2cd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:37.128903 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.128876    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b342464c-2796-4a60-92fa-e87df2ea2cd7-kube-api-access-qmvv7" (OuterVolumeSpecName: "kube-api-access-qmvv7") pod "b342464c-2796-4a60-92fa-e87df2ea2cd7" (UID: "b342464c-2796-4a60-92fa-e87df2ea2cd7"). InnerVolumeSpecName "kube-api-access-qmvv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:37.129011 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.128997    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b342464c-2796-4a60-92fa-e87df2ea2cd7" (UID: "b342464c-2796-4a60-92fa-e87df2ea2cd7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:21:37.129207 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.129184    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b342464c-2796-4a60-92fa-e87df2ea2cd7" (UID: "b342464c-2796-4a60-92fa-e87df2ea2cd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:21:37.228481 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.228444    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmvv7\" (UniqueName: \"kubernetes.io/projected/b342464c-2796-4a60-92fa-e87df2ea2cd7-kube-api-access-qmvv7\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:21:37.228481 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.228476    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:21:37.228679 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.228489    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b342464c-2796-4a60-92fa-e87df2ea2cd7-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:21:37.228679 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.228501    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b342464c-2796-4a60-92fa-e87df2ea2cd7-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:21:37.413720 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.413686    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"]
Sep 15 09:21:37.416482 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:37.416450    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0da90685-66dfbcf46d-45ttt"]
Sep 15 09:21:38.956980 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:38.956947    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b342464c-2796-4a60-92fa-e87df2ea2cd7" path="/var/lib/kubelet/pods/b342464c-2796-4a60-92fa-e87df2ea2cd7/volumes"
Sep 15 09:21:44.736223 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.736187    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"]
Sep 15 09:21:44.736969 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.736947    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b342464c-2796-4a60-92fa-e87df2ea2cd7" containerName="maas-api"
Sep 15 09:21:44.737044 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.736973    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b342464c-2796-4a60-92fa-e87df2ea2cd7" containerName="maas-api"
Sep 15 09:21:44.737151 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.737138    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b342464c-2796-4a60-92fa-e87df2ea2cd7" containerName="maas-api"
Sep 15 09:21:44.742314 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.742291    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.744968 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.744947    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-a01e15d8-serving-cert\""
Sep 15 09:21:44.748633 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.748609    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"]
Sep 15 09:21:44.800447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.800413    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5355c21e-4f3f-4b3b-8891-92a1d026f792-openshift-service-ca\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.800596 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.800524    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbc8\" (UniqueName: \"kubernetes.io/projected/5355c21e-4f3f-4b3b-8891-92a1d026f792-kube-api-access-4xbc8\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.800650 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.800599    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-metrics-certs\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.800688 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.800654    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-maas-api-tls\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.902168 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.902133    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-metrics-certs\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.902343 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.902191    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-maas-api-tls\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.902343 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.902276    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5355c21e-4f3f-4b3b-8891-92a1d026f792-openshift-service-ca\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.902438 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.902347    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbc8\" (UniqueName: \"kubernetes.io/projected/5355c21e-4f3f-4b3b-8891-92a1d026f792-kube-api-access-4xbc8\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.902926 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.902900    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5355c21e-4f3f-4b3b-8891-92a1d026f792-openshift-service-ca\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.904588 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.904568    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-maas-api-tls\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.904664 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.904634    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-metrics-certs\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:44.910157 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:44.910139    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbc8\" (UniqueName: \"kubernetes.io/projected/5355c21e-4f3f-4b3b-8891-92a1d026f792-kube-api-access-4xbc8\") pod \"maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:45.079925 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:45.079829    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:45.358860 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:21:45.358813    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5355c21e_4f3f_4b3b_8891_92a1d026f792.slice/crio-be3ca1cb7295ff9c8d01f58c4955705d1a3f2b185de83b892b851b5fb6950178 WatchSource:0}: Error finding container be3ca1cb7295ff9c8d01f58c4955705d1a3f2b185de83b892b851b5fb6950178: Status 404 returned error can't find the container with id be3ca1cb7295ff9c8d01f58c4955705d1a3f2b185de83b892b851b5fb6950178
Sep 15 09:21:45.358860 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:45.358816    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"]
Sep 15 09:21:46.153471 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:46.153379    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5" event={"ID":"5355c21e-4f3f-4b3b-8891-92a1d026f792","Type":"ContainerStarted","Data":"d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310"}
Sep 15 09:21:46.153471 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:46.153437    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5" event={"ID":"5355c21e-4f3f-4b3b-8891-92a1d026f792","Type":"ContainerStarted","Data":"be3ca1cb7295ff9c8d01f58c4955705d1a3f2b185de83b892b851b5fb6950178"}
Sep 15 09:21:46.153471 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:46.153473    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:21:46.172055 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:46.172006    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5" podStartSLOduration=1.800479672 podStartE2EDuration="2.171989136s" totalImagesPullingTime="371.509464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:46.168987886 +0000 UTC m=+893.758812234" watchObservedRunningTime="2026-09-15 09:21:46.171989136 +0000 UTC m=+893.761813483"
Sep 15 09:21:52.165116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:21:52.165082    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:22:07.260637 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.260597    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"]
Sep 15 09:22:07.263105 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.260932    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5" podUID="5355c21e-4f3f-4b3b-8891-92a1d026f792" containerName="maas-api" containerID="cri-o://d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310" gracePeriod=30
Sep 15 09:22:07.509912 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.509886    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:22:07.645299 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.645206    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xbc8\" (UniqueName: \"kubernetes.io/projected/5355c21e-4f3f-4b3b-8891-92a1d026f792-kube-api-access-4xbc8\") pod \"5355c21e-4f3f-4b3b-8891-92a1d026f792\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") "
Sep 15 09:22:07.645299 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.645253    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-metrics-certs\") pod \"5355c21e-4f3f-4b3b-8891-92a1d026f792\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") "
Sep 15 09:22:07.645299 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.645272    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-maas-api-tls\") pod \"5355c21e-4f3f-4b3b-8891-92a1d026f792\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") "
Sep 15 09:22:07.645299 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.645291    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5355c21e-4f3f-4b3b-8891-92a1d026f792-openshift-service-ca\") pod \"5355c21e-4f3f-4b3b-8891-92a1d026f792\" (UID: \"5355c21e-4f3f-4b3b-8891-92a1d026f792\") "
Sep 15 09:22:07.645799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.645764    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5355c21e-4f3f-4b3b-8891-92a1d026f792-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5355c21e-4f3f-4b3b-8891-92a1d026f792" (UID: "5355c21e-4f3f-4b3b-8891-92a1d026f792"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:22:07.647957 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.647908    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5355c21e-4f3f-4b3b-8891-92a1d026f792-kube-api-access-4xbc8" (OuterVolumeSpecName: "kube-api-access-4xbc8") pod "5355c21e-4f3f-4b3b-8891-92a1d026f792" (UID: "5355c21e-4f3f-4b3b-8891-92a1d026f792"). InnerVolumeSpecName "kube-api-access-4xbc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:22:07.648297 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.648260    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5355c21e-4f3f-4b3b-8891-92a1d026f792" (UID: "5355c21e-4f3f-4b3b-8891-92a1d026f792"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:22:07.648813 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.648777    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5355c21e-4f3f-4b3b-8891-92a1d026f792" (UID: "5355c21e-4f3f-4b3b-8891-92a1d026f792"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:22:07.746834 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.746798    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xbc8\" (UniqueName: \"kubernetes.io/projected/5355c21e-4f3f-4b3b-8891-92a1d026f792-kube-api-access-4xbc8\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:22:07.746834 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.746832    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:22:07.746834 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.746841    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5355c21e-4f3f-4b3b-8891-92a1d026f792-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:22:07.747156 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:07.746881    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5355c21e-4f3f-4b3b-8891-92a1d026f792-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:22:08.290902 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.290865    2555 generic.go:356] "Generic (PLEG): container finished" podID="5355c21e-4f3f-4b3b-8891-92a1d026f792" containerID="d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310" exitCode=0
Sep 15 09:22:08.291311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.290910    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"
Sep 15 09:22:08.291311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.290942    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5" event={"ID":"5355c21e-4f3f-4b3b-8891-92a1d026f792","Type":"ContainerDied","Data":"d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310"}
Sep 15 09:22:08.291311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.290998    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5" event={"ID":"5355c21e-4f3f-4b3b-8891-92a1d026f792","Type":"ContainerDied","Data":"be3ca1cb7295ff9c8d01f58c4955705d1a3f2b185de83b892b851b5fb6950178"}
Sep 15 09:22:08.291311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.291020    2555 scope.go:117] "RemoveContainer" containerID="d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310"
Sep 15 09:22:08.303649 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.303632    2555 scope.go:117] "RemoveContainer" containerID="d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310"
Sep 15 09:22:08.303946 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:22:08.303928    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310\": container with ID starting with d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310 not found: ID does not exist" containerID="d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310"
Sep 15 09:22:08.304010 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.303957    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310"} err="failed to get container status \"d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310\": rpc error: code = NotFound desc = could not find container \"d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310\": container with ID starting with d1c54fee0c244002ad5412b843187e18d1ec174a4a8d0af0c97b482c6bc57310 not found: ID does not exist"
Sep 15 09:22:08.316504 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.316475    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"]
Sep 15 09:22:08.320592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.320566    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a01e15d8-6f4cf7bc87-p2gm5"]
Sep 15 09:22:08.957714 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:08.957682    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5355c21e-4f3f-4b3b-8891-92a1d026f792" path="/var/lib/kubelet/pods/5355c21e-4f3f-4b3b-8891-92a1d026f792/volumes"
Sep 15 09:22:54.404394 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.403580    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"]
Sep 15 09:22:54.404394 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.404392    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5355c21e-4f3f-4b3b-8891-92a1d026f792" containerName="maas-api"
Sep 15 09:22:54.405048 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.404413    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5355c21e-4f3f-4b3b-8891-92a1d026f792" containerName="maas-api"
Sep 15 09:22:54.405048 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.404588    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5355c21e-4f3f-4b3b-8891-92a1d026f792" containerName="maas-api"
Sep 15 09:22:54.409042 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.409020    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.411819 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.411795    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2430e2\"/\"openshift-service-ca.crt\""
Sep 15 09:22:54.411819 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.411814    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2430e2\"/\"default-dockercfg-w655h\""
Sep 15 09:22:54.412808 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.412781    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2430e2\"/\"kube-root-ca.crt\""
Sep 15 09:22:54.420301 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.413497    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2430e2\"/\"test-model-2430e2-kserve-self-signed-certs\""
Sep 15 09:22:54.425433 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.425401    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"]
Sep 15 09:22:54.510622 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.510581    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-home\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.510622 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.510623    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tmp-dir\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.510918 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.510651    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckwd2\" (UniqueName: \"kubernetes.io/projected/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-kube-api-access-ckwd2\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.510918 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.510695    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-dshm\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.510918 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.510785    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tls-certs\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.510918 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.510819    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-model-cache\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.612389 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.612353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tls-certs\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.612389 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.612387    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-model-cache\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.612600 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.612434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-home\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.612600 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.612450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tmp-dir\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.612600 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.612475    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckwd2\" (UniqueName: \"kubernetes.io/projected/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-kube-api-access-ckwd2\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.612600 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.612518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-dshm\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.612946 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.612922    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tmp-dir\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.613010 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.612935    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-home\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.613046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.612998    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-model-cache\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.614639 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.614623    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-dshm\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.615001 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.614985    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tls-certs\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.621213 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.621190    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckwd2\" (UniqueName: \"kubernetes.io/projected/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-kube-api-access-ckwd2\") pod \"test-model-2430e2-kserve-649f7ff445-7tpc5\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") " pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:54.728751 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:54.728718    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:22:55.005717 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:55.005691    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"]
Sep 15 09:22:55.007271 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:22:55.007242    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d1ef1cc_ea36_4cef_8b78_c3633d860e38.slice/crio-3d1170b98273226731b03e4ef2bcfc06394b0f82766901aad60a1a4238586efc WatchSource:0}: Error finding container 3d1170b98273226731b03e4ef2bcfc06394b0f82766901aad60a1a4238586efc: Status 404 returned error can't find the container with id 3d1170b98273226731b03e4ef2bcfc06394b0f82766901aad60a1a4238586efc
Sep 15 09:22:55.593016 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:55.592980    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5" event={"ID":"3d1ef1cc-ea36-4cef-8b78-c3633d860e38","Type":"ContainerStarted","Data":"1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955"}
Sep 15 09:22:55.593016 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:55.593024    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5" event={"ID":"3d1ef1cc-ea36-4cef-8b78-c3633d860e38","Type":"ContainerStarted","Data":"3d1170b98273226731b03e4ef2bcfc06394b0f82766901aad60a1a4238586efc"}
Sep 15 09:22:55.610636 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:22:55.610589    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5" podStartSLOduration=1.6105726219999998 podStartE2EDuration="1.610572622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:22:55.60810365 +0000 UTC m=+963.197927996" watchObservedRunningTime="2026-09-15 09:22:55.610572622 +0000 UTC m=+963.200396970"
Sep 15 09:23:04.729163 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:04.729130    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:23:04.729735 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:04.729180    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:23:04.741945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:04.741921    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:23:05.676142 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:05.676110    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:23:50.856239 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:50.856204    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"]
Sep 15 09:23:50.860266 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:50.860207    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:50.863048 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:50.863024    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7ce8ca0e-serving-cert\""
Sep 15 09:23:50.871440 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:50.871413    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"]
Sep 15 09:23:50.976815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:50.976787    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-metrics-certs\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:50.976815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:50.976819    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442q5\" (UniqueName: \"kubernetes.io/projected/d9bc63b6-52bf-471d-93e5-8aa56330bda3-kube-api-access-442q5\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:50.977030 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:50.976963    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:50.977030 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:50.977006    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc63b6-52bf-471d-93e5-8aa56330bda3-openshift-service-ca\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:51.078151 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.078110    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:51.078322 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.078162    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc63b6-52bf-471d-93e5-8aa56330bda3-openshift-service-ca\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:51.078322 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.078243    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-metrics-certs\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:51.078322 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.078265    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-442q5\" (UniqueName: \"kubernetes.io/projected/d9bc63b6-52bf-471d-93e5-8aa56330bda3-kube-api-access-442q5\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:51.078322 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:23:51.078282    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-serving-cert: secret "maas-api-e2e-mt-7ce8ca0e-serving-cert" not found
Sep 15 09:23:51.078489 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:23:51.078377    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls podName:d9bc63b6-52bf-471d-93e5-8aa56330bda3 nodeName:}" failed. No retries permitted until 2026-09-15 09:23:51.578356355 +0000 UTC m=+1019.168180700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls") pod "maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc" (UID: "d9bc63b6-52bf-471d-93e5-8aa56330bda3") : secret "maas-api-e2e-mt-7ce8ca0e-serving-cert" not found
Sep 15 09:23:51.079002 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.078986    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc63b6-52bf-471d-93e5-8aa56330bda3-openshift-service-ca\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:51.080618 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.080590    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-metrics-certs\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:51.088620 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.088597    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-442q5\" (UniqueName: \"kubernetes.io/projected/d9bc63b6-52bf-471d-93e5-8aa56330bda3-kube-api-access-442q5\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:51.566017 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.565986    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"]
Sep 15 09:23:51.570042 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.570022    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:23:51.572448 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.572429    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7ce8ca0e-dockercfg-fg2j5\""
Sep 15 09:23:51.572563 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.572434    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7ce8ca0e\""
Sep 15 09:23:51.578358 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.578326    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"]
Sep 15 09:23:51.583676 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.583655    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:51.583822 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:23:51.583805    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-serving-cert: secret "maas-api-e2e-mt-7ce8ca0e-serving-cert" not found
Sep 15 09:23:51.583905 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:23:51.583894    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls podName:d9bc63b6-52bf-471d-93e5-8aa56330bda3 nodeName:}" failed. No retries permitted until 2026-09-15 09:23:52.583875906 +0000 UTC m=+1020.173700254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls") pod "maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc" (UID: "d9bc63b6-52bf-471d-93e5-8aa56330bda3") : secret "maas-api-e2e-mt-7ce8ca0e-serving-cert" not found
Sep 15 09:23:51.684751 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.684710    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwvl\" (UniqueName: \"kubernetes.io/projected/d45cd795-1656-432b-8705-07d94a194ec0-kube-api-access-pnwvl\") pod \"payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv\" (UID: \"d45cd795-1656-432b-8705-07d94a194ec0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:23:51.684953 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.684902    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d45cd795-1656-432b-8705-07d94a194ec0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv\" (UID: \"d45cd795-1656-432b-8705-07d94a194ec0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:23:51.786206 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.786173    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d45cd795-1656-432b-8705-07d94a194ec0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv\" (UID: \"d45cd795-1656-432b-8705-07d94a194ec0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:23:51.786372 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.786267    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwvl\" (UniqueName: \"kubernetes.io/projected/d45cd795-1656-432b-8705-07d94a194ec0-kube-api-access-pnwvl\") pod \"payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv\" (UID: \"d45cd795-1656-432b-8705-07d94a194ec0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:23:51.786897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.786877    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d45cd795-1656-432b-8705-07d94a194ec0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv\" (UID: \"d45cd795-1656-432b-8705-07d94a194ec0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:23:51.795361 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.795330    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwvl\" (UniqueName: \"kubernetes.io/projected/d45cd795-1656-432b-8705-07d94a194ec0-kube-api-access-pnwvl\") pod \"payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv\" (UID: \"d45cd795-1656-432b-8705-07d94a194ec0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:23:51.883030 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:51.882960    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:23:52.158764 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.158736    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"]
Sep 15 09:23:52.160168 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:23:52.160143    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45cd795_1656_432b_8705_07d94a194ec0.slice/crio-5c7bc156aa7d59c002c470f92dad16bb722235d9831546d282ed337a8d30fbc7 WatchSource:0}: Error finding container 5c7bc156aa7d59c002c470f92dad16bb722235d9831546d282ed337a8d30fbc7: Status 404 returned error can't find the container with id 5c7bc156aa7d59c002c470f92dad16bb722235d9831546d282ed337a8d30fbc7
Sep 15 09:23:52.596536 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.596494    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:52.599029 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.599010    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls\") pod \"maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:52.673489 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.673455    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:23:52.957487 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:23:52.957439    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bc63b6_52bf_471d_93e5_8aa56330bda3.slice/crio-3cf816f42b59b46e5bbd96cee6a40b8e2435427f55b423bbcac20d95aad08257 WatchSource:0}: Error finding container 3cf816f42b59b46e5bbd96cee6a40b8e2435427f55b423bbcac20d95aad08257: Status 404 returned error can't find the container with id 3cf816f42b59b46e5bbd96cee6a40b8e2435427f55b423bbcac20d95aad08257
Sep 15 09:23:52.959070 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.959040    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:23:52.960343 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.960319    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"]
Sep 15 09:23:52.968157 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.968133    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc" event={"ID":"d9bc63b6-52bf-471d-93e5-8aa56330bda3","Type":"ContainerStarted","Data":"3cf816f42b59b46e5bbd96cee6a40b8e2435427f55b423bbcac20d95aad08257"}
Sep 15 09:23:52.969657 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.969635    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv" event={"ID":"d45cd795-1656-432b-8705-07d94a194ec0","Type":"ContainerStarted","Data":"9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b"}
Sep 15 09:23:52.969766 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.969674    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv" event={"ID":"d45cd795-1656-432b-8705-07d94a194ec0","Type":"ContainerStarted","Data":"5c7bc156aa7d59c002c470f92dad16bb722235d9831546d282ed337a8d30fbc7"}
Sep 15 09:23:52.969766 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.969753    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:23:52.985056 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:52.984995    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv" podStartSLOduration=1.9849774340000002 podStartE2EDuration="1.984977434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:52.984017166 +0000 UTC m=+1020.573841513" watchObservedRunningTime="2026-09-15 09:23:52.984977434 +0000 UTC m=+1020.574801785"
Sep 15 09:23:53.977382 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:53.977345    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc" event={"ID":"d9bc63b6-52bf-471d-93e5-8aa56330bda3","Type":"ContainerStarted","Data":"933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e"}
Sep 15 09:23:53.997043 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:53.996991    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc" podStartSLOduration=3.630250808 podStartE2EDuration="3.996976708s" totalImagesPullingTime="366.7259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:53.993901546 +0000 UTC m=+1021.583725895" watchObservedRunningTime="2026-09-15 09:23:53.996976708 +0000 UTC m=+1021.586801055"
Sep 15 09:23:54.989607 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:23:54.989572    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:24:01.001359 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:01.001330    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:24:03.980446 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:03.980409    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:24:28.716736 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:28.716698    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"]
Sep 15 09:24:28.717217 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:28.716995    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc" podUID="d9bc63b6-52bf-471d-93e5-8aa56330bda3" containerName="maas-api" containerID="cri-o://933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e" gracePeriod=30
Sep 15 09:24:28.779664 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:28.779629    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"]
Sep 15 09:24:28.779933 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:28.779883    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv" podUID="d45cd795-1656-432b-8705-07d94a194ec0" containerName="payload-pre-processing" containerID="cri-o://9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b" gracePeriod=30
Sep 15 09:24:29.035332 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.035309    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:24:29.074303 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.074279    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:24:29.160102 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.160069    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls\") pod \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") "
Sep 15 09:24:29.160102 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.160114    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-442q5\" (UniqueName: \"kubernetes.io/projected/d9bc63b6-52bf-471d-93e5-8aa56330bda3-kube-api-access-442q5\") pod \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") "
Sep 15 09:24:29.160336 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.160134    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc63b6-52bf-471d-93e5-8aa56330bda3-openshift-service-ca\") pod \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") "
Sep 15 09:24:29.160336 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.160281    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-metrics-certs\") pod \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\" (UID: \"d9bc63b6-52bf-471d-93e5-8aa56330bda3\") "
Sep 15 09:24:29.160593 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.160565    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9bc63b6-52bf-471d-93e5-8aa56330bda3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9bc63b6-52bf-471d-93e5-8aa56330bda3" (UID: "d9bc63b6-52bf-471d-93e5-8aa56330bda3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:24:29.162316 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.162291    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9bc63b6-52bf-471d-93e5-8aa56330bda3" (UID: "d9bc63b6-52bf-471d-93e5-8aa56330bda3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:24:29.162382 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.162327    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d9bc63b6-52bf-471d-93e5-8aa56330bda3" (UID: "d9bc63b6-52bf-471d-93e5-8aa56330bda3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:24:29.162424 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.162378    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9bc63b6-52bf-471d-93e5-8aa56330bda3-kube-api-access-442q5" (OuterVolumeSpecName: "kube-api-access-442q5") pod "d9bc63b6-52bf-471d-93e5-8aa56330bda3" (UID: "d9bc63b6-52bf-471d-93e5-8aa56330bda3"). InnerVolumeSpecName "kube-api-access-442q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:29.209252 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.209213    2555 generic.go:356] "Generic (PLEG): container finished" podID="d9bc63b6-52bf-471d-93e5-8aa56330bda3" containerID="933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e" exitCode=0
Sep 15 09:24:29.209425 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.209263    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"
Sep 15 09:24:29.209425 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.209296    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc" event={"ID":"d9bc63b6-52bf-471d-93e5-8aa56330bda3","Type":"ContainerDied","Data":"933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e"}
Sep 15 09:24:29.209425 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.209350    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc" event={"ID":"d9bc63b6-52bf-471d-93e5-8aa56330bda3","Type":"ContainerDied","Data":"3cf816f42b59b46e5bbd96cee6a40b8e2435427f55b423bbcac20d95aad08257"}
Sep 15 09:24:29.209425 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.209376    2555 scope.go:117] "RemoveContainer" containerID="933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e"
Sep 15 09:24:29.210824 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.210798    2555 generic.go:356] "Generic (PLEG): container finished" podID="d45cd795-1656-432b-8705-07d94a194ec0" containerID="9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b" exitCode=0
Sep 15 09:24:29.210976 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.210837    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"
Sep 15 09:24:29.210976 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.210885    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv" event={"ID":"d45cd795-1656-432b-8705-07d94a194ec0","Type":"ContainerDied","Data":"9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b"}
Sep 15 09:24:29.210976 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.210929    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv" event={"ID":"d45cd795-1656-432b-8705-07d94a194ec0","Type":"ContainerDied","Data":"5c7bc156aa7d59c002c470f92dad16bb722235d9831546d282ed337a8d30fbc7"}
Sep 15 09:24:29.219940 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.219923    2555 scope.go:117] "RemoveContainer" containerID="933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e"
Sep 15 09:24:29.220191 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:24:29.220173    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e\": container with ID starting with 933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e not found: ID does not exist" containerID="933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e"
Sep 15 09:24:29.220257 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.220197    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e"} err="failed to get container status \"933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e\": rpc error: code = NotFound desc = could not find container \"933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e\": container with ID starting with 933d30d39cf8015943951534b838396e715a3b59ee675cab96678e42fe0aff8e not found: ID does not exist"
Sep 15 09:24:29.220257 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.220212    2555 scope.go:117] "RemoveContainer" containerID="9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b"
Sep 15 09:24:29.228606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.228589    2555 scope.go:117] "RemoveContainer" containerID="9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b"
Sep 15 09:24:29.228902 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:24:29.228883    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b\": container with ID starting with 9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b not found: ID does not exist" containerID="9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b"
Sep 15 09:24:29.228949 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.228909    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b"} err="failed to get container status \"9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b\": rpc error: code = NotFound desc = could not find container \"9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b\": container with ID starting with 9b80b4544f99180a2e952caf37347b5a267d78631a2bd5dc877da23fb5d0839b not found: ID does not exist"
Sep 15 09:24:29.232485 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.232464    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"]
Sep 15 09:24:29.238516 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.238496    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7ce8ca0e-8fd77b4d6-8pgwc"]
Sep 15 09:24:29.261628 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.261562    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d45cd795-1656-432b-8705-07d94a194ec0-plugins-config-volume\") pod \"d45cd795-1656-432b-8705-07d94a194ec0\" (UID: \"d45cd795-1656-432b-8705-07d94a194ec0\") "
Sep 15 09:24:29.261743 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.261634    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnwvl\" (UniqueName: \"kubernetes.io/projected/d45cd795-1656-432b-8705-07d94a194ec0-kube-api-access-pnwvl\") pod \"d45cd795-1656-432b-8705-07d94a194ec0\" (UID: \"d45cd795-1656-432b-8705-07d94a194ec0\") "
Sep 15 09:24:29.261904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.261890    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:24:29.261904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.261903    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bc63b6-52bf-471d-93e5-8aa56330bda3-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:24:29.262021 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.261913    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-442q5\" (UniqueName: \"kubernetes.io/projected/d9bc63b6-52bf-471d-93e5-8aa56330bda3-kube-api-access-442q5\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:24:29.262021 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.261926    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bc63b6-52bf-471d-93e5-8aa56330bda3-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:24:29.262021 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.261966    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d45cd795-1656-432b-8705-07d94a194ec0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d45cd795-1656-432b-8705-07d94a194ec0" (UID: "d45cd795-1656-432b-8705-07d94a194ec0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:24:29.263594 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.263576    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45cd795-1656-432b-8705-07d94a194ec0-kube-api-access-pnwvl" (OuterVolumeSpecName: "kube-api-access-pnwvl") pod "d45cd795-1656-432b-8705-07d94a194ec0" (UID: "d45cd795-1656-432b-8705-07d94a194ec0"). InnerVolumeSpecName "kube-api-access-pnwvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:29.363270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.363234    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d45cd795-1656-432b-8705-07d94a194ec0-plugins-config-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:24:29.363270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.363265    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnwvl\" (UniqueName: \"kubernetes.io/projected/d45cd795-1656-432b-8705-07d94a194ec0-kube-api-access-pnwvl\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:24:29.533217 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.533184    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"]
Sep 15 09:24:29.535835 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:29.535812    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv"]
Sep 15 09:24:30.956043 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:30.956012    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d45cd795-1656-432b-8705-07d94a194ec0" path="/var/lib/kubelet/pods/d45cd795-1656-432b-8705-07d94a194ec0/volumes"
Sep 15 09:24:30.956435 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:30.956421    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9bc63b6-52bf-471d-93e5-8aa56330bda3" path="/var/lib/kubelet/pods/d9bc63b6-52bf-471d-93e5-8aa56330bda3/volumes"
Sep 15 09:24:55.844202 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.844164    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"]
Sep 15 09:24:55.844956 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.844930    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45cd795-1656-432b-8705-07d94a194ec0" containerName="payload-pre-processing"
Sep 15 09:24:55.845136 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.845112    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45cd795-1656-432b-8705-07d94a194ec0" containerName="payload-pre-processing"
Sep 15 09:24:55.845256 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.845141    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9bc63b6-52bf-471d-93e5-8aa56330bda3" containerName="maas-api"
Sep 15 09:24:55.845256 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.845151    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bc63b6-52bf-471d-93e5-8aa56330bda3" containerName="maas-api"
Sep 15 09:24:55.845379 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.845352    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45cd795-1656-432b-8705-07d94a194ec0" containerName="payload-pre-processing"
Sep 15 09:24:55.845379 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.845366    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9bc63b6-52bf-471d-93e5-8aa56330bda3" containerName="maas-api"
Sep 15 09:24:55.855206 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.855178    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:55.859135 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.859113    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"]
Sep 15 09:24:55.859457 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.859385    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-577f23-serving-cert\""
Sep 15 09:24:55.932485 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.932453    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll7k6\" (UniqueName: \"kubernetes.io/projected/08cc102d-879c-408d-9ced-6190c62a7466-kube-api-access-ll7k6\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:55.932657 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.932528    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:55.932657 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.932584    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:55.932737 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:55.932668    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08cc102d-879c-408d-9ced-6190c62a7466-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.033902 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.033868    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.034073 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.033942    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.034073 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.033975    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08cc102d-879c-408d-9ced-6190c62a7466-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.034165 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.034115    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll7k6\" (UniqueName: \"kubernetes.io/projected/08cc102d-879c-408d-9ced-6190c62a7466-kube-api-access-ll7k6\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.034712 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.034685    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08cc102d-879c-408d-9ced-6190c62a7466-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.036493 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.036456    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.036493 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.036478    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.041523 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.041505    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll7k6\" (UniqueName: \"kubernetes.io/projected/08cc102d-879c-408d-9ced-6190c62a7466-kube-api-access-ll7k6\") pod \"maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.169578 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.169499    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:56.449052 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.449021    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"]
Sep 15 09:24:56.450977 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:24:56.450942    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cc102d_879c_408d_9ced_6190c62a7466.slice/crio-ee94295541c4c5297a4751e6e127d98606835167a48f905e8375c7c9f5b63806 WatchSource:0}: Error finding container ee94295541c4c5297a4751e6e127d98606835167a48f905e8375c7c9f5b63806: Status 404 returned error can't find the container with id ee94295541c4c5297a4751e6e127d98606835167a48f905e8375c7c9f5b63806
Sep 15 09:24:56.520393 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.520359    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"]
Sep 15 09:24:56.525171 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.525150    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:24:56.527885 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.527840    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-577f23\""
Sep 15 09:24:56.528110 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.528096    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-577f23-dockercfg-vvcmz\""
Sep 15 09:24:56.534314 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.534281    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"]
Sep 15 09:24:56.640583 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.640542    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2d9eb67-d112-4693-9a9a-2357946c2157-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g\" (UID: \"d2d9eb67-d112-4693-9a9a-2357946c2157\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:24:56.640757 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.640682    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjwkr\" (UniqueName: \"kubernetes.io/projected/d2d9eb67-d112-4693-9a9a-2357946c2157-kube-api-access-rjwkr\") pod \"payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g\" (UID: \"d2d9eb67-d112-4693-9a9a-2357946c2157\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:24:56.741275 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.741234    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2d9eb67-d112-4693-9a9a-2357946c2157-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g\" (UID: \"d2d9eb67-d112-4693-9a9a-2357946c2157\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:24:56.741447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.741357    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjwkr\" (UniqueName: \"kubernetes.io/projected/d2d9eb67-d112-4693-9a9a-2357946c2157-kube-api-access-rjwkr\") pod \"payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g\" (UID: \"d2d9eb67-d112-4693-9a9a-2357946c2157\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:24:56.741965 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.741944    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2d9eb67-d112-4693-9a9a-2357946c2157-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g\" (UID: \"d2d9eb67-d112-4693-9a9a-2357946c2157\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:24:56.750528 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.750500    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjwkr\" (UniqueName: \"kubernetes.io/projected/d2d9eb67-d112-4693-9a9a-2357946c2157-kube-api-access-rjwkr\") pod \"payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g\" (UID: \"d2d9eb67-d112-4693-9a9a-2357946c2157\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:24:56.838984 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:56.838944    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:24:57.114447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:57.114420    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"]
Sep 15 09:24:57.116575 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:24:57.116539    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d9eb67_d112_4693_9a9a_2357946c2157.slice/crio-afa2b085535dbcb1b697deb76a7b8d39b5f20ffac5eaa83d5a90e00d645d555a WatchSource:0}: Error finding container afa2b085535dbcb1b697deb76a7b8d39b5f20ffac5eaa83d5a90e00d645d555a: Status 404 returned error can't find the container with id afa2b085535dbcb1b697deb76a7b8d39b5f20ffac5eaa83d5a90e00d645d555a
Sep 15 09:24:57.396676 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:57.396584    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g" event={"ID":"d2d9eb67-d112-4693-9a9a-2357946c2157","Type":"ContainerStarted","Data":"f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9"}
Sep 15 09:24:57.396676 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:57.396643    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g" event={"ID":"d2d9eb67-d112-4693-9a9a-2357946c2157","Type":"ContainerStarted","Data":"afa2b085535dbcb1b697deb76a7b8d39b5f20ffac5eaa83d5a90e00d645d555a"}
Sep 15 09:24:57.396954 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:57.396767    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:24:57.398259 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:57.398237    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc" event={"ID":"08cc102d-879c-408d-9ced-6190c62a7466","Type":"ContainerStarted","Data":"47f35951cd00fd3ba3917c2e8cce9a0f3cdcd91ff14ae570886784258c351717"}
Sep 15 09:24:57.398348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:57.398272    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc" event={"ID":"08cc102d-879c-408d-9ced-6190c62a7466","Type":"ContainerStarted","Data":"ee94295541c4c5297a4751e6e127d98606835167a48f905e8375c7c9f5b63806"}
Sep 15 09:24:57.398348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:57.398328    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:24:57.414888 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:57.414830    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g" podStartSLOduration=1.414817193 podStartE2EDuration="1.414817193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:57.413171606 +0000 UTC m=+1085.002995955" watchObservedRunningTime="2026-09-15 09:24:57.414817193 +0000 UTC m=+1085.004641542"
Sep 15 09:24:57.430608 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:24:57.430573    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc" podStartSLOduration=2.000980514 podStartE2EDuration="2.430561297s" totalImagesPullingTime="429.580783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:57.429380929 +0000 UTC m=+1085.019205276" watchObservedRunningTime="2026-09-15 09:24:57.430561297 +0000 UTC m=+1085.020385680"
Sep 15 09:25:03.410603 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:03.410571    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:25:08.407906 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:08.407865    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:25:38.526402 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.526363    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"]
Sep 15 09:25:38.526931 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.526611    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr" podUID="acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" containerName="maas-api" containerID="cri-o://d758042fb573852d47215371ac05eb1713c6b13fdd765952588568d0b983accb" gracePeriod=30
Sep 15 09:25:38.580815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.580784    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"]
Sep 15 09:25:38.581064 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.581036    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb" podUID="da622f5a-d6eb-4976-beaf-7f2cd33bd2e6" containerName="payload-processing" containerID="cri-o://740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104" gracePeriod=30
Sep 15 09:25:38.669112 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.669078    2555 generic.go:356] "Generic (PLEG): container finished" podID="acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" containerID="d758042fb573852d47215371ac05eb1713c6b13fdd765952588568d0b983accb" exitCode=0
Sep 15 09:25:38.669265 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.669153    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr" event={"ID":"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40","Type":"ContainerDied","Data":"d758042fb573852d47215371ac05eb1713c6b13fdd765952588568d0b983accb"}
Sep 15 09:25:38.829297 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.829271    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:25:38.865497 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.865475    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:25:38.959971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.959941    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-openshift-service-ca\") pod \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") "
Sep 15 09:25:38.960123 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.959994    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8ltl\" (UniqueName: \"kubernetes.io/projected/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-kube-api-access-k8ltl\") pod \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\" (UID: \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\") "
Sep 15 09:25:38.960123 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.960023    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwqrk\" (UniqueName: \"kubernetes.io/projected/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-kube-api-access-hwqrk\") pod \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") "
Sep 15 09:25:38.960253 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.960129    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-metrics-certs\") pod \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") "
Sep 15 09:25:38.960253 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.960155    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-plugins-config-volume\") pod \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\" (UID: \"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6\") "
Sep 15 09:25:38.960253 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.960193    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-maas-api-tls\") pod \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\" (UID: \"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40\") "
Sep 15 09:25:38.960413 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.960354    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" (UID: "acb1b2ab-e9a2-48b8-a584-9ecef7a19b40"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:25:38.960552 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.960527    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:38.960614 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.960585    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da622f5a-d6eb-4976-beaf-7f2cd33bd2e6" (UID: "da622f5a-d6eb-4976-beaf-7f2cd33bd2e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:25:38.962441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.962409    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" (UID: "acb1b2ab-e9a2-48b8-a584-9ecef7a19b40"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:25:38.962590 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.962534    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-kube-api-access-k8ltl" (OuterVolumeSpecName: "kube-api-access-k8ltl") pod "da622f5a-d6eb-4976-beaf-7f2cd33bd2e6" (UID: "da622f5a-d6eb-4976-beaf-7f2cd33bd2e6"). InnerVolumeSpecName "kube-api-access-k8ltl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:38.962651 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.962601    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-kube-api-access-hwqrk" (OuterVolumeSpecName: "kube-api-access-hwqrk") pod "acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" (UID: "acb1b2ab-e9a2-48b8-a584-9ecef7a19b40"). InnerVolumeSpecName "kube-api-access-hwqrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:38.962711 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:38.962690    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" (UID: "acb1b2ab-e9a2-48b8-a584-9ecef7a19b40"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:25:39.062149 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.062054    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:39.062149 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.062091    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-plugins-config-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:39.062149 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.062107    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:39.062149 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.062127    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8ltl\" (UniqueName: \"kubernetes.io/projected/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6-kube-api-access-k8ltl\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:39.062149 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.062143    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwqrk\" (UniqueName: \"kubernetes.io/projected/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40-kube-api-access-hwqrk\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:39.677148 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.677112    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"
Sep 15 09:25:39.677148 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.677128    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr" event={"ID":"acb1b2ab-e9a2-48b8-a584-9ecef7a19b40","Type":"ContainerDied","Data":"102ff34053408adffc00eb02b9817b8cee4d6d2ba06ee5413df341b575fb1786"}
Sep 15 09:25:39.677676 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.677197    2555 scope.go:117] "RemoveContainer" containerID="d758042fb573852d47215371ac05eb1713c6b13fdd765952588568d0b983accb"
Sep 15 09:25:39.678643 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.678535    2555 generic.go:356] "Generic (PLEG): container finished" podID="da622f5a-d6eb-4976-beaf-7f2cd33bd2e6" containerID="740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104" exitCode=0
Sep 15 09:25:39.678643 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.678581    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"
Sep 15 09:25:39.678643 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.678624    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb" event={"ID":"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6","Type":"ContainerDied","Data":"740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104"}
Sep 15 09:25:39.678810 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.678668    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb" event={"ID":"da622f5a-d6eb-4976-beaf-7f2cd33bd2e6","Type":"ContainerDied","Data":"d005ab27618d80243aa7da09c29db3f2a7bb847fe3537c2d07a7803bb80001b0"}
Sep 15 09:25:39.688552 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.688527    2555 scope.go:117] "RemoveContainer" containerID="740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104"
Sep 15 09:25:39.697395 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.697377    2555 scope.go:117] "RemoveContainer" containerID="740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104"
Sep 15 09:25:39.697656 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:39.697638    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104\": container with ID starting with 740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104 not found: ID does not exist" containerID="740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104"
Sep 15 09:25:39.697713 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.697663    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104"} err="failed to get container status \"740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104\": rpc error: code = NotFound desc = could not find container \"740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104\": container with ID starting with 740689da431b8b11824343df5789c5246bcc8f08aa606549ec05aec7cc315104 not found: ID does not exist"
Sep 15 09:25:39.706620 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.706598    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"]
Sep 15 09:25:39.712627 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.712609    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2430e2-57458f569-jzhsr"]
Sep 15 09:25:39.722544 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.722524    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"]
Sep 15 09:25:39.728295 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:39.728271    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb"]
Sep 15 09:25:40.964022 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:40.963982    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" path="/var/lib/kubelet/pods/acb1b2ab-e9a2-48b8-a584-9ecef7a19b40/volumes"
Sep 15 09:25:40.964512 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:40.964492    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da622f5a-d6eb-4976-beaf-7f2cd33bd2e6" path="/var/lib/kubelet/pods/da622f5a-d6eb-4976-beaf-7f2cd33bd2e6/volumes"
Sep 15 09:25:44.097576 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:44.097538    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"]
Sep 15 09:25:47.415469 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.415430    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7738-86f933"]
Sep 15 09:25:47.416138 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.416115    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da622f5a-d6eb-4976-beaf-7f2cd33bd2e6" containerName="payload-processing"
Sep 15 09:25:47.416264 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.416139    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="da622f5a-d6eb-4976-beaf-7f2cd33bd2e6" containerName="payload-processing"
Sep 15 09:25:47.416264 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.416153    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" containerName="maas-api"
Sep 15 09:25:47.416264 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.416161    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" containerName="maas-api"
Sep 15 09:25:47.416415 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.416292    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="acb1b2ab-e9a2-48b8-a584-9ecef7a19b40" containerName="maas-api"
Sep 15 09:25:47.416415 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.416306    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="da622f5a-d6eb-4976-beaf-7f2cd33bd2e6" containerName="payload-processing"
Sep 15 09:25:47.421021 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.420997    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:47.423372 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.423338    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-86f933"]
Sep 15 09:25:47.423681 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.423654    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7g2n6\""
Sep 15 09:25:47.437300 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.437277    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fczsz\" (UniqueName: \"kubernetes.io/projected/276c15c6-ca2e-467c-90c3-47f094e926f3-kube-api-access-fczsz\") pod \"test-curl-7738-86f933\" (UID: \"276c15c6-ca2e-467c-90c3-47f094e926f3\") " pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:47.538305 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.538270    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fczsz\" (UniqueName: \"kubernetes.io/projected/276c15c6-ca2e-467c-90c3-47f094e926f3-kube-api-access-fczsz\") pod \"test-curl-7738-86f933\" (UID: \"276c15c6-ca2e-467c-90c3-47f094e926f3\") " pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:47.546976 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.546946    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fczsz\" (UniqueName: \"kubernetes.io/projected/276c15c6-ca2e-467c-90c3-47f094e926f3-kube-api-access-fczsz\") pod \"test-curl-7738-86f933\" (UID: \"276c15c6-ca2e-467c-90c3-47f094e926f3\") " pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:47.733198 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:47.733171    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:48.005475 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:48.005447    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-86f933"]
Sep 15 09:25:48.007390 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:25:48.007358    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod276c15c6_ca2e_467c_90c3_47f094e926f3.slice/crio-0d9b19a3a596b4c4974d75c6c0538a5717979125c3e75832bf7cb8a73b7ee121 WatchSource:0}: Error finding container 0d9b19a3a596b4c4974d75c6c0538a5717979125c3e75832bf7cb8a73b7ee121: Status 404 returned error can't find the container with id 0d9b19a3a596b4c4974d75c6c0538a5717979125c3e75832bf7cb8a73b7ee121
Sep 15 09:25:48.736411 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:48.736372    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-86f933" event={"ID":"276c15c6-ca2e-467c-90c3-47f094e926f3","Type":"ContainerStarted","Data":"0d9b19a3a596b4c4974d75c6c0538a5717979125c3e75832bf7cb8a73b7ee121"}
Sep 15 09:25:50.753260 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:50.753216    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-86f933" event={"ID":"276c15c6-ca2e-467c-90c3-47f094e926f3","Type":"ContainerStarted","Data":"e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba"}
Sep 15 09:25:50.768724 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:50.768674    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7738-86f933" podStartSLOduration=1.6332835719999999 podStartE2EDuration="3.768659074s" totalImagesPullingTime="2.135375502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:50.767047919 +0000 UTC m=+1138.356872268" watchObservedRunningTime="2026-09-15 09:25:50.768659074 +0000 UTC m=+1138.358483446"
Sep 15 09:25:51.428274 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.428237    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7738-86f933"]
Sep 15 09:25:51.431492 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.431461    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7738-86f933"]
Sep 15 09:25:51.539889 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.539854    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7738-0205cb"]
Sep 15 09:25:51.540372 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.540357    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" containerName="test-curl-7738-86f933"
Sep 15 09:25:51.540417 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.540374    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" containerName="test-curl-7738-86f933"
Sep 15 09:25:51.540461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.540452    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" containerName="test-curl-7738-86f933"
Sep 15 09:25:51.543600 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.543585    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:51.554989 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.554960    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-0205cb"]
Sep 15 09:25:51.581412 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.581385    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thr6r\" (UniqueName: \"kubernetes.io/projected/2b0b09a0-8f99-44e0-9799-097497b2ad31-kube-api-access-thr6r\") pod \"test-curl-7738-0205cb\" (UID: \"2b0b09a0-8f99-44e0-9799-097497b2ad31\") " pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:51.682110 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.682072    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thr6r\" (UniqueName: \"kubernetes.io/projected/2b0b09a0-8f99-44e0-9799-097497b2ad31-kube-api-access-thr6r\") pod \"test-curl-7738-0205cb\" (UID: \"2b0b09a0-8f99-44e0-9799-097497b2ad31\") " pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:51.690368 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.690342    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thr6r\" (UniqueName: \"kubernetes.io/projected/2b0b09a0-8f99-44e0-9799-097497b2ad31-kube-api-access-thr6r\") pod \"test-curl-7738-0205cb\" (UID: \"2b0b09a0-8f99-44e0-9799-097497b2ad31\") " pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:51.760744 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:51.760710    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7738-86f933" container="test-curl-7738-86f933"
Sep 15 09:25:51.856105 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:51.856024    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:52.127295 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:52.127266    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-0205cb"]
Sep 15 09:25:52.128409 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:25:52.128377    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b0b09a0_8f99_44e0_9799_097497b2ad31.slice/crio-89235ad86026f0600268e2a5803b7e57a6b6fd6613be5ecdec3960ffdb9e143f WatchSource:0}: Error finding container 89235ad86026f0600268e2a5803b7e57a6b6fd6613be5ecdec3960ffdb9e143f: Status 404 returned error can't find the container with id 89235ad86026f0600268e2a5803b7e57a6b6fd6613be5ecdec3960ffdb9e143f
Sep 15 09:25:52.768897 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:52.768861    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-0205cb" event={"ID":"2b0b09a0-8f99-44e0-9799-097497b2ad31","Type":"ContainerStarted","Data":"d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303"}
Sep 15 09:25:52.769346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:52.768906    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-0205cb" event={"ID":"2b0b09a0-8f99-44e0-9799-097497b2ad31","Type":"ContainerStarted","Data":"89235ad86026f0600268e2a5803b7e57a6b6fd6613be5ecdec3960ffdb9e143f"}
Sep 15 09:25:52.769346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:52.769112    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7738-86f933" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" containerName="test-curl-7738-86f933" containerID="cri-o://e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba" gracePeriod=2
Sep 15 09:25:52.784006 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:52.783971    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-86f933\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:52.785233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:52.785190    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7738-0205cb" podStartSLOduration=1.785176522 podStartE2EDuration="1.785176522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:52.781928469 +0000 UTC m=+1140.371752819" watchObservedRunningTime="2026-09-15 09:25:52.785176522 +0000 UTC m=+1140.375000869"
Sep 15 09:25:52.955013 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:52.954976    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-86f933\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:53.374366 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.374332    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7738-0205cb"]
Sep 15 09:25:53.378960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.378930    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7738-0205cb"]
Sep 15 09:25:53.490877 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.490832    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7738-86f5fa"]
Sep 15 09:25:53.491352 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.491338    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0b09a0-8f99-44e0-9799-097497b2ad31" containerName="test-curl-7738-0205cb"
Sep 15 09:25:53.491394 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.491354    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0b09a0-8f99-44e0-9799-097497b2ad31" containerName="test-curl-7738-0205cb"
Sep 15 09:25:53.491460 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.491451    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b0b09a0-8f99-44e0-9799-097497b2ad31" containerName="test-curl-7738-0205cb"
Sep 15 09:25:53.495980 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.495963    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:53.500975 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.500949    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-86f5fa"]
Sep 15 09:25:53.599815 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.599778    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmvht\" (UniqueName: \"kubernetes.io/projected/46fa9664-d139-443e-9b1b-1bfa8819d469-kube-api-access-nmvht\") pod \"test-curl-7738-86f5fa\" (UID: \"46fa9664-d139-443e-9b1b-1bfa8819d469\") " pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:53.700488 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.700456    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvht\" (UniqueName: \"kubernetes.io/projected/46fa9664-d139-443e-9b1b-1bfa8819d469-kube-api-access-nmvht\") pod \"test-curl-7738-86f5fa\" (UID: \"46fa9664-d139-443e-9b1b-1bfa8819d469\") " pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:53.708065 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.708034    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmvht\" (UniqueName: \"kubernetes.io/projected/46fa9664-d139-443e-9b1b-1bfa8819d469-kube-api-access-nmvht\") pod \"test-curl-7738-86f5fa\" (UID: \"46fa9664-d139-443e-9b1b-1bfa8819d469\") " pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:53.775567 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:53.775493    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7738-0205cb" container="test-curl-7738-0205cb"
Sep 15 09:25:53.806783 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:53.806745    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:54.080068 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:54.080039    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-86f5fa"]
Sep 15 09:25:54.081718 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:25:54.081687    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46fa9664_d139_443e_9b1b_1bfa8819d469.slice/crio-cf142b3c74eb3b5ce3774e9a45cb0a74f9b4970456edaf3488fbc34657b8a90e WatchSource:0}: Error finding container cf142b3c74eb3b5ce3774e9a45cb0a74f9b4970456edaf3488fbc34657b8a90e: Status 404 returned error can't find the container with id cf142b3c74eb3b5ce3774e9a45cb0a74f9b4970456edaf3488fbc34657b8a90e
Sep 15 09:25:54.782988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:54.782959    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-86f5fa" event={"ID":"46fa9664-d139-443e-9b1b-1bfa8819d469","Type":"ContainerStarted","Data":"5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269"}
Sep 15 09:25:54.783377 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:54.783001    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-86f5fa" event={"ID":"46fa9664-d139-443e-9b1b-1bfa8819d469","Type":"ContainerStarted","Data":"cf142b3c74eb3b5ce3774e9a45cb0a74f9b4970456edaf3488fbc34657b8a90e"}
Sep 15 09:25:54.783377 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:54.783012    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7738-0205cb" podUID="2b0b09a0-8f99-44e0-9799-097497b2ad31" containerName="test-curl-7738-0205cb" containerID="cri-o://d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303" gracePeriod=2
Sep 15 09:25:54.796719 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:54.796675    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7738-86f5fa" podStartSLOduration=1.796660187 podStartE2EDuration="1.796660187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:54.795945276 +0000 UTC m=+1142.385769624" watchObservedRunningTime="2026-09-15 09:25:54.796660187 +0000 UTC m=+1142.386484559"
Sep 15 09:25:54.798106 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:54.798079    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-0205cb\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="2b0b09a0-8f99-44e0-9799-097497b2ad31" pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:54.800162 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:54.800128    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-0205cb\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="2b0b09a0-8f99-44e0-9799-097497b2ad31" pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:54.962253 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:54.962226    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:55.012861 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.012819    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fczsz\" (UniqueName: \"kubernetes.io/projected/276c15c6-ca2e-467c-90c3-47f094e926f3-kube-api-access-fczsz\") pod \"276c15c6-ca2e-467c-90c3-47f094e926f3\" (UID: \"276c15c6-ca2e-467c-90c3-47f094e926f3\") "
Sep 15 09:25:55.014784 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.014755    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276c15c6-ca2e-467c-90c3-47f094e926f3-kube-api-access-fczsz" (OuterVolumeSpecName: "kube-api-access-fczsz") pod "276c15c6-ca2e-467c-90c3-47f094e926f3" (UID: "276c15c6-ca2e-467c-90c3-47f094e926f3"). InnerVolumeSpecName "kube-api-access-fczsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:55.114444 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.114368    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fczsz\" (UniqueName: \"kubernetes.io/projected/276c15c6-ca2e-467c-90c3-47f094e926f3-kube-api-access-fczsz\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:55.381954 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.381876    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7738-86f5fa"]
Sep 15 09:25:55.386052 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.386021    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7738-86f5fa"]
Sep 15 09:25:55.502818 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.502782    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7738-5ef2ab"]
Sep 15 09:25:55.503276 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.503262    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fa9664-d139-443e-9b1b-1bfa8819d469" containerName="test-curl-7738-86f5fa"
Sep 15 09:25:55.503314 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.503278    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fa9664-d139-443e-9b1b-1bfa8819d469" containerName="test-curl-7738-86f5fa"
Sep 15 09:25:55.503379 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.503371    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="46fa9664-d139-443e-9b1b-1bfa8819d469" containerName="test-curl-7738-86f5fa"
Sep 15 09:25:55.506526 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.506511    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:25:55.512262 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.512236    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-5ef2ab"]
Sep 15 09:25:55.618448 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.618415    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v7wx\" (UniqueName: \"kubernetes.io/projected/ed1ff9a5-e266-455e-a02c-b2dcf19ac26e-kube-api-access-6v7wx\") pod \"test-curl-7738-5ef2ab\" (UID: \"ed1ff9a5-e266-455e-a02c-b2dcf19ac26e\") " pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:25:55.719244 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.719153    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v7wx\" (UniqueName: \"kubernetes.io/projected/ed1ff9a5-e266-455e-a02c-b2dcf19ac26e-kube-api-access-6v7wx\") pod \"test-curl-7738-5ef2ab\" (UID: \"ed1ff9a5-e266-455e-a02c-b2dcf19ac26e\") " pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:25:55.728408 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.728384    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v7wx\" (UniqueName: \"kubernetes.io/projected/ed1ff9a5-e266-455e-a02c-b2dcf19ac26e-kube-api-access-6v7wx\") pod \"test-curl-7738-5ef2ab\" (UID: \"ed1ff9a5-e266-455e-a02c-b2dcf19ac26e\") " pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:25:55.790287 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.790257    2555 generic.go:356] "Generic (PLEG): container finished" podID="276c15c6-ca2e-467c-90c3-47f094e926f3" containerID="e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba" exitCode=137
Sep 15 09:25:55.790680 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.790299    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:55.790680 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.790355    2555 scope.go:117] "RemoveContainer" containerID="e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba"
Sep 15 09:25:55.790680 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:55.790653    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7738-86f5fa" container="test-curl-7738-86f5fa"
Sep 15 09:25:55.800511 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.800496    2555 scope.go:117] "RemoveContainer" containerID="e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba"
Sep 15 09:25:55.800762 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:55.800746    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba\": container with ID starting with e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba not found: ID does not exist" containerID="e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba"
Sep 15 09:25:55.800822 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.800772    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba"} err="failed to get container status \"e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba\": rpc error: code = NotFound desc = could not find container \"e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba\": container with ID starting with e63cc15e1bdaf05768af388226598c33ead74823e03663e92ca9b8fbc1d398ba not found: ID does not exist"
Sep 15 09:25:55.801734 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:55.801715    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-86f933\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:55.817916 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:55.817895    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:25:56.090205 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:56.090176    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-5ef2ab"]
Sep 15 09:25:56.090834 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:25:56.090804    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded1ff9a5_e266_455e_a02c_b2dcf19ac26e.slice/crio-8fa6f66bcdd5197932ec19de74013fafd8c7c595526b72ef649c1a7e7c091fea WatchSource:0}: Error finding container 8fa6f66bcdd5197932ec19de74013fafd8c7c595526b72ef649c1a7e7c091fea: Status 404 returned error can't find the container with id 8fa6f66bcdd5197932ec19de74013fafd8c7c595526b72ef649c1a7e7c091fea
Sep 15 09:25:56.799577 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:56.799540    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-5ef2ab" event={"ID":"ed1ff9a5-e266-455e-a02c-b2dcf19ac26e","Type":"ContainerStarted","Data":"f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d"}
Sep 15 09:25:56.799941 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:56.799595    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-5ef2ab" event={"ID":"ed1ff9a5-e266-455e-a02c-b2dcf19ac26e","Type":"ContainerStarted","Data":"8fa6f66bcdd5197932ec19de74013fafd8c7c595526b72ef649c1a7e7c091fea"}
Sep 15 09:25:56.799941 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:56.799654    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7738-86f5fa" podUID="46fa9664-d139-443e-9b1b-1bfa8819d469" containerName="test-curl-7738-86f5fa" containerID="cri-o://5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269" gracePeriod=2
Sep 15 09:25:56.802286 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:56.802261    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-86f933\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:56.804022 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:56.803999    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-86f5fa\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="46fa9664-d139-443e-9b1b-1bfa8819d469" pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:56.818939 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:56.818898    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7738-5ef2ab" podStartSLOduration=1.818884425 podStartE2EDuration="1.818884425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:56.816974974 +0000 UTC m=+1144.406799319" watchObservedRunningTime="2026-09-15 09:25:56.818884425 +0000 UTC m=+1144.408708773"
Sep 15 09:25:56.819035 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:56.818954    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-86f933\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" pod="opendatahub/test-curl-7738-86f933"
Sep 15 09:25:56.820837 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:56.820816    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-86f5fa\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="46fa9664-d139-443e-9b1b-1bfa8819d469" pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:56.956978 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:56.956945    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="276c15c6-ca2e-467c-90c3-47f094e926f3" path="/var/lib/kubelet/pods/276c15c6-ca2e-467c-90c3-47f094e926f3/volumes"
Sep 15 09:25:56.983637 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:56.983612    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:57.032219 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.032189    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thr6r\" (UniqueName: \"kubernetes.io/projected/2b0b09a0-8f99-44e0-9799-097497b2ad31-kube-api-access-thr6r\") pod \"2b0b09a0-8f99-44e0-9799-097497b2ad31\" (UID: \"2b0b09a0-8f99-44e0-9799-097497b2ad31\") "
Sep 15 09:25:57.034091 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.034062    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b0b09a0-8f99-44e0-9799-097497b2ad31-kube-api-access-thr6r" (OuterVolumeSpecName: "kube-api-access-thr6r") pod "2b0b09a0-8f99-44e0-9799-097497b2ad31" (UID: "2b0b09a0-8f99-44e0-9799-097497b2ad31"). InnerVolumeSpecName "kube-api-access-thr6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:57.133201 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.133161    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thr6r\" (UniqueName: \"kubernetes.io/projected/2b0b09a0-8f99-44e0-9799-097497b2ad31-kube-api-access-thr6r\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:57.417217 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.417135    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7738-5ef2ab"]
Sep 15 09:25:57.422446 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.422418    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7738-5ef2ab"]
Sep 15 09:25:57.806820 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.806783    2555 generic.go:356] "Generic (PLEG): container finished" podID="2b0b09a0-8f99-44e0-9799-097497b2ad31" containerID="d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303" exitCode=137
Sep 15 09:25:57.806820 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.806822    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:57.807348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.806892    2555 scope.go:117] "RemoveContainer" containerID="d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303"
Sep 15 09:25:57.807348 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:57.807192    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7738-5ef2ab" container="test-curl-7738-5ef2ab"
Sep 15 09:25:57.816592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.816574    2555 scope.go:117] "RemoveContainer" containerID="d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303"
Sep 15 09:25:57.816961 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:57.816940    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303\": container with ID starting with d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303 not found: ID does not exist" containerID="d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303"
Sep 15 09:25:57.817024 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:57.816972    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303"} err="failed to get container status \"d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303\": rpc error: code = NotFound desc = could not find container \"d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303\": container with ID starting with d0ae1a1893113aca33952bfdd363f04d18bf8b993e7550dbde9c814803214303 not found: ID does not exist"
Sep 15 09:25:57.817241 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:57.817220    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-0205cb\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="2b0b09a0-8f99-44e0-9799-097497b2ad31" pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:58.815282 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:58.815250    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7738-5ef2ab" podUID="ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" containerName="test-curl-7738-5ef2ab" containerID="cri-o://f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d" gracePeriod=2
Sep 15 09:25:58.817553 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:58.817526    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-0205cb\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="2b0b09a0-8f99-44e0-9799-097497b2ad31" pod="opendatahub/test-curl-7738-0205cb"
Sep 15 09:25:58.819523 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:58.819500    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-5ef2ab\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:25:58.958027 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:58.957997    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0b09a0-8f99-44e0-9799-097497b2ad31" path="/var/lib/kubelet/pods/2b0b09a0-8f99-44e0-9799-097497b2ad31/volumes"
Sep 15 09:25:58.999605 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:58.999580    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:59.050231 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.050190    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmvht\" (UniqueName: \"kubernetes.io/projected/46fa9664-d139-443e-9b1b-1bfa8819d469-kube-api-access-nmvht\") pod \"46fa9664-d139-443e-9b1b-1bfa8819d469\" (UID: \"46fa9664-d139-443e-9b1b-1bfa8819d469\") "
Sep 15 09:25:59.052568 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.052536    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46fa9664-d139-443e-9b1b-1bfa8819d469-kube-api-access-nmvht" (OuterVolumeSpecName: "kube-api-access-nmvht") pod "46fa9664-d139-443e-9b1b-1bfa8819d469" (UID: "46fa9664-d139-443e-9b1b-1bfa8819d469"). InnerVolumeSpecName "kube-api-access-nmvht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:59.117353 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.117312    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5" podUID="3d1ef1cc-ea36-4cef-8b78-c3633d860e38" containerName="main" containerID="cri-o://1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955" gracePeriod=45
Sep 15 09:25:59.152207 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.152176    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmvht\" (UniqueName: \"kubernetes.io/projected/46fa9664-d139-443e-9b1b-1bfa8819d469-kube-api-access-nmvht\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:59.361129 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.361099    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:25:59.454545 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.454509    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckwd2\" (UniqueName: \"kubernetes.io/projected/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-kube-api-access-ckwd2\") pod \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") "
Sep 15 09:25:59.454691 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.454582    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tls-certs\") pod \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") "
Sep 15 09:25:59.454691 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.454683    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tmp-dir\") pod \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") "
Sep 15 09:25:59.454769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.454710    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-model-cache\") pod \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") "
Sep 15 09:25:59.454769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.454735    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-home\") pod \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") "
Sep 15 09:25:59.454900 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.454773    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-dshm\") pod \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\" (UID: \"3d1ef1cc-ea36-4cef-8b78-c3633d860e38\") "
Sep 15 09:25:59.455040 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.455010    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3d1ef1cc-ea36-4cef-8b78-c3633d860e38" (UID: "3d1ef1cc-ea36-4cef-8b78-c3633d860e38"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:59.455122 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.455025    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-model-cache" (OuterVolumeSpecName: "model-cache") pod "3d1ef1cc-ea36-4cef-8b78-c3633d860e38" (UID: "3d1ef1cc-ea36-4cef-8b78-c3633d860e38"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:59.455246 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.455220    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-home" (OuterVolumeSpecName: "home") pod "3d1ef1cc-ea36-4cef-8b78-c3633d860e38" (UID: "3d1ef1cc-ea36-4cef-8b78-c3633d860e38"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:59.455246 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.455241    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tmp-dir\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:59.455442 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.455263    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-model-cache\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:59.456960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.456933    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-dshm" (OuterVolumeSpecName: "dshm") pod "3d1ef1cc-ea36-4cef-8b78-c3633d860e38" (UID: "3d1ef1cc-ea36-4cef-8b78-c3633d860e38"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:59.456960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.456941    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3d1ef1cc-ea36-4cef-8b78-c3633d860e38" (UID: "3d1ef1cc-ea36-4cef-8b78-c3633d860e38"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:25:59.457083 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.457022    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-kube-api-access-ckwd2" (OuterVolumeSpecName: "kube-api-access-ckwd2") pod "3d1ef1cc-ea36-4cef-8b78-c3633d860e38" (UID: "3d1ef1cc-ea36-4cef-8b78-c3633d860e38"). InnerVolumeSpecName "kube-api-access-ckwd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:59.556151 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.556116    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-home\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:59.556151 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.556145    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-dshm\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:59.556151 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.556155    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckwd2\" (UniqueName: \"kubernetes.io/projected/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-kube-api-access-ckwd2\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:59.556364 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.556166    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d1ef1cc-ea36-4cef-8b78-c3633d860e38-tls-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:25:59.822581 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.822555    2555 generic.go:356] "Generic (PLEG): container finished" podID="3d1ef1cc-ea36-4cef-8b78-c3633d860e38" containerID="1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955" exitCode=0
Sep 15 09:25:59.823024 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.822596    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"
Sep 15 09:25:59.823024 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.822631    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5" event={"ID":"3d1ef1cc-ea36-4cef-8b78-c3633d860e38","Type":"ContainerDied","Data":"1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955"}
Sep 15 09:25:59.823024 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.822680    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5" event={"ID":"3d1ef1cc-ea36-4cef-8b78-c3633d860e38","Type":"ContainerDied","Data":"3d1170b98273226731b03e4ef2bcfc06394b0f82766901aad60a1a4238586efc"}
Sep 15 09:25:59.823024 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.822704    2555 scope.go:117] "RemoveContainer" containerID="1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955"
Sep 15 09:25:59.824273 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.824253    2555 generic.go:356] "Generic (PLEG): container finished" podID="46fa9664-d139-443e-9b1b-1bfa8819d469" containerID="5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269" exitCode=137
Sep 15 09:25:59.824375 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.824289    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:59.832150 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.832054    2555 scope.go:117] "RemoveContainer" containerID="1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955"
Sep 15 09:25:59.832352 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:59.832334    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955\": container with ID starting with 1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955 not found: ID does not exist" containerID="1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955"
Sep 15 09:25:59.832444 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.832363    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955"} err="failed to get container status \"1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955\": rpc error: code = NotFound desc = could not find container \"1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955\": container with ID starting with 1733e2b29183f8a9fa2193323f64db24dc399647735d2e2091969b60a4741955 not found: ID does not exist"
Sep 15 09:25:59.832444 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.832386    2555 scope.go:117] "RemoveContainer" containerID="5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269"
Sep 15 09:25:59.837357 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:59.836835    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-86f5fa\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="46fa9664-d139-443e-9b1b-1bfa8819d469" pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:59.866099 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:59.866048    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-86f5fa\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="46fa9664-d139-443e-9b1b-1bfa8819d469" pod="opendatahub/test-curl-7738-86f5fa"
Sep 15 09:25:59.866552 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.866525    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"]
Sep 15 09:25:59.866992 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.866970    2555 scope.go:117] "RemoveContainer" containerID="5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269"
Sep 15 09:25:59.867610 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:25:59.867586    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269\": container with ID starting with 5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269 not found: ID does not exist" containerID="5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269"
Sep 15 09:25:59.867704 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.867614    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269"} err="failed to get container status \"5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269\": rpc error: code = NotFound desc = could not find container \"5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269\": container with ID starting with 5b6642d7967f32f53695c2922b9c967cbf69691aa911ff37b009873f540ea269 not found: ID does not exist"
Sep 15 09:25:59.869988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:25:59.869967    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2430e2/test-model-2430e2-kserve-649f7ff445-7tpc5"]
Sep 15 09:26:00.957562 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:00.957524    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d1ef1cc-ea36-4cef-8b78-c3633d860e38" path="/var/lib/kubelet/pods/3d1ef1cc-ea36-4cef-8b78-c3633d860e38/volumes"
Sep 15 09:26:00.957991 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:00.957907    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46fa9664-d139-443e-9b1b-1bfa8819d469" path="/var/lib/kubelet/pods/46fa9664-d139-443e-9b1b-1bfa8819d469/volumes"
Sep 15 09:26:01.003888 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:01.003860    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:26:01.078559 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:01.078476    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v7wx\" (UniqueName: \"kubernetes.io/projected/ed1ff9a5-e266-455e-a02c-b2dcf19ac26e-kube-api-access-6v7wx\") pod \"ed1ff9a5-e266-455e-a02c-b2dcf19ac26e\" (UID: \"ed1ff9a5-e266-455e-a02c-b2dcf19ac26e\") "
Sep 15 09:26:01.080670 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:01.080634    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1ff9a5-e266-455e-a02c-b2dcf19ac26e-kube-api-access-6v7wx" (OuterVolumeSpecName: "kube-api-access-6v7wx") pod "ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" (UID: "ed1ff9a5-e266-455e-a02c-b2dcf19ac26e"). InnerVolumeSpecName "kube-api-access-6v7wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:26:01.179514 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:01.179479    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v7wx\" (UniqueName: \"kubernetes.io/projected/ed1ff9a5-e266-455e-a02c-b2dcf19ac26e-kube-api-access-6v7wx\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:26:01.840568 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:01.840533    2555 generic.go:356] "Generic (PLEG): container finished" podID="ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" containerID="f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d" exitCode=137
Sep 15 09:26:01.840760 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:01.840576    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:26:01.840760 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:01.840601    2555 scope.go:117] "RemoveContainer" containerID="f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d"
Sep 15 09:26:01.850787 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:01.850768    2555 scope.go:117] "RemoveContainer" containerID="f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d"
Sep 15 09:26:01.851097 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:26:01.851078    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d\": container with ID starting with f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d not found: ID does not exist" containerID="f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d"
Sep 15 09:26:01.851156 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:01.851106    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d"} err="failed to get container status \"f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d\": rpc error: code = NotFound desc = could not find container \"f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d\": container with ID starting with f52ea816fb5d0a0ea8ee7ced7ac3fcb1b8630174a4a02e18cfc829a8d192632d not found: ID does not exist"
Sep 15 09:26:01.852057 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:26:01.852031    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-5ef2ab\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:26:02.954190 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:26:02.954149    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-5ef2ab\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" pod="opendatahub/test-curl-7738-5ef2ab"
Sep 15 09:26:02.956890 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:02.956838    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" path="/var/lib/kubelet/pods/ed1ff9a5-e266-455e-a02c-b2dcf19ac26e/volumes"
Sep 15 09:26:04.364168 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.364117    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"]
Sep 15 09:26:04.364656 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.364591    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" containerName="test-curl-7738-5ef2ab"
Sep 15 09:26:04.364656 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.364602    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" containerName="test-curl-7738-5ef2ab"
Sep 15 09:26:04.364656 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.364621    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1ef1cc-ea36-4cef-8b78-c3633d860e38" containerName="main"
Sep 15 09:26:04.364656 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.364627    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1ef1cc-ea36-4cef-8b78-c3633d860e38" containerName="main"
Sep 15 09:26:04.364881 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.364706    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1ff9a5-e266-455e-a02c-b2dcf19ac26e" containerName="test-curl-7738-5ef2ab"
Sep 15 09:26:04.364881 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.364716    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d1ef1cc-ea36-4cef-8b78-c3633d860e38" containerName="main"
Sep 15 09:26:04.369329 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.369312    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.371932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.371903    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-fcb750c6-serving-cert\""
Sep 15 09:26:04.377819 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.377768    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"]
Sep 15 09:26:04.515208 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.515172    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s9lb\" (UniqueName: \"kubernetes.io/projected/d433ad33-4c98-4c17-a5ec-2146e086d9ed-kube-api-access-2s9lb\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.515405 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.515221    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-maas-api-tls\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.515405 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.515345    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d433ad33-4c98-4c17-a5ec-2146e086d9ed-openshift-service-ca\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.515501 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.515433    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-metrics-certs\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.616612 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.616524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-metrics-certs\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.616612 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.616587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s9lb\" (UniqueName: \"kubernetes.io/projected/d433ad33-4c98-4c17-a5ec-2146e086d9ed-kube-api-access-2s9lb\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.616612 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.616615    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-maas-api-tls\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.616953 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.616659    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d433ad33-4c98-4c17-a5ec-2146e086d9ed-openshift-service-ca\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.617323 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.617303    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d433ad33-4c98-4c17-a5ec-2146e086d9ed-openshift-service-ca\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.619054 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.619035    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-maas-api-tls\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.619201 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.619183    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-metrics-certs\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.625630 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.625599    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s9lb\" (UniqueName: \"kubernetes.io/projected/d433ad33-4c98-4c17-a5ec-2146e086d9ed-kube-api-access-2s9lb\") pod \"maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.681673 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.681638    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:04.964029 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:04.964000    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"]
Sep 15 09:26:04.965179 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:26:04.965152    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd433ad33_4c98_4c17_a5ec_2146e086d9ed.slice/crio-b2c06e27ac01b6f88090415c19afd2edddf0064920e30c8c5ff5afeb6e4e335f WatchSource:0}: Error finding container b2c06e27ac01b6f88090415c19afd2edddf0064920e30c8c5ff5afeb6e4e335f: Status 404 returned error can't find the container with id b2c06e27ac01b6f88090415c19afd2edddf0064920e30c8c5ff5afeb6e4e335f
Sep 15 09:26:05.073479 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.073444    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"]
Sep 15 09:26:05.078586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.078566    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:05.081190 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.081161    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-fcb750c6-dockercfg-qx9fl\""
Sep 15 09:26:05.081315 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.081278    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-fcb750c6\""
Sep 15 09:26:05.086747 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.086724    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"]
Sep 15 09:26:05.222631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.222601    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782d0ad1-b44e-4de5-9c84-2db54623fadf-plugins-config-volume\") pod \"payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx\" (UID: \"782d0ad1-b44e-4de5-9c84-2db54623fadf\") " pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:05.222791 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.222678    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqm7s\" (UniqueName: \"kubernetes.io/projected/782d0ad1-b44e-4de5-9c84-2db54623fadf-kube-api-access-cqm7s\") pod \"payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx\" (UID: \"782d0ad1-b44e-4de5-9c84-2db54623fadf\") " pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:05.323827 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.323790    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782d0ad1-b44e-4de5-9c84-2db54623fadf-plugins-config-volume\") pod \"payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx\" (UID: \"782d0ad1-b44e-4de5-9c84-2db54623fadf\") " pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:05.324037 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.323929    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqm7s\" (UniqueName: \"kubernetes.io/projected/782d0ad1-b44e-4de5-9c84-2db54623fadf-kube-api-access-cqm7s\") pod \"payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx\" (UID: \"782d0ad1-b44e-4de5-9c84-2db54623fadf\") " pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:05.324548 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.324524    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782d0ad1-b44e-4de5-9c84-2db54623fadf-plugins-config-volume\") pod \"payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx\" (UID: \"782d0ad1-b44e-4de5-9c84-2db54623fadf\") " pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:05.332364 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.332338    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqm7s\" (UniqueName: \"kubernetes.io/projected/782d0ad1-b44e-4de5-9c84-2db54623fadf-kube-api-access-cqm7s\") pod \"payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx\" (UID: \"782d0ad1-b44e-4de5-9c84-2db54623fadf\") " pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:05.393061 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.393033    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:05.664719 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.664697    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"]
Sep 15 09:26:05.666872 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:26:05.666801    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782d0ad1_b44e_4de5_9c84_2db54623fadf.slice/crio-f5b5dbbb3b43be0d01badac7bf2e16197684a50b999d7d5e56cd6b8b3c04964b WatchSource:0}: Error finding container f5b5dbbb3b43be0d01badac7bf2e16197684a50b999d7d5e56cd6b8b3c04964b: Status 404 returned error can't find the container with id f5b5dbbb3b43be0d01badac7bf2e16197684a50b999d7d5e56cd6b8b3c04964b
Sep 15 09:26:05.869660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.869547    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp" event={"ID":"d433ad33-4c98-4c17-a5ec-2146e086d9ed","Type":"ContainerStarted","Data":"ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476"}
Sep 15 09:26:05.869660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.869619    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp" event={"ID":"d433ad33-4c98-4c17-a5ec-2146e086d9ed","Type":"ContainerStarted","Data":"b2c06e27ac01b6f88090415c19afd2edddf0064920e30c8c5ff5afeb6e4e335f"}
Sep 15 09:26:05.869944 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.869759    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:05.871320 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.871289    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx" event={"ID":"782d0ad1-b44e-4de5-9c84-2db54623fadf","Type":"ContainerStarted","Data":"bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c"}
Sep 15 09:26:05.871453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.871332    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx" event={"ID":"782d0ad1-b44e-4de5-9c84-2db54623fadf","Type":"ContainerStarted","Data":"f5b5dbbb3b43be0d01badac7bf2e16197684a50b999d7d5e56cd6b8b3c04964b"}
Sep 15 09:26:05.871453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.871353    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:05.887326 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.887283    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp" podStartSLOduration=1.369131863 podStartE2EDuration="1.887270415s" totalImagesPullingTime="518.138552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:26:05.885600442 +0000 UTC m=+1153.475424792" watchObservedRunningTime="2026-09-15 09:26:05.887270415 +0000 UTC m=+1153.477094762"
Sep 15 09:26:05.901569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:05.901532    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx" podStartSLOduration=0.901518666 podStartE2EDuration="901.518666ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:26:05.90030257 +0000 UTC m=+1153.490126936" watchObservedRunningTime="2026-09-15 09:26:05.901518666 +0000 UTC m=+1153.491343014"
Sep 15 09:26:11.883910 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:11.883879    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:26:16.881065 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:16.880990    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:26:30.557620 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.557576    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"]
Sep 15 09:26:30.565679 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.565651    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.567635 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.567606    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"]
Sep 15 09:26:30.568524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.568351    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-f79800-serving-cert\""
Sep 15 09:26:30.674828 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.674796    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab287e5-4c00-4beb-b559-3b998932e60a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.675000 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.674870    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcwjp\" (UniqueName: \"kubernetes.io/projected/fab287e5-4c00-4beb-b559-3b998932e60a-kube-api-access-mcwjp\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.675000 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.674933    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.675000 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.674972    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.776318 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.776280    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab287e5-4c00-4beb-b559-3b998932e60a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.776529 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.776339    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcwjp\" (UniqueName: \"kubernetes.io/projected/fab287e5-4c00-4beb-b559-3b998932e60a-kube-api-access-mcwjp\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.776529 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.776388    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.776529 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.776406    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.776981 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.776958    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab287e5-4c00-4beb-b559-3b998932e60a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.778910 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.778885    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.779022 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.779007    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.784799 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.784778    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcwjp\" (UniqueName: \"kubernetes.io/projected/fab287e5-4c00-4beb-b559-3b998932e60a-kube-api-access-mcwjp\") pod \"maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:30.878092 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:30.878000    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:31.154398 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:31.154362    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"]
Sep 15 09:26:31.155259 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:26:31.155235    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab287e5_4c00_4beb_b559_3b998932e60a.slice/crio-d70f43059eb93ab9963274b6a8496d4387420a082b46b99a5c6da4e8d26903cf WatchSource:0}: Error finding container d70f43059eb93ab9963274b6a8496d4387420a082b46b99a5c6da4e8d26903cf: Status 404 returned error can't find the container with id d70f43059eb93ab9963274b6a8496d4387420a082b46b99a5c6da4e8d26903cf
Sep 15 09:26:32.040866 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:32.040817    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs" event={"ID":"fab287e5-4c00-4beb-b559-3b998932e60a","Type":"ContainerStarted","Data":"c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d"}
Sep 15 09:26:32.041293 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:32.040881    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs" event={"ID":"fab287e5-4c00-4beb-b559-3b998932e60a","Type":"ContainerStarted","Data":"d70f43059eb93ab9963274b6a8496d4387420a082b46b99a5c6da4e8d26903cf"}
Sep 15 09:26:32.041293 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:32.040998    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:26:32.059945 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:32.059884    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs" podStartSLOduration=1.7145693770000001 podStartE2EDuration="2.059862328s" totalImagesPullingTime="345.292951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:26:32.057650656 +0000 UTC m=+1179.647475006" watchObservedRunningTime="2026-09-15 09:26:32.059862328 +0000 UTC m=+1179.649686672"
Sep 15 09:26:38.053710 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:26:38.053679    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:27:04.965170 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:04.965138    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"]
Sep 15 09:27:04.970679 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:04.970655    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:04.973753 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:04.973728    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-8dd3bd-serving-cert\""
Sep 15 09:27:04.977346 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:04.977321    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"]
Sep 15 09:27:05.015745 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.015710    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrc22\" (UniqueName: \"kubernetes.io/projected/f457ec46-5071-4177-937f-e673ae62b70d-kube-api-access-mrc22\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.015939 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.015775    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.015988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.015952    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f457ec46-5071-4177-937f-e673ae62b70d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.016040 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.016003    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.117090 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.117049    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrc22\" (UniqueName: \"kubernetes.io/projected/f457ec46-5071-4177-937f-e673ae62b70d-kube-api-access-mrc22\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.117090 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.117093    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.117343 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.117141    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f457ec46-5071-4177-937f-e673ae62b70d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.117343 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.117158    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.117343 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:27:05.117254    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-serving-cert: secret "maas-api-e2e-shared-b-w3-8dd3bd-serving-cert" not found
Sep 15 09:27:05.117343 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:27:05.117313    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-maas-api-tls podName:f457ec46-5071-4177-937f-e673ae62b70d nodeName:}" failed. No retries permitted until 2026-09-15 09:27:05.617297621 +0000 UTC m=+1213.207121963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-maas-api-tls") pod "maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z" (UID: "f457ec46-5071-4177-937f-e673ae62b70d") : secret "maas-api-e2e-shared-b-w3-8dd3bd-serving-cert" not found
Sep 15 09:27:05.117903 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.117840    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f457ec46-5071-4177-937f-e673ae62b70d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.119601 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.119573    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.125221 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.125197    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrc22\" (UniqueName: \"kubernetes.io/projected/f457ec46-5071-4177-937f-e673ae62b70d-kube-api-access-mrc22\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.621929 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.621898    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.624256 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.624228    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:05.884129 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:05.884042    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:06.158005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:06.157979    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"]
Sep 15 09:27:06.159925 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:27:06.159899    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf457ec46_5071_4177_937f_e673ae62b70d.slice/crio-02bc4e42e84103801f915b8592770879abaa3e0acccf71fd40091c75f337ee4d WatchSource:0}: Error finding container 02bc4e42e84103801f915b8592770879abaa3e0acccf71fd40091c75f337ee4d: Status 404 returned error can't find the container with id 02bc4e42e84103801f915b8592770879abaa3e0acccf71fd40091c75f337ee4d
Sep 15 09:27:06.260004 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:06.259964    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z" event={"ID":"f457ec46-5071-4177-937f-e673ae62b70d","Type":"ContainerStarted","Data":"02bc4e42e84103801f915b8592770879abaa3e0acccf71fd40091c75f337ee4d"}
Sep 15 09:27:07.267555 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:07.267428    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z" event={"ID":"f457ec46-5071-4177-937f-e673ae62b70d","Type":"ContainerStarted","Data":"f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6"}
Sep 15 09:27:07.279173 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:07.267592    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:27:07.285998 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:07.285928    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z" podStartSLOduration=2.748731605 podStartE2EDuration="3.285913401s" totalImagesPullingTime="537.181796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:07.284716955 +0000 UTC m=+1214.874541306" watchObservedRunningTime="2026-09-15 09:27:07.285913401 +0000 UTC m=+1214.875737759"
Sep 15 09:27:13.280059 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:27:13.280024    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:28:39.113148 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.113113    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"]
Sep 15 09:28:39.113705 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.113360    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp" podUID="d433ad33-4c98-4c17-a5ec-2146e086d9ed" containerName="maas-api" containerID="cri-o://ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476" gracePeriod=30
Sep 15 09:28:39.170285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.170251    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"]
Sep 15 09:28:39.170829 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.170640    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx" podUID="782d0ad1-b44e-4de5-9c84-2db54623fadf" containerName="payload-processing" containerID="cri-o://bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c" gracePeriod=30
Sep 15 09:28:39.429670 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.429645    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:28:39.464151 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.464119    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:28:39.568375 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.568340    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782d0ad1-b44e-4de5-9c84-2db54623fadf-plugins-config-volume\") pod \"782d0ad1-b44e-4de5-9c84-2db54623fadf\" (UID: \"782d0ad1-b44e-4de5-9c84-2db54623fadf\") "
Sep 15 09:28:39.568375 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.568376    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqm7s\" (UniqueName: \"kubernetes.io/projected/782d0ad1-b44e-4de5-9c84-2db54623fadf-kube-api-access-cqm7s\") pod \"782d0ad1-b44e-4de5-9c84-2db54623fadf\" (UID: \"782d0ad1-b44e-4de5-9c84-2db54623fadf\") "
Sep 15 09:28:39.568647 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.568402    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-maas-api-tls\") pod \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") "
Sep 15 09:28:39.568647 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.568441    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d433ad33-4c98-4c17-a5ec-2146e086d9ed-openshift-service-ca\") pod \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") "
Sep 15 09:28:39.568647 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.568483    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-metrics-certs\") pod \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") "
Sep 15 09:28:39.568647 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.568541    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s9lb\" (UniqueName: \"kubernetes.io/projected/d433ad33-4c98-4c17-a5ec-2146e086d9ed-kube-api-access-2s9lb\") pod \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\" (UID: \"d433ad33-4c98-4c17-a5ec-2146e086d9ed\") "
Sep 15 09:28:39.568935 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.568803    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d433ad33-4c98-4c17-a5ec-2146e086d9ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d433ad33-4c98-4c17-a5ec-2146e086d9ed" (UID: "d433ad33-4c98-4c17-a5ec-2146e086d9ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:28:39.568935 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.568825    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/782d0ad1-b44e-4de5-9c84-2db54623fadf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "782d0ad1-b44e-4de5-9c84-2db54623fadf" (UID: "782d0ad1-b44e-4de5-9c84-2db54623fadf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:28:39.569046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.569029    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782d0ad1-b44e-4de5-9c84-2db54623fadf-plugins-config-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:28:39.569094 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.569050    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d433ad33-4c98-4c17-a5ec-2146e086d9ed-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:28:39.570621 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.570597    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d433ad33-4c98-4c17-a5ec-2146e086d9ed" (UID: "d433ad33-4c98-4c17-a5ec-2146e086d9ed"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:28:39.570710 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.570675    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d433ad33-4c98-4c17-a5ec-2146e086d9ed-kube-api-access-2s9lb" (OuterVolumeSpecName: "kube-api-access-2s9lb") pod "d433ad33-4c98-4c17-a5ec-2146e086d9ed" (UID: "d433ad33-4c98-4c17-a5ec-2146e086d9ed"). InnerVolumeSpecName "kube-api-access-2s9lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:28:39.571010 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.570988    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d433ad33-4c98-4c17-a5ec-2146e086d9ed" (UID: "d433ad33-4c98-4c17-a5ec-2146e086d9ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:28:39.571058 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.571003    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/782d0ad1-b44e-4de5-9c84-2db54623fadf-kube-api-access-cqm7s" (OuterVolumeSpecName: "kube-api-access-cqm7s") pod "782d0ad1-b44e-4de5-9c84-2db54623fadf" (UID: "782d0ad1-b44e-4de5-9c84-2db54623fadf"). InnerVolumeSpecName "kube-api-access-cqm7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:28:39.669642 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.669553    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqm7s\" (UniqueName: \"kubernetes.io/projected/782d0ad1-b44e-4de5-9c84-2db54623fadf-kube-api-access-cqm7s\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:28:39.669642 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.669587    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:28:39.669642 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.669600    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433ad33-4c98-4c17-a5ec-2146e086d9ed-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:28:39.669642 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.669611    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s9lb\" (UniqueName: \"kubernetes.io/projected/d433ad33-4c98-4c17-a5ec-2146e086d9ed-kube-api-access-2s9lb\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:28:39.887349 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.887315    2555 generic.go:356] "Generic (PLEG): container finished" podID="d433ad33-4c98-4c17-a5ec-2146e086d9ed" containerID="ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476" exitCode=0
Sep 15 09:28:39.887539 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.887361    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"
Sep 15 09:28:39.887539 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.887408    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp" event={"ID":"d433ad33-4c98-4c17-a5ec-2146e086d9ed","Type":"ContainerDied","Data":"ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476"}
Sep 15 09:28:39.887539 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.887467    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp" event={"ID":"d433ad33-4c98-4c17-a5ec-2146e086d9ed","Type":"ContainerDied","Data":"b2c06e27ac01b6f88090415c19afd2edddf0064920e30c8c5ff5afeb6e4e335f"}
Sep 15 09:28:39.887539 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.887498    2555 scope.go:117] "RemoveContainer" containerID="ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476"
Sep 15 09:28:39.888963 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.888939    2555 generic.go:356] "Generic (PLEG): container finished" podID="782d0ad1-b44e-4de5-9c84-2db54623fadf" containerID="bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c" exitCode=0
Sep 15 09:28:39.889077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.888998    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"
Sep 15 09:28:39.889077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.889022    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx" event={"ID":"782d0ad1-b44e-4de5-9c84-2db54623fadf","Type":"ContainerDied","Data":"bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c"}
Sep 15 09:28:39.889077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.889067    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx" event={"ID":"782d0ad1-b44e-4de5-9c84-2db54623fadf","Type":"ContainerDied","Data":"f5b5dbbb3b43be0d01badac7bf2e16197684a50b999d7d5e56cd6b8b3c04964b"}
Sep 15 09:28:39.899124 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.899040    2555 scope.go:117] "RemoveContainer" containerID="ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476"
Sep 15 09:28:39.899408 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:28:39.899380    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476\": container with ID starting with ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476 not found: ID does not exist" containerID="ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476"
Sep 15 09:28:39.899495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.899420    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476"} err="failed to get container status \"ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476\": rpc error: code = NotFound desc = could not find container \"ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476\": container with ID starting with ff81fef886818f77fb08ec46e710d62ae386f634dd9f26142ef25d40f54e3476 not found: ID does not exist"
Sep 15 09:28:39.899495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.899446    2555 scope.go:117] "RemoveContainer" containerID="bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c"
Sep 15 09:28:39.908005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.907984    2555 scope.go:117] "RemoveContainer" containerID="bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c"
Sep 15 09:28:39.908302 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:28:39.908283    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c\": container with ID starting with bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c not found: ID does not exist" containerID="bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c"
Sep 15 09:28:39.908361 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.908309    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c"} err="failed to get container status \"bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c\": rpc error: code = NotFound desc = could not find container \"bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c\": container with ID starting with bfc4ea84b2fd5cff2be486d1f5a8cb8c241c1d87cc26824d8d2525b426b9507c not found: ID does not exist"
Sep 15 09:28:39.914872 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.914832    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"]
Sep 15 09:28:39.921090 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.921041    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fcb750c6-699598cfc8-kfxwp"]
Sep 15 09:28:39.931584 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.931560    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"]
Sep 15 09:28:39.934947 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:39.934925    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx"]
Sep 15 09:28:40.956269 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:40.956231    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="782d0ad1-b44e-4de5-9c84-2db54623fadf" path="/var/lib/kubelet/pods/782d0ad1-b44e-4de5-9c84-2db54623fadf/volumes"
Sep 15 09:28:40.956661 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:28:40.956647    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d433ad33-4c98-4c17-a5ec-2146e086d9ed" path="/var/lib/kubelet/pods/d433ad33-4c98-4c17-a5ec-2146e086d9ed/volumes"
Sep 15 09:29:50.513329 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.513286    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"]
Sep 15 09:29:50.514182 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.514159    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d433ad33-4c98-4c17-a5ec-2146e086d9ed" containerName="maas-api"
Sep 15 09:29:50.514240 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.514186    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d433ad33-4c98-4c17-a5ec-2146e086d9ed" containerName="maas-api"
Sep 15 09:29:50.514240 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.514199    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="782d0ad1-b44e-4de5-9c84-2db54623fadf" containerName="payload-processing"
Sep 15 09:29:50.514240 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.514208    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="782d0ad1-b44e-4de5-9c84-2db54623fadf" containerName="payload-processing"
Sep 15 09:29:50.514358 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.514333    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="782d0ad1-b44e-4de5-9c84-2db54623fadf" containerName="payload-processing"
Sep 15 09:29:50.514358 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.514346    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d433ad33-4c98-4c17-a5ec-2146e086d9ed" containerName="maas-api"
Sep 15 09:29:50.518242 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.518220    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.520685 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.520660    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-8dd3bd\"/\"openshift-service-ca.crt\""
Sep 15 09:29:50.522193 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.522130    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-8dd3bd\"/\"default-dockercfg-6xhfl\""
Sep 15 09:29:50.522193 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.522153    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-8dd3bd\"/\"kube-root-ca.crt\""
Sep 15 09:29:50.522492 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.522441    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-8dd3bd\"/\"auth-test-model-8dd3bd-kserve-self-signed-certs\""
Sep 15 09:29:50.528806 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.528783    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"]
Sep 15 09:29:50.673394 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.673356    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-model-cache\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.673394 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.673397    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-home\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.673665 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.673473    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-dshm\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.673665 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.673581    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tls-certs\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.673665 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.673609    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqg64\" (UniqueName: \"kubernetes.io/projected/7dd6b784-50e4-4ead-ab39-2c91d216f3af-kube-api-access-gqg64\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.673898 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.673683    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tmp-dir\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.775322 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.775236    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-dshm\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.775322 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.775302    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tls-certs\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.775322 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.775318    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqg64\" (UniqueName: \"kubernetes.io/projected/7dd6b784-50e4-4ead-ab39-2c91d216f3af-kube-api-access-gqg64\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.775615 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.775353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tmp-dir\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.775615 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.775393    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-model-cache\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.775615 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.775419    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-home\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.775778 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.775762    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tmp-dir\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.775819 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.775796    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-model-cache\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.775880 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.775829    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-home\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.777533 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.777505    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-dshm\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.777820 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.777804    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tls-certs\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.783631 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.783609    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqg64\" (UniqueName: \"kubernetes.io/projected/7dd6b784-50e4-4ead-ab39-2c91d216f3af-kube-api-access-gqg64\") pod \"auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") " pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:50.830672 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:50.830638    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:29:51.106621 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:51.106592    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"]
Sep 15 09:29:51.107299 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:29:51.107274    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7dd6b784_50e4_4ead_ab39_2c91d216f3af.slice/crio-bc4b20f1c4d7b724978f754175b6309bb3130b0e9c9741b6d79284cc80603719 WatchSource:0}: Error finding container bc4b20f1c4d7b724978f754175b6309bb3130b0e9c9741b6d79284cc80603719: Status 404 returned error can't find the container with id bc4b20f1c4d7b724978f754175b6309bb3130b0e9c9741b6d79284cc80603719
Sep 15 09:29:51.361441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:51.361338    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6" event={"ID":"7dd6b784-50e4-4ead-ab39-2c91d216f3af","Type":"ContainerStarted","Data":"50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821"}
Sep 15 09:29:51.361441 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:51.361393    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6" event={"ID":"7dd6b784-50e4-4ead-ab39-2c91d216f3af","Type":"ContainerStarted","Data":"bc4b20f1c4d7b724978f754175b6309bb3130b0e9c9741b6d79284cc80603719"}
Sep 15 09:29:51.384551 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:29:51.384504    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6" podStartSLOduration=1.384488759 podStartE2EDuration="1.384488759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:29:51.381882749 +0000 UTC m=+1378.971707098" watchObservedRunningTime="2026-09-15 09:29:51.384488759 +0000 UTC m=+1378.974313106"
Sep 15 09:30:00.831256 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:00.831220    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:30:00.831687 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:00.831307    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:30:00.843469 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:00.843442    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:30:01.437901 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:01.437868    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:30:30.905340 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.905306    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"]
Sep 15 09:30:30.909019 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.909002    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:30.912608 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.912579    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ffb593\"/\"default-dockercfg-bjtj2\""
Sep 15 09:30:30.912768 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.912636    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ffb593\"/\"kube-root-ca.crt\""
Sep 15 09:30:30.912768 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.912578    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ffb593\"/\"openshift-service-ca.crt\""
Sep 15 09:30:30.912768 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.912578    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ffb593\"/\"embedding-w0-ffb593-kserve-self-signed-certs\""
Sep 15 09:30:30.919250 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.919226    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"]
Sep 15 09:30:30.976264 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.976227    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-dshm\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:30.976444 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.976299    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-tmp-dir\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:30.976444 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.976346    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqnd\" (UniqueName: \"kubernetes.io/projected/58291c44-48c7-4724-ab13-c5e520774683-kube-api-access-dnqnd\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:30.976444 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.976427    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-model-cache\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:30.976611 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.976485    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58291c44-48c7-4724-ab13-c5e520774683-tls-certs\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:30.976611 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:30.976573    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-home\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.077599 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.077561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-home\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.077808 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.077650    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-dshm\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.077808 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.077701    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-tmp-dir\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.077808 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.077731    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqnd\" (UniqueName: \"kubernetes.io/projected/58291c44-48c7-4724-ab13-c5e520774683-kube-api-access-dnqnd\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.077808 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.077797    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-model-cache\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.078085 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.077876    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58291c44-48c7-4724-ab13-c5e520774683-tls-certs\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.078085 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.078054    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-home\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.078304 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.078280    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-model-cache\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.078381 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.078367    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-tmp-dir\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.079959 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.079934    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-dshm\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.080251 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.080234    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58291c44-48c7-4724-ab13-c5e520774683-tls-certs\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.085437 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.085413    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqnd\" (UniqueName: \"kubernetes.io/projected/58291c44-48c7-4724-ab13-c5e520774683-kube-api-access-dnqnd\") pod \"embedding-w0-ffb593-kserve-7c545b8455-9s48h\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") " pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.220959 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.220928    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:31.497034 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.496999    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"]
Sep 15 09:30:31.497910 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:30:31.497884    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58291c44_48c7_4724_ab13_c5e520774683.slice/crio-94d489322cd04cfbf844621643f4e2a67b8de6c4b20a46919fd1a6e6cf1e448a WatchSource:0}: Error finding container 94d489322cd04cfbf844621643f4e2a67b8de6c4b20a46919fd1a6e6cf1e448a: Status 404 returned error can't find the container with id 94d489322cd04cfbf844621643f4e2a67b8de6c4b20a46919fd1a6e6cf1e448a
Sep 15 09:30:31.621924 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.621887    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h" event={"ID":"58291c44-48c7-4724-ab13-c5e520774683","Type":"ContainerStarted","Data":"3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b"}
Sep 15 09:30:31.622078 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.621940    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h" event={"ID":"58291c44-48c7-4724-ab13-c5e520774683","Type":"ContainerStarted","Data":"94d489322cd04cfbf844621643f4e2a67b8de6c4b20a46919fd1a6e6cf1e448a"}
Sep 15 09:30:31.641120 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:31.641073    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h" podStartSLOduration=1.6410587049999998 podStartE2EDuration="1.641058705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:31.64009721 +0000 UTC m=+1419.229921558" watchObservedRunningTime="2026-09-15 09:30:31.641058705 +0000 UTC m=+1419.230883053"
Sep 15 09:30:41.222012 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:41.221969    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:41.222404 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:41.222032    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:41.234745 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:41.234719    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:30:41.705132 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:30:41.705047    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:31:04.221787 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.221710    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"]
Sep 15 09:31:04.226453 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.226427    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.229054 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.229025    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-730be9-serving-cert\""
Sep 15 09:31:04.239525 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.239497    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"]
Sep 15 09:31:04.312058 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.312024    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f3fde9-9ee4-466b-8fea-88b29baa1f98-openshift-service-ca\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.312058 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.312067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cphpg\" (UniqueName: \"kubernetes.io/projected/88f3fde9-9ee4-466b-8fea-88b29baa1f98-kube-api-access-cphpg\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.312333 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.312091    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-maas-api-tls\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.312333 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.312275    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-metrics-certs\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.413005 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.412957    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-metrics-certs\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.413231 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.413042    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f3fde9-9ee4-466b-8fea-88b29baa1f98-openshift-service-ca\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.413231 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.413070    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphpg\" (UniqueName: \"kubernetes.io/projected/88f3fde9-9ee4-466b-8fea-88b29baa1f98-kube-api-access-cphpg\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.413231 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.413090    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-maas-api-tls\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.413418 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:31:04.413234    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-serving-cert: secret "maas-api-e2e-api-a-730be9-serving-cert" not found
Sep 15 09:31:04.413418 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:31:04.413309    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-maas-api-tls podName:88f3fde9-9ee4-466b-8fea-88b29baa1f98 nodeName:}" failed. No retries permitted until 2026-09-15 09:31:04.913278572 +0000 UTC m=+1452.503102914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-maas-api-tls") pod "maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l" (UID: "88f3fde9-9ee4-466b-8fea-88b29baa1f98") : secret "maas-api-e2e-api-a-730be9-serving-cert" not found
Sep 15 09:31:04.413758 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.413739    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f3fde9-9ee4-466b-8fea-88b29baa1f98-openshift-service-ca\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.415472 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.415446    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-metrics-certs\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.421805 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.421783    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cphpg\" (UniqueName: \"kubernetes.io/projected/88f3fde9-9ee4-466b-8fea-88b29baa1f98-kube-api-access-cphpg\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.917820 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.917787    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-maas-api-tls\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:04.920332 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:04.920305    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-maas-api-tls\") pod \"maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:05.143077 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:05.143042    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:05.419657 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:05.419628    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"]
Sep 15 09:31:05.420146 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:31:05.420122    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f3fde9_9ee4_466b_8fea_88b29baa1f98.slice/crio-b1fa4cf7b4008beb09e4c731bc76dc7725f1258c4f384d4fb68a6fd30ef01e69 WatchSource:0}: Error finding container b1fa4cf7b4008beb09e4c731bc76dc7725f1258c4f384d4fb68a6fd30ef01e69: Status 404 returned error can't find the container with id b1fa4cf7b4008beb09e4c731bc76dc7725f1258c4f384d4fb68a6fd30ef01e69
Sep 15 09:31:05.421660 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:05.421634    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:31:05.861834 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:05.861794    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l" event={"ID":"88f3fde9-9ee4-466b-8fea-88b29baa1f98","Type":"ContainerStarted","Data":"b1fa4cf7b4008beb09e4c731bc76dc7725f1258c4f384d4fb68a6fd30ef01e69"}
Sep 15 09:31:06.869265 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:06.869223    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l" event={"ID":"88f3fde9-9ee4-466b-8fea-88b29baa1f98","Type":"ContainerStarted","Data":"ea1a96e64533db017bd9105ad30afbbf2ed638734e80defa374e0eae6995209d"}
Sep 15 09:31:06.869640 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:06.869294    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:06.888562 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:06.888511    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l" podStartSLOduration=2.3516159500000002 podStartE2EDuration="2.888494994s" totalImagesPullingTime="536.879044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:06.885090997 +0000 UTC m=+1454.474915345" watchObservedRunningTime="2026-09-15 09:31:06.888494994 +0000 UTC m=+1454.478319401"
Sep 15 09:31:12.882832 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:12.882800    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:31:39.547194 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.547160    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"]
Sep 15 09:31:39.552743 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.552716    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.555260 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.555237    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ff390e-serving-cert\""
Sep 15 09:31:39.565650 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.565619    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"]
Sep 15 09:31:39.686067 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.686025    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvf6x\" (UniqueName: \"kubernetes.io/projected/7759461a-40ab-4ab8-a619-eb274b8e1cff-kube-api-access-jvf6x\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.686240 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.686086    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-metrics-certs\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.686240 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.686167    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7759461a-40ab-4ab8-a619-eb274b8e1cff-openshift-service-ca\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.686240 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.686223    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-maas-api-tls\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.787643 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.787608    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-maas-api-tls\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.787814 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.787756    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvf6x\" (UniqueName: \"kubernetes.io/projected/7759461a-40ab-4ab8-a619-eb274b8e1cff-kube-api-access-jvf6x\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.787814 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.787799    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-metrics-certs\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.787950 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.787838    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7759461a-40ab-4ab8-a619-eb274b8e1cff-openshift-service-ca\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.788545 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.788518    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7759461a-40ab-4ab8-a619-eb274b8e1cff-openshift-service-ca\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.790155 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.790123    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-metrics-certs\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.790268 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.790240    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-maas-api-tls\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.795133 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.795109    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvf6x\" (UniqueName: \"kubernetes.io/projected/7759461a-40ab-4ab8-a619-eb274b8e1cff-kube-api-access-jvf6x\") pod \"maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:39.868970 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:39.868882    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:40.145187 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.145146    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"]
Sep 15 09:31:40.146725 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:31:40.146698    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7759461a_40ab_4ab8_a619_eb274b8e1cff.slice/crio-49c7069f8e8fe77cbc7d0838556af6f02b6434a872768d29bbb5ff30743976e7 WatchSource:0}: Error finding container 49c7069f8e8fe77cbc7d0838556af6f02b6434a872768d29bbb5ff30743976e7: Status 404 returned error can't find the container with id 49c7069f8e8fe77cbc7d0838556af6f02b6434a872768d29bbb5ff30743976e7
Sep 15 09:31:40.172905 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.172880    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"]
Sep 15 09:31:40.177880 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.177859    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:31:40.180612 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.180588    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ff390e\""
Sep 15 09:31:40.180812 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.180790    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ff390e-dockercfg-wmtf8\""
Sep 15 09:31:40.187265 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.187241    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"]
Sep 15 09:31:40.293523 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.293473    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b528a10-e197-4627-9e8f-3a78263f4220-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz\" (UID: \"4b528a10-e197-4627-9e8f-3a78263f4220\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:31:40.293712 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.293544    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrtq\" (UniqueName: \"kubernetes.io/projected/4b528a10-e197-4627-9e8f-3a78263f4220-kube-api-access-xnrtq\") pod \"payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz\" (UID: \"4b528a10-e197-4627-9e8f-3a78263f4220\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:31:40.394400 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.394315    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b528a10-e197-4627-9e8f-3a78263f4220-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz\" (UID: \"4b528a10-e197-4627-9e8f-3a78263f4220\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:31:40.394400 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.394372    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrtq\" (UniqueName: \"kubernetes.io/projected/4b528a10-e197-4627-9e8f-3a78263f4220-kube-api-access-xnrtq\") pod \"payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz\" (UID: \"4b528a10-e197-4627-9e8f-3a78263f4220\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:31:40.395110 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.395086    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b528a10-e197-4627-9e8f-3a78263f4220-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz\" (UID: \"4b528a10-e197-4627-9e8f-3a78263f4220\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:31:40.401930 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.401902    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrtq\" (UniqueName: \"kubernetes.io/projected/4b528a10-e197-4627-9e8f-3a78263f4220-kube-api-access-xnrtq\") pod \"payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz\" (UID: \"4b528a10-e197-4627-9e8f-3a78263f4220\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:31:40.493013 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.492974    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:31:40.770825 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:40.770797    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"]
Sep 15 09:31:40.771490 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:31:40.771458    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b528a10_e197_4627_9e8f_3a78263f4220.slice/crio-9d3d81e2e759af1075498c9049ba8a96cc288f247990678484b24dcbb969bc50 WatchSource:0}: Error finding container 9d3d81e2e759af1075498c9049ba8a96cc288f247990678484b24dcbb969bc50: Status 404 returned error can't find the container with id 9d3d81e2e759af1075498c9049ba8a96cc288f247990678484b24dcbb969bc50
Sep 15 09:31:41.106402 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:41.106360    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz" event={"ID":"4b528a10-e197-4627-9e8f-3a78263f4220","Type":"ContainerStarted","Data":"b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9"}
Sep 15 09:31:41.106601 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:41.106422    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz" event={"ID":"4b528a10-e197-4627-9e8f-3a78263f4220","Type":"ContainerStarted","Data":"9d3d81e2e759af1075498c9049ba8a96cc288f247990678484b24dcbb969bc50"}
Sep 15 09:31:41.106601 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:41.106540    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:31:41.108083 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:41.108048    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld" event={"ID":"7759461a-40ab-4ab8-a619-eb274b8e1cff","Type":"ContainerStarted","Data":"eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e"}
Sep 15 09:31:41.108208 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:41.108102    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld" event={"ID":"7759461a-40ab-4ab8-a619-eb274b8e1cff","Type":"ContainerStarted","Data":"49c7069f8e8fe77cbc7d0838556af6f02b6434a872768d29bbb5ff30743976e7"}
Sep 15 09:31:41.108208 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:41.108124    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:41.125577 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:41.125528    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz" podStartSLOduration=1.125513776 podStartE2EDuration="1.125513776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:41.12278391 +0000 UTC m=+1488.712608269" watchObservedRunningTime="2026-09-15 09:31:41.125513776 +0000 UTC m=+1488.715338186"
Sep 15 09:31:41.139972 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:41.139926    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld" podStartSLOduration=1.648545603 podStartE2EDuration="2.139909103s" totalImagesPullingTime="491.3635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:41.138921981 +0000 UTC m=+1488.728746330" watchObservedRunningTime="2026-09-15 09:31:41.139909103 +0000 UTC m=+1488.729733451"
Sep 15 09:31:47.119212 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:47.119176    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:31:48.138576 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:48.138542    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"]
Sep 15 09:31:52.117036 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:31:52.116999    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:32:03.162240 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.162164    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h" podUID="58291c44-48c7-4724-ab13-c5e520774683" containerName="main" containerID="cri-o://3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b" gracePeriod=45
Sep 15 09:32:03.420765 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.420707    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:32:03.435066 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435036    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-model-cache\") pod \"58291c44-48c7-4724-ab13-c5e520774683\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") "
Sep 15 09:32:03.435219 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435137    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnqnd\" (UniqueName: \"kubernetes.io/projected/58291c44-48c7-4724-ab13-c5e520774683-kube-api-access-dnqnd\") pod \"58291c44-48c7-4724-ab13-c5e520774683\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") "
Sep 15 09:32:03.435283 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435222    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-home\") pod \"58291c44-48c7-4724-ab13-c5e520774683\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") "
Sep 15 09:32:03.435328 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435287    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-tmp-dir\") pod \"58291c44-48c7-4724-ab13-c5e520774683\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") "
Sep 15 09:32:03.435328 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435306    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-model-cache" (OuterVolumeSpecName: "model-cache") pod "58291c44-48c7-4724-ab13-c5e520774683" (UID: "58291c44-48c7-4724-ab13-c5e520774683"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:03.435430 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435343    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-dshm\") pod \"58291c44-48c7-4724-ab13-c5e520774683\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") "
Sep 15 09:32:03.435430 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435368    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58291c44-48c7-4724-ab13-c5e520774683-tls-certs\") pod \"58291c44-48c7-4724-ab13-c5e520774683\" (UID: \"58291c44-48c7-4724-ab13-c5e520774683\") "
Sep 15 09:32:03.435536 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435476    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-home" (OuterVolumeSpecName: "home") pod "58291c44-48c7-4724-ab13-c5e520774683" (UID: "58291c44-48c7-4724-ab13-c5e520774683"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:03.435616 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435584    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58291c44-48c7-4724-ab13-c5e520774683" (UID: "58291c44-48c7-4724-ab13-c5e520774683"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:03.435807 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435792    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-model-cache\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.435896 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435814    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-home\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.435896 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.435827    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-tmp-dir\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.438654 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.438100    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58291c44-48c7-4724-ab13-c5e520774683-kube-api-access-dnqnd" (OuterVolumeSpecName: "kube-api-access-dnqnd") pod "58291c44-48c7-4724-ab13-c5e520774683" (UID: "58291c44-48c7-4724-ab13-c5e520774683"). InnerVolumeSpecName "kube-api-access-dnqnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:03.438654 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.438426    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58291c44-48c7-4724-ab13-c5e520774683-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58291c44-48c7-4724-ab13-c5e520774683" (UID: "58291c44-48c7-4724-ab13-c5e520774683"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:03.440083 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.440008    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-dshm" (OuterVolumeSpecName: "dshm") pod "58291c44-48c7-4724-ab13-c5e520774683" (UID: "58291c44-48c7-4724-ab13-c5e520774683"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:03.537439 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.537396    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnqnd\" (UniqueName: \"kubernetes.io/projected/58291c44-48c7-4724-ab13-c5e520774683-kube-api-access-dnqnd\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.537439 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.537429    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58291c44-48c7-4724-ab13-c5e520774683-dshm\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.537439 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:03.537441    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58291c44-48c7-4724-ab13-c5e520774683-tls-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:04.265545 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.265511    2555 generic.go:356] "Generic (PLEG): container finished" podID="58291c44-48c7-4724-ab13-c5e520774683" containerID="3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b" exitCode=0
Sep 15 09:32:04.266049 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.265559    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"
Sep 15 09:32:04.266049 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.265606    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h" event={"ID":"58291c44-48c7-4724-ab13-c5e520774683","Type":"ContainerDied","Data":"3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b"}
Sep 15 09:32:04.266049 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.265659    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h" event={"ID":"58291c44-48c7-4724-ab13-c5e520774683","Type":"ContainerDied","Data":"94d489322cd04cfbf844621643f4e2a67b8de6c4b20a46919fd1a6e6cf1e448a"}
Sep 15 09:32:04.266049 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.265699    2555 scope.go:117] "RemoveContainer" containerID="3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b"
Sep 15 09:32:04.276554 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.276541    2555 scope.go:117] "RemoveContainer" containerID="3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b"
Sep 15 09:32:04.276831 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:32:04.276815    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b\": container with ID starting with 3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b not found: ID does not exist" containerID="3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b"
Sep 15 09:32:04.276900 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.276839    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b"} err="failed to get container status \"3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b\": rpc error: code = NotFound desc = could not find container \"3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b\": container with ID starting with 3e8c2be291d93295af0b8167bbfddc5fdc8d2982332b8bb934e78faf8028d00b not found: ID does not exist"
Sep 15 09:32:04.291158 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.291133    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"]
Sep 15 09:32:04.295565 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.295541    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/embedding-w0-ffb593-kserve-7c545b8455-9s48h"]
Sep 15 09:32:04.377546 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.377507    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"]
Sep 15 09:32:04.377792 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.377750    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk" podUID="20f51f1a-9a52-4c55-8fe3-e4aa140cde96" containerName="maas-api" containerID="cri-o://7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525" gracePeriod=30
Sep 15 09:32:04.828557 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.828534    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:32:04.851547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.850362    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-openshift-service-ca\") pod \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") "
Sep 15 09:32:04.851547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.850404    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-metrics-certs\") pod \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") "
Sep 15 09:32:04.851547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.850530    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls\") pod \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") "
Sep 15 09:32:04.851547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.850575    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9phxh\" (UniqueName: \"kubernetes.io/projected/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-kube-api-access-9phxh\") pod \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\" (UID: \"20f51f1a-9a52-4c55-8fe3-e4aa140cde96\") "
Sep 15 09:32:04.851547 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.851272    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20f51f1a-9a52-4c55-8fe3-e4aa140cde96" (UID: "20f51f1a-9a52-4c55-8fe3-e4aa140cde96"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:04.855002 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.854963    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20f51f1a-9a52-4c55-8fe3-e4aa140cde96" (UID: "20f51f1a-9a52-4c55-8fe3-e4aa140cde96"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:04.855177 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.855033    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "20f51f1a-9a52-4c55-8fe3-e4aa140cde96" (UID: "20f51f1a-9a52-4c55-8fe3-e4aa140cde96"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:04.855177 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.855109    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-kube-api-access-9phxh" (OuterVolumeSpecName: "kube-api-access-9phxh") pod "20f51f1a-9a52-4c55-8fe3-e4aa140cde96" (UID: "20f51f1a-9a52-4c55-8fe3-e4aa140cde96"). InnerVolumeSpecName "kube-api-access-9phxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:04.952427 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.952350    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:04.952427 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.952379    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9phxh\" (UniqueName: \"kubernetes.io/projected/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-kube-api-access-9phxh\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:04.952427 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.952395    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:04.952427 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.952410    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20f51f1a-9a52-4c55-8fe3-e4aa140cde96-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:04.957552 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:04.957518    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58291c44-48c7-4724-ab13-c5e520774683" path="/var/lib/kubelet/pods/58291c44-48c7-4724-ab13-c5e520774683/volumes"
Sep 15 09:32:05.274478 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:05.274445    2555 generic.go:356] "Generic (PLEG): container finished" podID="20f51f1a-9a52-4c55-8fe3-e4aa140cde96" containerID="7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525" exitCode=0
Sep 15 09:32:05.274891 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:05.274492    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"
Sep 15 09:32:05.274891 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:05.274511    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk" event={"ID":"20f51f1a-9a52-4c55-8fe3-e4aa140cde96","Type":"ContainerDied","Data":"7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525"}
Sep 15 09:32:05.274891 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:05.274553    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk" event={"ID":"20f51f1a-9a52-4c55-8fe3-e4aa140cde96","Type":"ContainerDied","Data":"fd333c59a8a0cf6b7ba7b45081599e92c39243e84c675ae854742d4faafa88a3"}
Sep 15 09:32:05.274891 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:05.274574    2555 scope.go:117] "RemoveContainer" containerID="7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525"
Sep 15 09:32:05.284871 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:05.284839    2555 scope.go:117] "RemoveContainer" containerID="7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525"
Sep 15 09:32:05.285138 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:32:05.285119    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525\": container with ID starting with 7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525 not found: ID does not exist" containerID="7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525"
Sep 15 09:32:05.285210 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:05.285144    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525"} err="failed to get container status \"7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525\": rpc error: code = NotFound desc = could not find container \"7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525\": container with ID starting with 7534d3fddb0c3e8e5b090d3c63e3768273bca25de12cf601e9228bb148079525 not found: ID does not exist"
Sep 15 09:32:05.292064 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:05.291909    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"]
Sep 15 09:32:05.294893 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:05.294875    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ffb593-b57b45c9d-9p9bk"]
Sep 15 09:32:06.956498 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:06.956456    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20f51f1a-9a52-4c55-8fe3-e4aa140cde96" path="/var/lib/kubelet/pods/20f51f1a-9a52-4c55-8fe3-e4aa140cde96/volumes"
Sep 15 09:32:15.097400 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.097357    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"]
Sep 15 09:32:15.100901 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.097589    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l" podUID="88f3fde9-9ee4-466b-8fea-88b29baa1f98" containerName="maas-api" containerID="cri-o://ea1a96e64533db017bd9105ad30afbbf2ed638734e80defa374e0eae6995209d" gracePeriod=30
Sep 15 09:32:15.342711 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.342679    2555 generic.go:356] "Generic (PLEG): container finished" podID="88f3fde9-9ee4-466b-8fea-88b29baa1f98" containerID="ea1a96e64533db017bd9105ad30afbbf2ed638734e80defa374e0eae6995209d" exitCode=0
Sep 15 09:32:15.342856 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.342748    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l" event={"ID":"88f3fde9-9ee4-466b-8fea-88b29baa1f98","Type":"ContainerDied","Data":"ea1a96e64533db017bd9105ad30afbbf2ed638734e80defa374e0eae6995209d"}
Sep 15 09:32:15.342856 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.342797    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l" event={"ID":"88f3fde9-9ee4-466b-8fea-88b29baa1f98","Type":"ContainerDied","Data":"b1fa4cf7b4008beb09e4c731bc76dc7725f1258c4f384d4fb68a6fd30ef01e69"}
Sep 15 09:32:15.342856 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.342813    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1fa4cf7b4008beb09e4c731bc76dc7725f1258c4f384d4fb68a6fd30ef01e69"
Sep 15 09:32:15.357092 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.357027    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:32:15.455362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.455328    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f3fde9-9ee4-466b-8fea-88b29baa1f98-openshift-service-ca\") pod \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") "
Sep 15 09:32:15.455362 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.455360    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cphpg\" (UniqueName: \"kubernetes.io/projected/88f3fde9-9ee4-466b-8fea-88b29baa1f98-kube-api-access-cphpg\") pod \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") "
Sep 15 09:32:15.455596 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.455425    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-metrics-certs\") pod \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") "
Sep 15 09:32:15.455596 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.455445    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-maas-api-tls\") pod \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\" (UID: \"88f3fde9-9ee4-466b-8fea-88b29baa1f98\") "
Sep 15 09:32:15.455778 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.455748    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f3fde9-9ee4-466b-8fea-88b29baa1f98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88f3fde9-9ee4-466b-8fea-88b29baa1f98" (UID: "88f3fde9-9ee4-466b-8fea-88b29baa1f98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:15.455919 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.455900    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f3fde9-9ee4-466b-8fea-88b29baa1f98-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:15.457672 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.457632    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f3fde9-9ee4-466b-8fea-88b29baa1f98-kube-api-access-cphpg" (OuterVolumeSpecName: "kube-api-access-cphpg") pod "88f3fde9-9ee4-466b-8fea-88b29baa1f98" (UID: "88f3fde9-9ee4-466b-8fea-88b29baa1f98"). InnerVolumeSpecName "kube-api-access-cphpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:15.457807 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.457702    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88f3fde9-9ee4-466b-8fea-88b29baa1f98" (UID: "88f3fde9-9ee4-466b-8fea-88b29baa1f98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:15.458040 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.457951    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "88f3fde9-9ee4-466b-8fea-88b29baa1f98" (UID: "88f3fde9-9ee4-466b-8fea-88b29baa1f98"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:15.557023 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.556991    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cphpg\" (UniqueName: \"kubernetes.io/projected/88f3fde9-9ee4-466b-8fea-88b29baa1f98-kube-api-access-cphpg\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:15.557023 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.557019    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:15.557023 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:15.557030    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f3fde9-9ee4-466b-8fea-88b29baa1f98-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.352023 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:16.351986    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"
Sep 15 09:32:16.375652 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:16.375624    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"]
Sep 15 09:32:16.379169 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:16.379142    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-730be9-75dfd6f599-j2w8l"]
Sep 15 09:32:16.955469 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:16.955433    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88f3fde9-9ee4-466b-8fea-88b29baa1f98" path="/var/lib/kubelet/pods/88f3fde9-9ee4-466b-8fea-88b29baa1f98/volumes"
Sep 15 09:32:37.870229 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:37.870190    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"]
Sep 15 09:32:37.870758 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:37.870425    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld" podUID="7759461a-40ab-4ab8-a619-eb274b8e1cff" containerName="maas-api" containerID="cri-o://eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e" gracePeriod=30
Sep 15 09:32:37.936233 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:37.936195    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"]
Sep 15 09:32:37.936486 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:37.936454    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz" podUID="4b528a10-e197-4627-9e8f-3a78263f4220" containerName="payload-pre-processing" containerID="cri-o://b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9" gracePeriod=30
Sep 15 09:32:38.218149 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.218123    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:32:38.221291 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.221272    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:32:38.281621 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.281591    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-maas-api-tls\") pod \"7759461a-40ab-4ab8-a619-eb274b8e1cff\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") "
Sep 15 09:32:38.281811 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.281632    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-metrics-certs\") pod \"7759461a-40ab-4ab8-a619-eb274b8e1cff\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") "
Sep 15 09:32:38.281811 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.281661    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvf6x\" (UniqueName: \"kubernetes.io/projected/7759461a-40ab-4ab8-a619-eb274b8e1cff-kube-api-access-jvf6x\") pod \"7759461a-40ab-4ab8-a619-eb274b8e1cff\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") "
Sep 15 09:32:38.281970 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.281828    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnrtq\" (UniqueName: \"kubernetes.io/projected/4b528a10-e197-4627-9e8f-3a78263f4220-kube-api-access-xnrtq\") pod \"4b528a10-e197-4627-9e8f-3a78263f4220\" (UID: \"4b528a10-e197-4627-9e8f-3a78263f4220\") "
Sep 15 09:32:38.282035 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.281982    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b528a10-e197-4627-9e8f-3a78263f4220-plugins-config-volume\") pod \"4b528a10-e197-4627-9e8f-3a78263f4220\" (UID: \"4b528a10-e197-4627-9e8f-3a78263f4220\") "
Sep 15 09:32:38.282101 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.282034    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7759461a-40ab-4ab8-a619-eb274b8e1cff-openshift-service-ca\") pod \"7759461a-40ab-4ab8-a619-eb274b8e1cff\" (UID: \"7759461a-40ab-4ab8-a619-eb274b8e1cff\") "
Sep 15 09:32:38.282662 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.282632    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7759461a-40ab-4ab8-a619-eb274b8e1cff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7759461a-40ab-4ab8-a619-eb274b8e1cff" (UID: "7759461a-40ab-4ab8-a619-eb274b8e1cff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:38.282807 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.282648    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b528a10-e197-4627-9e8f-3a78263f4220-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b528a10-e197-4627-9e8f-3a78263f4220" (UID: "4b528a10-e197-4627-9e8f-3a78263f4220"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:38.284046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.284020    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7759461a-40ab-4ab8-a619-eb274b8e1cff" (UID: "7759461a-40ab-4ab8-a619-eb274b8e1cff"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:38.284206 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.284179    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b528a10-e197-4627-9e8f-3a78263f4220-kube-api-access-xnrtq" (OuterVolumeSpecName: "kube-api-access-xnrtq") pod "4b528a10-e197-4627-9e8f-3a78263f4220" (UID: "4b528a10-e197-4627-9e8f-3a78263f4220"). InnerVolumeSpecName "kube-api-access-xnrtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:38.284371 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.284355    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7759461a-40ab-4ab8-a619-eb274b8e1cff-kube-api-access-jvf6x" (OuterVolumeSpecName: "kube-api-access-jvf6x") pod "7759461a-40ab-4ab8-a619-eb274b8e1cff" (UID: "7759461a-40ab-4ab8-a619-eb274b8e1cff"). InnerVolumeSpecName "kube-api-access-jvf6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:38.284586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.284554    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7759461a-40ab-4ab8-a619-eb274b8e1cff" (UID: "7759461a-40ab-4ab8-a619-eb274b8e1cff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:38.383576 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.383545    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b528a10-e197-4627-9e8f-3a78263f4220-plugins-config-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:38.383576 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.383572    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7759461a-40ab-4ab8-a619-eb274b8e1cff-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:38.383576 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.383583    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:38.383800 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.383592    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759461a-40ab-4ab8-a619-eb274b8e1cff-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:38.383800 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.383599    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvf6x\" (UniqueName: \"kubernetes.io/projected/7759461a-40ab-4ab8-a619-eb274b8e1cff-kube-api-access-jvf6x\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:38.383800 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.383607    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnrtq\" (UniqueName: \"kubernetes.io/projected/4b528a10-e197-4627-9e8f-3a78263f4220-kube-api-access-xnrtq\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:38.510671 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.510635    2555 generic.go:356] "Generic (PLEG): container finished" podID="4b528a10-e197-4627-9e8f-3a78263f4220" containerID="b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9" exitCode=0
Sep 15 09:32:38.510873 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.510701    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"
Sep 15 09:32:38.510873 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.510727    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz" event={"ID":"4b528a10-e197-4627-9e8f-3a78263f4220","Type":"ContainerDied","Data":"b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9"}
Sep 15 09:32:38.510873 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.510825    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz" event={"ID":"4b528a10-e197-4627-9e8f-3a78263f4220","Type":"ContainerDied","Data":"9d3d81e2e759af1075498c9049ba8a96cc288f247990678484b24dcbb969bc50"}
Sep 15 09:32:38.511377 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.510883    2555 scope.go:117] "RemoveContainer" containerID="b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9"
Sep 15 09:32:38.512257 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.512237    2555 generic.go:356] "Generic (PLEG): container finished" podID="7759461a-40ab-4ab8-a619-eb274b8e1cff" containerID="eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e" exitCode=0
Sep 15 09:32:38.512336 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.512304    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"
Sep 15 09:32:38.512336 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.512310    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld" event={"ID":"7759461a-40ab-4ab8-a619-eb274b8e1cff","Type":"ContainerDied","Data":"eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e"}
Sep 15 09:32:38.512451 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.512364    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld" event={"ID":"7759461a-40ab-4ab8-a619-eb274b8e1cff","Type":"ContainerDied","Data":"49c7069f8e8fe77cbc7d0838556af6f02b6434a872768d29bbb5ff30743976e7"}
Sep 15 09:32:38.520542 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.520522    2555 scope.go:117] "RemoveContainer" containerID="b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9"
Sep 15 09:32:38.520933 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:32:38.520904    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9\": container with ID starting with b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9 not found: ID does not exist" containerID="b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9"
Sep 15 09:32:38.521072 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.520943    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9"} err="failed to get container status \"b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9\": rpc error: code = NotFound desc = could not find container \"b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9\": container with ID starting with b3e19a975ab0c02c382a41846c6d1c6655641d2375a4214d99bfa7033c32dee9 not found: ID does not exist"
Sep 15 09:32:38.521072 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.520968    2555 scope.go:117] "RemoveContainer" containerID="eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e"
Sep 15 09:32:38.531086 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.531070    2555 scope.go:117] "RemoveContainer" containerID="eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e"
Sep 15 09:32:38.531330 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:32:38.531312    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e\": container with ID starting with eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e not found: ID does not exist" containerID="eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e"
Sep 15 09:32:38.531393 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.531335    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e"} err="failed to get container status \"eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e\": rpc error: code = NotFound desc = could not find container \"eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e\": container with ID starting with eab52b35ec235f857de3a770a45aabbc0a371bb6d66259a63b66467adf487d0e not found: ID does not exist"
Sep 15 09:32:38.537437 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.537417    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"]
Sep 15 09:32:38.545133 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.545111    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz"]
Sep 15 09:32:38.566665 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.566639    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"]
Sep 15 09:32:38.576399 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.576378    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ff390e-5988b9d9df-qpxld"]
Sep 15 09:32:38.958681 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.958586    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b528a10-e197-4627-9e8f-3a78263f4220" path="/var/lib/kubelet/pods/4b528a10-e197-4627-9e8f-3a78263f4220/volumes"
Sep 15 09:32:38.959248 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:38.959224    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7759461a-40ab-4ab8-a619-eb274b8e1cff" path="/var/lib/kubelet/pods/7759461a-40ab-4ab8-a619-eb274b8e1cff/volumes"
Sep 15 09:32:55.500891 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.500837    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"]
Sep 15 09:32:55.501311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.501144    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc" podUID="08cc102d-879c-408d-9ced-6190c62a7466" containerName="maas-api" containerID="cri-o://47f35951cd00fd3ba3917c2e8cce9a0f3cdcd91ff14ae570886784258c351717" gracePeriod=30
Sep 15 09:32:55.567946 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.567909    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"]
Sep 15 09:32:55.568187 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.568156    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g" podUID="d2d9eb67-d112-4693-9a9a-2357946c2157" containerName="payload-pre-processing" containerID="cri-o://f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9" gracePeriod=30
Sep 15 09:32:55.630947 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.630918    2555 generic.go:356] "Generic (PLEG): container finished" podID="08cc102d-879c-408d-9ced-6190c62a7466" containerID="47f35951cd00fd3ba3917c2e8cce9a0f3cdcd91ff14ae570886784258c351717" exitCode=0
Sep 15 09:32:55.631108 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.630985    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc" event={"ID":"08cc102d-879c-408d-9ced-6190c62a7466","Type":"ContainerDied","Data":"47f35951cd00fd3ba3917c2e8cce9a0f3cdcd91ff14ae570886784258c351717"}
Sep 15 09:32:55.824202 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.824180    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:32:55.858683 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.858652    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:32:55.965435 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.965405    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-maas-api-tls\") pod \"08cc102d-879c-408d-9ced-6190c62a7466\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") "
Sep 15 09:32:55.965435 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.965436    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2d9eb67-d112-4693-9a9a-2357946c2157-plugins-config-volume\") pod \"d2d9eb67-d112-4693-9a9a-2357946c2157\" (UID: \"d2d9eb67-d112-4693-9a9a-2357946c2157\") "
Sep 15 09:32:55.965659 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.965485    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll7k6\" (UniqueName: \"kubernetes.io/projected/08cc102d-879c-408d-9ced-6190c62a7466-kube-api-access-ll7k6\") pod \"08cc102d-879c-408d-9ced-6190c62a7466\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") "
Sep 15 09:32:55.965659 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.965509    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08cc102d-879c-408d-9ced-6190c62a7466-openshift-service-ca\") pod \"08cc102d-879c-408d-9ced-6190c62a7466\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") "
Sep 15 09:32:55.965659 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.965539    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-metrics-certs\") pod \"08cc102d-879c-408d-9ced-6190c62a7466\" (UID: \"08cc102d-879c-408d-9ced-6190c62a7466\") "
Sep 15 09:32:55.965659 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.965586    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjwkr\" (UniqueName: \"kubernetes.io/projected/d2d9eb67-d112-4693-9a9a-2357946c2157-kube-api-access-rjwkr\") pod \"d2d9eb67-d112-4693-9a9a-2357946c2157\" (UID: \"d2d9eb67-d112-4693-9a9a-2357946c2157\") "
Sep 15 09:32:55.965926 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.965898    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08cc102d-879c-408d-9ced-6190c62a7466-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "08cc102d-879c-408d-9ced-6190c62a7466" (UID: "08cc102d-879c-408d-9ced-6190c62a7466"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:55.965994 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.965925    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d9eb67-d112-4693-9a9a-2357946c2157-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2d9eb67-d112-4693-9a9a-2357946c2157" (UID: "d2d9eb67-d112-4693-9a9a-2357946c2157"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:55.966054 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.966034    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08cc102d-879c-408d-9ced-6190c62a7466-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:55.966054 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.966050    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2d9eb67-d112-4693-9a9a-2357946c2157-plugins-config-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:55.967645 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.967620    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "08cc102d-879c-408d-9ced-6190c62a7466" (UID: "08cc102d-879c-408d-9ced-6190c62a7466"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:55.967775 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.967676    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08cc102d-879c-408d-9ced-6190c62a7466-kube-api-access-ll7k6" (OuterVolumeSpecName: "kube-api-access-ll7k6") pod "08cc102d-879c-408d-9ced-6190c62a7466" (UID: "08cc102d-879c-408d-9ced-6190c62a7466"). InnerVolumeSpecName "kube-api-access-ll7k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:55.967942 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.967925    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "08cc102d-879c-408d-9ced-6190c62a7466" (UID: "08cc102d-879c-408d-9ced-6190c62a7466"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:55.967993 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:55.967983    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d9eb67-d112-4693-9a9a-2357946c2157-kube-api-access-rjwkr" (OuterVolumeSpecName: "kube-api-access-rjwkr") pod "d2d9eb67-d112-4693-9a9a-2357946c2157" (UID: "d2d9eb67-d112-4693-9a9a-2357946c2157"). InnerVolumeSpecName "kube-api-access-rjwkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:56.066971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.066894    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:56.066971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.066923    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjwkr\" (UniqueName: \"kubernetes.io/projected/d2d9eb67-d112-4693-9a9a-2357946c2157-kube-api-access-rjwkr\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:56.066971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.066933    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08cc102d-879c-408d-9ced-6190c62a7466-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:56.066971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.066942    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll7k6\" (UniqueName: \"kubernetes.io/projected/08cc102d-879c-408d-9ced-6190c62a7466-kube-api-access-ll7k6\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:32:56.638298 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.638265    2555 generic.go:356] "Generic (PLEG): container finished" podID="d2d9eb67-d112-4693-9a9a-2357946c2157" containerID="f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9" exitCode=0
Sep 15 09:32:56.638762 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.638307    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"
Sep 15 09:32:56.638762 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.638349    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g" event={"ID":"d2d9eb67-d112-4693-9a9a-2357946c2157","Type":"ContainerDied","Data":"f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9"}
Sep 15 09:32:56.638762 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.638412    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g" event={"ID":"d2d9eb67-d112-4693-9a9a-2357946c2157","Type":"ContainerDied","Data":"afa2b085535dbcb1b697deb76a7b8d39b5f20ffac5eaa83d5a90e00d645d555a"}
Sep 15 09:32:56.638762 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.638448    2555 scope.go:117] "RemoveContainer" containerID="f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9"
Sep 15 09:32:56.639907 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.639797    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc" event={"ID":"08cc102d-879c-408d-9ced-6190c62a7466","Type":"ContainerDied","Data":"ee94295541c4c5297a4751e6e127d98606835167a48f905e8375c7c9f5b63806"}
Sep 15 09:32:56.639907 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.639802    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"
Sep 15 09:32:56.651415 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.651366    2555 scope.go:117] "RemoveContainer" containerID="f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9"
Sep 15 09:32:56.652304 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:32:56.652279    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9\": container with ID starting with f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9 not found: ID does not exist" containerID="f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9"
Sep 15 09:32:56.652458 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.652435    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9"} err="failed to get container status \"f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9\": rpc error: code = NotFound desc = could not find container \"f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9\": container with ID starting with f1bb90b5efd75e2a21e5611b628bfdb4ae148db6cc4bd5ac25c6241c7a8693d9 not found: ID does not exist"
Sep 15 09:32:56.652556 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.652546    2555 scope.go:117] "RemoveContainer" containerID="47f35951cd00fd3ba3917c2e8cce9a0f3cdcd91ff14ae570886784258c351717"
Sep 15 09:32:56.669266 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.669241    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"]
Sep 15 09:32:56.673322 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.673292    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g"]
Sep 15 09:32:56.683494 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.683473    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"]
Sep 15 09:32:56.689598 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.689575    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-577f23-84bdd768f4-k6mtc"]
Sep 15 09:32:56.958439 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.958359    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08cc102d-879c-408d-9ced-6190c62a7466" path="/var/lib/kubelet/pods/08cc102d-879c-408d-9ced-6190c62a7466/volumes"
Sep 15 09:32:56.958940 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:32:56.958924    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2d9eb67-d112-4693-9a9a-2357946c2157" path="/var/lib/kubelet/pods/d2d9eb67-d112-4693-9a9a-2357946c2157/volumes"
Sep 15 09:33:21.883715 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:21.883670    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"]
Sep 15 09:33:21.884308 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:21.883947    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7" podUID="55dca501-4caa-4327-9ab9-847537b30321" containerName="maas-api" containerID="cri-o://47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf" gracePeriod=30
Sep 15 09:33:21.937721 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:21.937689    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"]
Sep 15 09:33:21.937964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:21.937918    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd" podUID="fdd2894d-ca0e-4713-b4e8-224ec9e81bac" containerName="payload-processing" containerID="cri-o://cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017" gracePeriod=30
Sep 15 09:33:22.195676 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.195650    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:33:22.218043 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.218018    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-metrics-certs\") pod \"55dca501-4caa-4327-9ab9-847537b30321\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") "
Sep 15 09:33:22.218180 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.218087    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-maas-api-tls\") pod \"55dca501-4caa-4327-9ab9-847537b30321\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") "
Sep 15 09:33:22.218180 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.218153    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55dca501-4caa-4327-9ab9-847537b30321-openshift-service-ca\") pod \"55dca501-4caa-4327-9ab9-847537b30321\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") "
Sep 15 09:33:22.218278 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.218194    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdg25\" (UniqueName: \"kubernetes.io/projected/55dca501-4caa-4327-9ab9-847537b30321-kube-api-access-qdg25\") pod \"55dca501-4caa-4327-9ab9-847537b30321\" (UID: \"55dca501-4caa-4327-9ab9-847537b30321\") "
Sep 15 09:33:22.218841 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.218795    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55dca501-4caa-4327-9ab9-847537b30321-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55dca501-4caa-4327-9ab9-847537b30321" (UID: "55dca501-4caa-4327-9ab9-847537b30321"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:22.221324 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.221285    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "55dca501-4caa-4327-9ab9-847537b30321" (UID: "55dca501-4caa-4327-9ab9-847537b30321"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:33:22.221420 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.221340    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55dca501-4caa-4327-9ab9-847537b30321" (UID: "55dca501-4caa-4327-9ab9-847537b30321"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:33:22.221656 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.221630    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55dca501-4caa-4327-9ab9-847537b30321-kube-api-access-qdg25" (OuterVolumeSpecName: "kube-api-access-qdg25") pod "55dca501-4caa-4327-9ab9-847537b30321" (UID: "55dca501-4caa-4327-9ab9-847537b30321"). InnerVolumeSpecName "kube-api-access-qdg25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:22.227324 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.227304    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:33:22.319466 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.319422    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-plugins-config-volume\") pod \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\" (UID: \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\") "
Sep 15 09:33:22.319648 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.319540    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkrsl\" (UniqueName: \"kubernetes.io/projected/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-kube-api-access-pkrsl\") pod \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\" (UID: \"fdd2894d-ca0e-4713-b4e8-224ec9e81bac\") "
Sep 15 09:33:22.319782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.319770    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdg25\" (UniqueName: \"kubernetes.io/projected/55dca501-4caa-4327-9ab9-847537b30321-kube-api-access-qdg25\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.319821 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.319771    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fdd2894d-ca0e-4713-b4e8-224ec9e81bac" (UID: "fdd2894d-ca0e-4713-b4e8-224ec9e81bac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:22.319821 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.319783    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.319821 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.319814    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55dca501-4caa-4327-9ab9-847537b30321-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.319956 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.319824    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55dca501-4caa-4327-9ab9-847537b30321-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.321582 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.321562    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-kube-api-access-pkrsl" (OuterVolumeSpecName: "kube-api-access-pkrsl") pod "fdd2894d-ca0e-4713-b4e8-224ec9e81bac" (UID: "fdd2894d-ca0e-4713-b4e8-224ec9e81bac"). InnerVolumeSpecName "kube-api-access-pkrsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:22.421248 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.421167    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-plugins-config-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.421248 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.421195    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkrsl\" (UniqueName: \"kubernetes.io/projected/fdd2894d-ca0e-4713-b4e8-224ec9e81bac-kube-api-access-pkrsl\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.815924 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.815884    2555 generic.go:356] "Generic (PLEG): container finished" podID="55dca501-4caa-4327-9ab9-847537b30321" containerID="47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf" exitCode=0
Sep 15 09:33:22.815924 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.815927    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"
Sep 15 09:33:22.816196 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.815967    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7" event={"ID":"55dca501-4caa-4327-9ab9-847537b30321","Type":"ContainerDied","Data":"47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf"}
Sep 15 09:33:22.816196 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.816026    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7" event={"ID":"55dca501-4caa-4327-9ab9-847537b30321","Type":"ContainerDied","Data":"2226024151d293b0ffab305f3562b9241f8b08774b49dc6de48886001471845c"}
Sep 15 09:33:22.816196 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.816054    2555 scope.go:117] "RemoveContainer" containerID="47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf"
Sep 15 09:33:22.817979 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.817955    2555 generic.go:356] "Generic (PLEG): container finished" podID="fdd2894d-ca0e-4713-b4e8-224ec9e81bac" containerID="cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017" exitCode=0
Sep 15 09:33:22.818087 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.818003    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"
Sep 15 09:33:22.818146 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.818082    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd" event={"ID":"fdd2894d-ca0e-4713-b4e8-224ec9e81bac","Type":"ContainerDied","Data":"cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017"}
Sep 15 09:33:22.818146 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.818132    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd" event={"ID":"fdd2894d-ca0e-4713-b4e8-224ec9e81bac","Type":"ContainerDied","Data":"4a4b867cf7646cbb914f433ddfdda4b4831f1a70f10651e657de35869d7c5c1d"}
Sep 15 09:33:22.827751 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.827731    2555 scope.go:117] "RemoveContainer" containerID="47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf"
Sep 15 09:33:22.828037 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:33:22.828014    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf\": container with ID starting with 47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf not found: ID does not exist" containerID="47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf"
Sep 15 09:33:22.828134 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.828047    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf"} err="failed to get container status \"47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf\": rpc error: code = NotFound desc = could not find container \"47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf\": container with ID starting with 47a16dc9f6c5046680e1b7ed4e60f2195c149b3fb5ed3d12d89d41feda2d5cdf not found: ID does not exist"
Sep 15 09:33:22.828134 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.828070    2555 scope.go:117] "RemoveContainer" containerID="cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017"
Sep 15 09:33:22.836630 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.836611    2555 scope.go:117] "RemoveContainer" containerID="cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017"
Sep 15 09:33:22.836913 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:33:22.836891    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017\": container with ID starting with cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017 not found: ID does not exist" containerID="cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017"
Sep 15 09:33:22.836964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.836922    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017"} err="failed to get container status \"cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017\": rpc error: code = NotFound desc = could not find container \"cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017\": container with ID starting with cfd8458837ec97993c21d10755c2b5242f94833cbf2a9223dbdce324c7374017 not found: ID does not exist"
Sep 15 09:33:22.849578 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.849545    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"]
Sep 15 09:33:22.863821 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.863793    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-890f3e-55bfbdff78-xxps7"]
Sep 15 09:33:22.866898 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.866870    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"]
Sep 15 09:33:22.869248 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.869227    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd"]
Sep 15 09:33:22.957230 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.957196    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55dca501-4caa-4327-9ab9-847537b30321" path="/var/lib/kubelet/pods/55dca501-4caa-4327-9ab9-847537b30321/volumes"
Sep 15 09:33:22.957576 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:33:22.957558    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdd2894d-ca0e-4713-b4e8-224ec9e81bac" path="/var/lib/kubelet/pods/fdd2894d-ca0e-4713-b4e8-224ec9e81bac/volumes"
Sep 15 09:34:07.791515 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:07.791480    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"]
Sep 15 09:34:22.811171 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:22.811105    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6" podUID="7dd6b784-50e4-4ead-ab39-2c91d216f3af" containerName="main" containerID="cri-o://50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821" gracePeriod=45
Sep 15 09:34:23.083093 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.083068    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:34:23.204796 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.204763    2555 generic.go:356] "Generic (PLEG): container finished" podID="7dd6b784-50e4-4ead-ab39-2c91d216f3af" containerID="50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821" exitCode=0
Sep 15 09:34:23.204964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.204808    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"
Sep 15 09:34:23.204964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.204856    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6" event={"ID":"7dd6b784-50e4-4ead-ab39-2c91d216f3af","Type":"ContainerDied","Data":"50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821"}
Sep 15 09:34:23.204964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.204903    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6" event={"ID":"7dd6b784-50e4-4ead-ab39-2c91d216f3af","Type":"ContainerDied","Data":"bc4b20f1c4d7b724978f754175b6309bb3130b0e9c9741b6d79284cc80603719"}
Sep 15 09:34:23.204964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.204929    2555 scope.go:117] "RemoveContainer" containerID="50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821"
Sep 15 09:34:23.213787 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.213771    2555 scope.go:117] "RemoveContainer" containerID="50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821"
Sep 15 09:34:23.214112 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:34:23.214087    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821\": container with ID starting with 50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821 not found: ID does not exist" containerID="50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821"
Sep 15 09:34:23.214170 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.214121    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821"} err="failed to get container status \"50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821\": rpc error: code = NotFound desc = could not find container \"50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821\": container with ID starting with 50a0a817acd545bd3641dfd28587c2a3049fdbcb5776cfb80bc5868f21604821 not found: ID does not exist"
Sep 15 09:34:23.234610 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.234586    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-model-cache\") pod \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") "
Sep 15 09:34:23.234695 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.234626    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tmp-dir\") pod \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") "
Sep 15 09:34:23.234733 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.234718    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqg64\" (UniqueName: \"kubernetes.io/projected/7dd6b784-50e4-4ead-ab39-2c91d216f3af-kube-api-access-gqg64\") pod \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") "
Sep 15 09:34:23.234784 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.234746    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-home\") pod \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") "
Sep 15 09:34:23.234784 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.234776    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-dshm\") pod \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") "
Sep 15 09:34:23.234903 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.234813    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tls-certs\") pod \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\" (UID: \"7dd6b784-50e4-4ead-ab39-2c91d216f3af\") "
Sep 15 09:34:23.234903 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.234880    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-model-cache" (OuterVolumeSpecName: "model-cache") pod "7dd6b784-50e4-4ead-ab39-2c91d216f3af" (UID: "7dd6b784-50e4-4ead-ab39-2c91d216f3af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:34:23.235029 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.234982    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7dd6b784-50e4-4ead-ab39-2c91d216f3af" (UID: "7dd6b784-50e4-4ead-ab39-2c91d216f3af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:34:23.235092 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.235038    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-home" (OuterVolumeSpecName: "home") pod "7dd6b784-50e4-4ead-ab39-2c91d216f3af" (UID: "7dd6b784-50e4-4ead-ab39-2c91d216f3af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:34:23.235220 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.235204    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-model-cache\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:34:23.235273 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.235227    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tmp-dir\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:34:23.235273 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.235240    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-home\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:34:23.236911 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.236881    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7dd6b784-50e4-4ead-ab39-2c91d216f3af" (UID: "7dd6b784-50e4-4ead-ab39-2c91d216f3af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:34:23.237006 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.236941    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd6b784-50e4-4ead-ab39-2c91d216f3af-kube-api-access-gqg64" (OuterVolumeSpecName: "kube-api-access-gqg64") pod "7dd6b784-50e4-4ead-ab39-2c91d216f3af" (UID: "7dd6b784-50e4-4ead-ab39-2c91d216f3af"). InnerVolumeSpecName "kube-api-access-gqg64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:34:23.237006 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.236959    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-dshm" (OuterVolumeSpecName: "dshm") pod "7dd6b784-50e4-4ead-ab39-2c91d216f3af" (UID: "7dd6b784-50e4-4ead-ab39-2c91d216f3af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:34:23.336750 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.336659    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqg64\" (UniqueName: \"kubernetes.io/projected/7dd6b784-50e4-4ead-ab39-2c91d216f3af-kube-api-access-gqg64\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:34:23.336750 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.336692    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dd6b784-50e4-4ead-ab39-2c91d216f3af-dshm\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:34:23.336750 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.336705    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dd6b784-50e4-4ead-ab39-2c91d216f3af-tls-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:34:23.527839 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.527808    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"]
Sep 15 09:34:23.531339 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:23.531312    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8dd3bd/auth-test-model-8dd3bd-kserve-d96d8474c-4mpl6"]
Sep 15 09:34:24.957160 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:34:24.957126    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dd6b784-50e4-4ead-ab39-2c91d216f3af" path="/var/lib/kubelet/pods/7dd6b784-50e4-4ead-ab39-2c91d216f3af/volumes"
Sep 15 09:35:11.299259 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299221    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7741-7e1597"]
Sep 15 09:35:11.299708 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299668    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55dca501-4caa-4327-9ab9-847537b30321" containerName="maas-api"
Sep 15 09:35:11.299708 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299681    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="55dca501-4caa-4327-9ab9-847537b30321" containerName="maas-api"
Sep 15 09:35:11.299708 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299693    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b528a10-e197-4627-9e8f-3a78263f4220" containerName="payload-pre-processing"
Sep 15 09:35:11.299708 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299698    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b528a10-e197-4627-9e8f-3a78263f4220" containerName="payload-pre-processing"
Sep 15 09:35:11.299708 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299706    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d9eb67-d112-4693-9a9a-2357946c2157" containerName="payload-pre-processing"
Sep 15 09:35:11.299708 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299712    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d9eb67-d112-4693-9a9a-2357946c2157" containerName="payload-pre-processing"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299720    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58291c44-48c7-4724-ab13-c5e520774683" containerName="main"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299726    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="58291c44-48c7-4724-ab13-c5e520774683" containerName="main"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299732    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08cc102d-879c-408d-9ced-6190c62a7466" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299737    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08cc102d-879c-408d-9ced-6190c62a7466" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299744    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd6b784-50e4-4ead-ab39-2c91d216f3af" containerName="main"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299748    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd6b784-50e4-4ead-ab39-2c91d216f3af" containerName="main"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299756    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20f51f1a-9a52-4c55-8fe3-e4aa140cde96" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299761    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="20f51f1a-9a52-4c55-8fe3-e4aa140cde96" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299769    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f3fde9-9ee4-466b-8fea-88b29baa1f98" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299774    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f3fde9-9ee4-466b-8fea-88b29baa1f98" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299786    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd2894d-ca0e-4713-b4e8-224ec9e81bac" containerName="payload-processing"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299792    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd2894d-ca0e-4713-b4e8-224ec9e81bac" containerName="payload-processing"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299797    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7759461a-40ab-4ab8-a619-eb274b8e1cff" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299801    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7759461a-40ab-4ab8-a619-eb274b8e1cff" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299891    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="08cc102d-879c-408d-9ced-6190c62a7466" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299900    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="58291c44-48c7-4724-ab13-c5e520774683" containerName="main"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299907    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b528a10-e197-4627-9e8f-3a78263f4220" containerName="payload-pre-processing"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299916    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd6b784-50e4-4ead-ab39-2c91d216f3af" containerName="main"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299922    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="55dca501-4caa-4327-9ab9-847537b30321" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299928    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d9eb67-d112-4693-9a9a-2357946c2157" containerName="payload-pre-processing"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299934    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="20f51f1a-9a52-4c55-8fe3-e4aa140cde96" containerName="maas-api"
Sep 15 09:35:11.299932 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299940    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f3fde9-9ee4-466b-8fea-88b29baa1f98" containerName="maas-api"
Sep 15 09:35:11.300592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299945    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7759461a-40ab-4ab8-a619-eb274b8e1cff" containerName="maas-api"
Sep 15 09:35:11.300592 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.299951    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdd2894d-ca0e-4713-b4e8-224ec9e81bac" containerName="payload-processing"
Sep 15 09:35:11.302983 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.302967    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7741-7e1597"
Sep 15 09:35:11.308569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.308504    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7g2n6\""
Sep 15 09:35:11.312335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.312315    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7741-7e1597"]
Sep 15 09:35:11.399415 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.399375    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xwxq\" (UniqueName: \"kubernetes.io/projected/33c30e57-8a05-4d13-b6d8-f355b0ecbd06-kube-api-access-5xwxq\") pod \"test-curl-7741-7e1597\" (UID: \"33c30e57-8a05-4d13-b6d8-f355b0ecbd06\") " pod="opendatahub/test-curl-7741-7e1597"
Sep 15 09:35:11.500708 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.500677    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xwxq\" (UniqueName: \"kubernetes.io/projected/33c30e57-8a05-4d13-b6d8-f355b0ecbd06-kube-api-access-5xwxq\") pod \"test-curl-7741-7e1597\" (UID: \"33c30e57-8a05-4d13-b6d8-f355b0ecbd06\") " pod="opendatahub/test-curl-7741-7e1597"
Sep 15 09:35:11.509122 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.509094    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xwxq\" (UniqueName: \"kubernetes.io/projected/33c30e57-8a05-4d13-b6d8-f355b0ecbd06-kube-api-access-5xwxq\") pod \"test-curl-7741-7e1597\" (UID: \"33c30e57-8a05-4d13-b6d8-f355b0ecbd06\") " pod="opendatahub/test-curl-7741-7e1597"
Sep 15 09:35:11.614364 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.614283    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7741-7e1597"
Sep 15 09:35:11.883988 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:11.883657    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7741-7e1597"]
Sep 15 09:35:11.887937 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:35:11.887908    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33c30e57_8a05_4d13_b6d8_f355b0ecbd06.slice/crio-d911fa82774f6336c7571c44d7ef5ac0cda840d9a50ea47abe1e702d7a7f6f17 WatchSource:0}: Error finding container d911fa82774f6336c7571c44d7ef5ac0cda840d9a50ea47abe1e702d7a7f6f17: Status 404 returned error can't find the container with id d911fa82774f6336c7571c44d7ef5ac0cda840d9a50ea47abe1e702d7a7f6f17
Sep 15 09:35:12.506505 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:12.506465    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7741-7e1597" event={"ID":"33c30e57-8a05-4d13-b6d8-f355b0ecbd06","Type":"ContainerStarted","Data":"98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d"}
Sep 15 09:35:12.506505 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:12.506514    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7741-7e1597" event={"ID":"33c30e57-8a05-4d13-b6d8-f355b0ecbd06","Type":"ContainerStarted","Data":"d911fa82774f6336c7571c44d7ef5ac0cda840d9a50ea47abe1e702d7a7f6f17"}
Sep 15 09:35:12.524396 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:12.524352    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7741-7e1597" podStartSLOduration=1.524336197 podStartE2EDuration="1.524336197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:35:12.522048689 +0000 UTC m=+1700.111873038" watchObservedRunningTime="2026-09-15 09:35:12.524336197 +0000 UTC m=+1700.114160545"
Sep 15 09:35:13.097991 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.097955    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7741-7e1597"]
Sep 15 09:35:13.102062 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.102032    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7741-7e1597"]
Sep 15 09:35:13.214372 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.214277    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7741-f474a0"]
Sep 15 09:35:13.214825 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.214805    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c30e57-8a05-4d13-b6d8-f355b0ecbd06" containerName="test-curl-7741-7e1597"
Sep 15 09:35:13.214960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.214828    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c30e57-8a05-4d13-b6d8-f355b0ecbd06" containerName="test-curl-7741-7e1597"
Sep 15 09:35:13.214960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.214948    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="33c30e57-8a05-4d13-b6d8-f355b0ecbd06" containerName="test-curl-7741-7e1597"
Sep 15 09:35:13.218129 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.218108    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7741-f474a0"
Sep 15 09:35:13.223060 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.223033    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7741-f474a0"]
Sep 15 09:35:13.317771 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.317737    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkgn\" (UniqueName: \"kubernetes.io/projected/08253478-959a-4a6d-9abe-362bafe3cf39-kube-api-access-jxkgn\") pod \"test-curl-7741-f474a0\" (UID: \"08253478-959a-4a6d-9abe-362bafe3cf39\") " pod="opendatahub/test-curl-7741-f474a0"
Sep 15 09:35:13.419166 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.419130    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkgn\" (UniqueName: \"kubernetes.io/projected/08253478-959a-4a6d-9abe-362bafe3cf39-kube-api-access-jxkgn\") pod \"test-curl-7741-f474a0\" (UID: \"08253478-959a-4a6d-9abe-362bafe3cf39\") " pod="opendatahub/test-curl-7741-f474a0"
Sep 15 09:35:13.427520 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.427498    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkgn\" (UniqueName: \"kubernetes.io/projected/08253478-959a-4a6d-9abe-362bafe3cf39-kube-api-access-jxkgn\") pod \"test-curl-7741-f474a0\" (UID: \"08253478-959a-4a6d-9abe-362bafe3cf39\") " pod="opendatahub/test-curl-7741-f474a0"
Sep 15 09:35:13.512682 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:35:13.512649    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7741-7e1597" container="test-curl-7741-7e1597"
Sep 15 09:35:13.529318 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.529295    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7741-f474a0"
Sep 15 09:35:13.807600 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:13.807570    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7741-f474a0"]
Sep 15 09:35:13.808924 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:35:13.808883    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08253478_959a_4a6d_9abe_362bafe3cf39.slice/crio-35416ace45b9c46dedbf1a43c5779e807a5a17e9b42e63513e6f45912abebdde WatchSource:0}: Error finding container 35416ace45b9c46dedbf1a43c5779e807a5a17e9b42e63513e6f45912abebdde: Status 404 returned error can't find the container with id 35416ace45b9c46dedbf1a43c5779e807a5a17e9b42e63513e6f45912abebdde
Sep 15 09:35:14.520035 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:14.520000    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7741-f474a0" event={"ID":"08253478-959a-4a6d-9abe-362bafe3cf39","Type":"ContainerStarted","Data":"3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1"}
Sep 15 09:35:14.520035 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:14.520040    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7741-f474a0" event={"ID":"08253478-959a-4a6d-9abe-362bafe3cf39","Type":"ContainerStarted","Data":"35416ace45b9c46dedbf1a43c5779e807a5a17e9b42e63513e6f45912abebdde"}
Sep 15 09:35:14.520533 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:14.520103    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7741-7e1597" podUID="33c30e57-8a05-4d13-b6d8-f355b0ecbd06" containerName="test-curl-7741-7e1597" containerID="cri-o://98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d" gracePeriod=2
Sep 15 09:35:14.522675 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:35:14.522646    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7741-7e1597\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="33c30e57-8a05-4d13-b6d8-f355b0ecbd06" pod="opendatahub/test-curl-7741-7e1597"
Sep 15 09:35:14.536904 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:14.536838    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7741-f474a0" podStartSLOduration=1.536824308 podStartE2EDuration="1.536824308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:35:14.535790993 +0000 UTC m=+1702.125615341" watchObservedRunningTime="2026-09-15 09:35:14.536824308 +0000 UTC m=+1702.126648656"
Sep 15 09:35:14.538065 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:35:14.538036    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7741-7e1597\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="33c30e57-8a05-4d13-b6d8-f355b0ecbd06" pod="opendatahub/test-curl-7741-7e1597"
Sep 15 09:35:15.093301 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:15.093261    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7741-f474a0"]
Sep 15 09:35:15.100396 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:15.100364    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7741-f474a0"]
Sep 15 09:35:15.526593 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:35:15.526565    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7741-f474a0" container="test-curl-7741-f474a0"
Sep 15 09:35:16.533311 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:16.533279    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7741-f474a0" podUID="08253478-959a-4a6d-9abe-362bafe3cf39" containerName="test-curl-7741-f474a0" containerID="cri-o://3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1" gracePeriod=2
Sep 15 09:35:16.535634 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:35:16.535608    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7741-f474a0\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="08253478-959a-4a6d-9abe-362bafe3cf39" pod="opendatahub/test-curl-7741-f474a0"
Sep 15 09:35:16.706457 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:16.706425    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7741-7e1597"
Sep 15 09:35:16.708865 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:35:16.708823    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7741-f474a0\" is forbidden: User \"system:node:ip-10-0-140-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-124.ec2.internal' and this object" podUID="08253478-959a-4a6d-9abe-362bafe3cf39" pod="opendatahub/test-curl-7741-f474a0"
Sep 15 09:35:16.751396 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:16.751368    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xwxq\" (UniqueName: \"kubernetes.io/projected/33c30e57-8a05-4d13-b6d8-f355b0ecbd06-kube-api-access-5xwxq\") pod \"33c30e57-8a05-4d13-b6d8-f355b0ecbd06\" (UID: \"33c30e57-8a05-4d13-b6d8-f355b0ecbd06\") "
Sep 15 09:35:16.753400 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:16.753358    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33c30e57-8a05-4d13-b6d8-f355b0ecbd06-kube-api-access-5xwxq" (OuterVolumeSpecName: "kube-api-access-5xwxq") pod "33c30e57-8a05-4d13-b6d8-f355b0ecbd06" (UID: "33c30e57-8a05-4d13-b6d8-f355b0ecbd06"). InnerVolumeSpecName "kube-api-access-5xwxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:35:16.852878 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:16.852780    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xwxq\" (UniqueName: \"kubernetes.io/projected/33c30e57-8a05-4d13-b6d8-f355b0ecbd06-kube-api-access-5xwxq\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:35:16.957055 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:16.957010    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33c30e57-8a05-4d13-b6d8-f355b0ecbd06" path="/var/lib/kubelet/pods/33c30e57-8a05-4d13-b6d8-f355b0ecbd06/volumes"
Sep 15 09:35:17.541028 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:17.540990    2555 generic.go:356] "Generic (PLEG): container finished" podID="33c30e57-8a05-4d13-b6d8-f355b0ecbd06" containerID="98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d" exitCode=137
Sep 15 09:35:17.541423 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:17.541036    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7741-7e1597"
Sep 15 09:35:17.541423 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:17.541083    2555 scope.go:117] "RemoveContainer" containerID="98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d"
Sep 15 09:35:17.551545 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:17.551523    2555 scope.go:117] "RemoveContainer" containerID="98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d"
Sep 15 09:35:17.551877 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:35:17.551826    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d\": container with ID starting with 98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d not found: ID does not exist" containerID="98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d"
Sep 15 09:35:17.551971 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:17.551885    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d"} err="failed to get container status \"98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d\": rpc error: code = NotFound desc = could not find container \"98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d\": container with ID starting with 98f48fd9330db5e6786f5b9eeaf7cae86d71b140a482ffa6f430dd6732a18e1d not found: ID does not exist"
Sep 15 09:35:18.688930 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:18.688903    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7741-f474a0"
Sep 15 09:35:18.775108 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:18.775075    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxkgn\" (UniqueName: \"kubernetes.io/projected/08253478-959a-4a6d-9abe-362bafe3cf39-kube-api-access-jxkgn\") pod \"08253478-959a-4a6d-9abe-362bafe3cf39\" (UID: \"08253478-959a-4a6d-9abe-362bafe3cf39\") "
Sep 15 09:35:18.777157 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:18.777127    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08253478-959a-4a6d-9abe-362bafe3cf39-kube-api-access-jxkgn" (OuterVolumeSpecName: "kube-api-access-jxkgn") pod "08253478-959a-4a6d-9abe-362bafe3cf39" (UID: "08253478-959a-4a6d-9abe-362bafe3cf39"). InnerVolumeSpecName "kube-api-access-jxkgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:35:18.876704 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:18.876625    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxkgn\" (UniqueName: \"kubernetes.io/projected/08253478-959a-4a6d-9abe-362bafe3cf39-kube-api-access-jxkgn\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:35:18.956751 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:18.956719    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08253478-959a-4a6d-9abe-362bafe3cf39" path="/var/lib/kubelet/pods/08253478-959a-4a6d-9abe-362bafe3cf39/volumes"
Sep 15 09:35:19.557480 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:19.557433    2555 generic.go:356] "Generic (PLEG): container finished" podID="08253478-959a-4a6d-9abe-362bafe3cf39" containerID="3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1" exitCode=137
Sep 15 09:35:19.557480 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:19.557475    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7741-f474a0"
Sep 15 09:35:19.557730 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:19.557526    2555 scope.go:117] "RemoveContainer" containerID="3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1"
Sep 15 09:35:19.567079 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:19.567058    2555 scope.go:117] "RemoveContainer" containerID="3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1"
Sep 15 09:35:19.567377 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:35:19.567356    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1\": container with ID starting with 3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1 not found: ID does not exist" containerID="3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1"
Sep 15 09:35:19.567420 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:35:19.567387    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1"} err="failed to get container status \"3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1\": rpc error: code = NotFound desc = could not find container \"3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1\": container with ID starting with 3655d0d9122bf329fe4ea6726da087fa5d92b5712f080896cd9df1666a27a5f1 not found: ID does not exist"
Sep 15 09:37:15.028595 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.028560    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"]
Sep 15 09:37:15.029314 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.029289    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08253478-959a-4a6d-9abe-362bafe3cf39" containerName="test-curl-7741-f474a0"
Sep 15 09:37:15.029359 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.029319    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08253478-959a-4a6d-9abe-362bafe3cf39" containerName="test-curl-7741-f474a0"
Sep 15 09:37:15.029489 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.029477    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="08253478-959a-4a6d-9abe-362bafe3cf39" containerName="test-curl-7741-f474a0"
Sep 15 09:37:15.033357 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.033336    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.035838 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.035818    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-6920e5-serving-cert\""
Sep 15 09:37:15.042014 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.041698    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"]
Sep 15 09:37:15.114116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.113972    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.114116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.114013    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-metrics-certs\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.114116 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.114074    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4nml\" (UniqueName: \"kubernetes.io/projected/2658bd96-e109-4503-b54a-a4089afa3064-kube-api-access-n4nml\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.120862 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.114227    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2658bd96-e109-4503-b54a-a4089afa3064-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.215187 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.215150    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2658bd96-e109-4503-b54a-a4089afa3064-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.215373 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.215201    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.215373 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.215223    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-metrics-certs\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.215373 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.215249    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4nml\" (UniqueName: \"kubernetes.io/projected/2658bd96-e109-4503-b54a-a4089afa3064-kube-api-access-n4nml\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.215373 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:37:15.215320    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-serving-cert: secret "maas-api-e2e-ipp-b-6920e5-serving-cert" not found
Sep 15 09:37:15.215606 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:37:15.215397    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-maas-api-tls podName:2658bd96-e109-4503-b54a-a4089afa3064 nodeName:}" failed. No retries permitted until 2026-09-15 09:37:15.715376001 +0000 UTC m=+1823.305200349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-maas-api-tls") pod "maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4" (UID: "2658bd96-e109-4503-b54a-a4089afa3064") : secret "maas-api-e2e-ipp-b-6920e5-serving-cert" not found
Sep 15 09:37:15.215934 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.215907    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2658bd96-e109-4503-b54a-a4089afa3064-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.217585 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.217567    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-metrics-certs\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.223898 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.223871    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4nml\" (UniqueName: \"kubernetes.io/projected/2658bd96-e109-4503-b54a-a4089afa3064-kube-api-access-n4nml\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.719659 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.719630    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.722115 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.722082    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:15.946653 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:15.946619    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:16.222461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:16.222432    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"]
Sep 15 09:37:16.223992 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:37:16.223963    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2658bd96_e109_4503_b54a_a4089afa3064.slice/crio-204351b120aa7a32351182cf73807ba2ba30fe63ec696f666c0ad80c870ad8f8 WatchSource:0}: Error finding container 204351b120aa7a32351182cf73807ba2ba30fe63ec696f666c0ad80c870ad8f8: Status 404 returned error can't find the container with id 204351b120aa7a32351182cf73807ba2ba30fe63ec696f666c0ad80c870ad8f8
Sep 15 09:37:16.225292 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:16.225274    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:37:16.292147 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:16.292070    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4" event={"ID":"2658bd96-e109-4503-b54a-a4089afa3064","Type":"ContainerStarted","Data":"204351b120aa7a32351182cf73807ba2ba30fe63ec696f666c0ad80c870ad8f8"}
Sep 15 09:37:17.300685 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:17.300646    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4" event={"ID":"2658bd96-e109-4503-b54a-a4089afa3064","Type":"ContainerStarted","Data":"f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b"}
Sep 15 09:37:17.301109 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:17.300730    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:17.319915 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:17.319870    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4" podStartSLOduration=1.920886967 podStartE2EDuration="2.319841475s" totalImagesPullingTime="398.954508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:37:17.31730628 +0000 UTC m=+1824.907130629" watchObservedRunningTime="2026-09-15 09:37:17.319841475 +0000 UTC m=+1824.909665823"
Sep 15 09:37:23.313361 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:23.313327    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:37:53.195353 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:37:53.192107    2555 scope.go:117] "RemoveContainer" containerID="ea1a96e64533db017bd9105ad30afbbf2ed638734e80defa374e0eae6995209d"
Sep 15 09:38:24.843697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:24.843657    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"]
Sep 15 09:38:24.848280 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:24.848255    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:24.851178 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:24.851149    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-14495e-serving-cert\""
Sep 15 09:38:24.859123 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:24.859097    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"]
Sep 15 09:38:24.901004 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:24.900971    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28d87fd8-40ad-4006-bbad-443c5829d817-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:24.901147 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:24.901018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:24.901147 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:24.901044    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:24.901147 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:24.901092    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vm5s\" (UniqueName: \"kubernetes.io/projected/28d87fd8-40ad-4006-bbad-443c5829d817-kube-api-access-7vm5s\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.002426 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.002391    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28d87fd8-40ad-4006-bbad-443c5829d817-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.002616 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.002441    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.002616 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.002474    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.002616 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.002526    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vm5s\" (UniqueName: \"kubernetes.io/projected/28d87fd8-40ad-4006-bbad-443c5829d817-kube-api-access-7vm5s\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.002793 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:38:25.002652    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-serving-cert: secret "maas-api-e2e-ipp-cleanup-14495e-serving-cert" not found
Sep 15 09:38:25.002793 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:38:25.002728    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-maas-api-tls podName:28d87fd8-40ad-4006-bbad-443c5829d817 nodeName:}" failed. No retries permitted until 2026-09-15 09:38:25.502710682 +0000 UTC m=+1893.092535027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp" (UID: "28d87fd8-40ad-4006-bbad-443c5829d817") : secret "maas-api-e2e-ipp-cleanup-14495e-serving-cert" not found
Sep 15 09:38:25.003196 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.003178    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28d87fd8-40ad-4006-bbad-443c5829d817-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.004872 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.004840    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.012490 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.012464    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vm5s\" (UniqueName: \"kubernetes.io/projected/28d87fd8-40ad-4006-bbad-443c5829d817-kube-api-access-7vm5s\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.490032 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.489998    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"]
Sep 15 09:38:25.493741 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.493725    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:25.496392 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.496367    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-14495e-dockercfg-qrdsv\""
Sep 15 09:38:25.496522 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.496396    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-14495e\""
Sep 15 09:38:25.504737 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.504711    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"]
Sep 15 09:38:25.509442 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.509416    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.511857 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.511815    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.610101 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.610060    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jdg5\" (UniqueName: \"kubernetes.io/projected/37783af0-a187-4213-8e1a-3730b78e441c-kube-api-access-7jdg5\") pod \"payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn\" (UID: \"37783af0-a187-4213-8e1a-3730b78e441c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:25.610270 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.610178    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37783af0-a187-4213-8e1a-3730b78e441c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn\" (UID: \"37783af0-a187-4213-8e1a-3730b78e441c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:25.711522 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.711481    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jdg5\" (UniqueName: \"kubernetes.io/projected/37783af0-a187-4213-8e1a-3730b78e441c-kube-api-access-7jdg5\") pod \"payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn\" (UID: \"37783af0-a187-4213-8e1a-3730b78e441c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:25.711697 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.711569    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37783af0-a187-4213-8e1a-3730b78e441c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn\" (UID: \"37783af0-a187-4213-8e1a-3730b78e441c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:25.712282 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.712262    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37783af0-a187-4213-8e1a-3730b78e441c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn\" (UID: \"37783af0-a187-4213-8e1a-3730b78e441c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:25.720158 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.720129    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jdg5\" (UniqueName: \"kubernetes.io/projected/37783af0-a187-4213-8e1a-3730b78e441c-kube-api-access-7jdg5\") pod \"payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn\" (UID: \"37783af0-a187-4213-8e1a-3730b78e441c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:25.763935 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.763865    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:25.805866 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:25.805821    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:26.036433 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.036400    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"]
Sep 15 09:38:26.037180 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:38:26.037144    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d87fd8_40ad_4006_bbad_443c5829d817.slice/crio-536c7e1f3d50adaeca1f99c0de7f808cfd18165e661272b55e99cb3d6aa55bde WatchSource:0}: Error finding container 536c7e1f3d50adaeca1f99c0de7f808cfd18165e661272b55e99cb3d6aa55bde: Status 404 returned error can't find the container with id 536c7e1f3d50adaeca1f99c0de7f808cfd18165e661272b55e99cb3d6aa55bde
Sep 15 09:38:26.089818 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.089790    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"]
Sep 15 09:38:26.091433 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:38:26.091403    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37783af0_a187_4213_8e1a_3730b78e441c.slice/crio-5501d4b91d7224ee41682d0c5e6bca3b00f3b588a7588e103b02705a565fa7fc WatchSource:0}: Error finding container 5501d4b91d7224ee41682d0c5e6bca3b00f3b588a7588e103b02705a565fa7fc: Status 404 returned error can't find the container with id 5501d4b91d7224ee41682d0c5e6bca3b00f3b588a7588e103b02705a565fa7fc
Sep 15 09:38:26.739872 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.739815    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn" event={"ID":"37783af0-a187-4213-8e1a-3730b78e441c","Type":"ContainerStarted","Data":"57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55"}
Sep 15 09:38:26.740074 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.739925    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn" event={"ID":"37783af0-a187-4213-8e1a-3730b78e441c","Type":"ContainerStarted","Data":"5501d4b91d7224ee41682d0c5e6bca3b00f3b588a7588e103b02705a565fa7fc"}
Sep 15 09:38:26.740074 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.739961    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:26.741588 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.741562    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp" event={"ID":"28d87fd8-40ad-4006-bbad-443c5829d817","Type":"ContainerStarted","Data":"f5556342034c804e1da35a5ff86be6be2ec273bfd03dee53b39b6dcf1830f6d9"}
Sep 15 09:38:26.741722 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.741601    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp" event={"ID":"28d87fd8-40ad-4006-bbad-443c5829d817","Type":"ContainerStarted","Data":"536c7e1f3d50adaeca1f99c0de7f808cfd18165e661272b55e99cb3d6aa55bde"}
Sep 15 09:38:26.741722 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.741710    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:26.759222 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.759179    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn" podStartSLOduration=1.759164201 podStartE2EDuration="1.759164201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:38:26.756884768 +0000 UTC m=+1894.346709112" watchObservedRunningTime="2026-09-15 09:38:26.759164201 +0000 UTC m=+1894.348988587"
Sep 15 09:38:26.773440 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:26.773398    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp" podStartSLOduration=2.379446994 podStartE2EDuration="2.773386034s" totalImagesPullingTime="393.93904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:38:26.771981191 +0000 UTC m=+1894.361805541" watchObservedRunningTime="2026-09-15 09:38:26.773386034 +0000 UTC m=+1894.363210382"
Sep 15 09:38:32.753875 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:32.753829    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:37.750769 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:37.750740    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:53.790084 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:53.790035    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"]
Sep 15 09:38:53.790564 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:53.790501    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp" podUID="28d87fd8-40ad-4006-bbad-443c5829d817" containerName="maas-api" containerID="cri-o://f5556342034c804e1da35a5ff86be6be2ec273bfd03dee53b39b6dcf1830f6d9" gracePeriod=30
Sep 15 09:38:53.846117 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:53.846078    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"]
Sep 15 09:38:53.846377 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:53.846351    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn" podUID="37783af0-a187-4213-8e1a-3730b78e441c" containerName="payload-processing" containerID="cri-o://57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55" gracePeriod=30
Sep 15 09:38:53.911978 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:53.911900    2555 generic.go:356] "Generic (PLEG): container finished" podID="28d87fd8-40ad-4006-bbad-443c5829d817" containerID="f5556342034c804e1da35a5ff86be6be2ec273bfd03dee53b39b6dcf1830f6d9" exitCode=0
Sep 15 09:38:53.912141 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:53.912063    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp" event={"ID":"28d87fd8-40ad-4006-bbad-443c5829d817","Type":"ContainerDied","Data":"f5556342034c804e1da35a5ff86be6be2ec273bfd03dee53b39b6dcf1830f6d9"}
Sep 15 09:38:54.112689 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.112658    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:54.143020 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.142993    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:54.195203 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195174    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37783af0-a187-4213-8e1a-3730b78e441c-plugins-config-volume\") pod \"37783af0-a187-4213-8e1a-3730b78e441c\" (UID: \"37783af0-a187-4213-8e1a-3730b78e441c\") "
Sep 15 09:38:54.195354 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195214    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jdg5\" (UniqueName: \"kubernetes.io/projected/37783af0-a187-4213-8e1a-3730b78e441c-kube-api-access-7jdg5\") pod \"37783af0-a187-4213-8e1a-3730b78e441c\" (UID: \"37783af0-a187-4213-8e1a-3730b78e441c\") "
Sep 15 09:38:54.195354 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195264    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28d87fd8-40ad-4006-bbad-443c5829d817-openshift-service-ca\") pod \"28d87fd8-40ad-4006-bbad-443c5829d817\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") "
Sep 15 09:38:54.195354 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195317    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-metrics-certs\") pod \"28d87fd8-40ad-4006-bbad-443c5829d817\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") "
Sep 15 09:38:54.195490 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195471    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-maas-api-tls\") pod \"28d87fd8-40ad-4006-bbad-443c5829d817\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") "
Sep 15 09:38:54.195563 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195539    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vm5s\" (UniqueName: \"kubernetes.io/projected/28d87fd8-40ad-4006-bbad-443c5829d817-kube-api-access-7vm5s\") pod \"28d87fd8-40ad-4006-bbad-443c5829d817\" (UID: \"28d87fd8-40ad-4006-bbad-443c5829d817\") "
Sep 15 09:38:54.195669 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195645    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37783af0-a187-4213-8e1a-3730b78e441c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37783af0-a187-4213-8e1a-3730b78e441c" (UID: "37783af0-a187-4213-8e1a-3730b78e441c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:38:54.195758 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195671    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28d87fd8-40ad-4006-bbad-443c5829d817-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28d87fd8-40ad-4006-bbad-443c5829d817" (UID: "28d87fd8-40ad-4006-bbad-443c5829d817"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:38:54.195995 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195964    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37783af0-a187-4213-8e1a-3730b78e441c-plugins-config-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:38:54.195995 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.195991    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28d87fd8-40ad-4006-bbad-443c5829d817-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:38:54.197499 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.197477    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "28d87fd8-40ad-4006-bbad-443c5829d817" (UID: "28d87fd8-40ad-4006-bbad-443c5829d817"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:38:54.197613 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.197570    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28d87fd8-40ad-4006-bbad-443c5829d817" (UID: "28d87fd8-40ad-4006-bbad-443c5829d817"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:38:54.197939 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.197915    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28d87fd8-40ad-4006-bbad-443c5829d817-kube-api-access-7vm5s" (OuterVolumeSpecName: "kube-api-access-7vm5s") pod "28d87fd8-40ad-4006-bbad-443c5829d817" (UID: "28d87fd8-40ad-4006-bbad-443c5829d817"). InnerVolumeSpecName "kube-api-access-7vm5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:38:54.197994 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.197939    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37783af0-a187-4213-8e1a-3730b78e441c-kube-api-access-7jdg5" (OuterVolumeSpecName: "kube-api-access-7jdg5") pod "37783af0-a187-4213-8e1a-3730b78e441c" (UID: "37783af0-a187-4213-8e1a-3730b78e441c"). InnerVolumeSpecName "kube-api-access-7jdg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:38:54.297095 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.297060    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:38:54.297095 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.297090    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28d87fd8-40ad-4006-bbad-443c5829d817-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:38:54.297095 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.297099    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vm5s\" (UniqueName: \"kubernetes.io/projected/28d87fd8-40ad-4006-bbad-443c5829d817-kube-api-access-7vm5s\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:38:54.297339 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.297109    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jdg5\" (UniqueName: \"kubernetes.io/projected/37783af0-a187-4213-8e1a-3730b78e441c-kube-api-access-7jdg5\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:38:54.920586 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.920559    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"
Sep 15 09:38:54.921112 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.920602    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp" event={"ID":"28d87fd8-40ad-4006-bbad-443c5829d817","Type":"ContainerDied","Data":"536c7e1f3d50adaeca1f99c0de7f808cfd18165e661272b55e99cb3d6aa55bde"}
Sep 15 09:38:54.921112 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.920663    2555 scope.go:117] "RemoveContainer" containerID="f5556342034c804e1da35a5ff86be6be2ec273bfd03dee53b39b6dcf1830f6d9"
Sep 15 09:38:54.922083 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.922058    2555 generic.go:356] "Generic (PLEG): container finished" podID="37783af0-a187-4213-8e1a-3730b78e441c" containerID="57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55" exitCode=0
Sep 15 09:38:54.922083 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.922110    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"
Sep 15 09:38:54.922358 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.922089    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn" event={"ID":"37783af0-a187-4213-8e1a-3730b78e441c","Type":"ContainerDied","Data":"57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55"}
Sep 15 09:38:54.922358 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.922242    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn" event={"ID":"37783af0-a187-4213-8e1a-3730b78e441c","Type":"ContainerDied","Data":"5501d4b91d7224ee41682d0c5e6bca3b00f3b588a7588e103b02705a565fa7fc"}
Sep 15 09:38:54.931569 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.931547    2555 scope.go:117] "RemoveContainer" containerID="57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55"
Sep 15 09:38:54.943040 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.943020    2555 scope.go:117] "RemoveContainer" containerID="57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55"
Sep 15 09:38:54.943310 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:38:54.943291    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55\": container with ID starting with 57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55 not found: ID does not exist" containerID="57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55"
Sep 15 09:38:54.943390 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.943322    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55"} err="failed to get container status \"57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55\": rpc error: code = NotFound desc = could not find container \"57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55\": container with ID starting with 57d172373f4013446ff7110b5ffcb301e364a37ceb1793dbe04357d4d4095e55 not found: ID does not exist"
Sep 15 09:38:54.947201 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.947180    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"]
Sep 15 09:38:54.957031 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.957008    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-14495e-7fd9b9dd77-hqbpp"]
Sep 15 09:38:54.961313 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.961294    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"]
Sep 15 09:38:54.963875 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:54.963855    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn"]
Sep 15 09:38:56.954869 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:56.954823    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28d87fd8-40ad-4006-bbad-443c5829d817" path="/var/lib/kubelet/pods/28d87fd8-40ad-4006-bbad-443c5829d817/volumes"
Sep 15 09:38:56.955321 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:38:56.955290    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37783af0-a187-4213-8e1a-3730b78e441c" path="/var/lib/kubelet/pods/37783af0-a187-4213-8e1a-3730b78e441c/volumes"
Sep 15 09:40:19.330161 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.329550    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"]
Sep 15 09:40:19.330161 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.329799    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4" podUID="2658bd96-e109-4503-b54a-a4089afa3064" containerName="maas-api" containerID="cri-o://f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b" gracePeriod=30
Sep 15 09:40:19.583086 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.583016    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:40:19.626048 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.626018    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-metrics-certs\") pod \"2658bd96-e109-4503-b54a-a4089afa3064\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") "
Sep 15 09:40:19.626212 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.626055    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2658bd96-e109-4503-b54a-a4089afa3064-openshift-service-ca\") pod \"2658bd96-e109-4503-b54a-a4089afa3064\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") "
Sep 15 09:40:19.626212 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.626188    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4nml\" (UniqueName: \"kubernetes.io/projected/2658bd96-e109-4503-b54a-a4089afa3064-kube-api-access-n4nml\") pod \"2658bd96-e109-4503-b54a-a4089afa3064\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") "
Sep 15 09:40:19.626302 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.626278    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-maas-api-tls\") pod \"2658bd96-e109-4503-b54a-a4089afa3064\" (UID: \"2658bd96-e109-4503-b54a-a4089afa3064\") "
Sep 15 09:40:19.626548 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.626515    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2658bd96-e109-4503-b54a-a4089afa3064-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2658bd96-e109-4503-b54a-a4089afa3064" (UID: "2658bd96-e109-4503-b54a-a4089afa3064"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:19.626687 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.626586    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2658bd96-e109-4503-b54a-a4089afa3064-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:19.628271 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.628239    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2658bd96-e109-4503-b54a-a4089afa3064" (UID: "2658bd96-e109-4503-b54a-a4089afa3064"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:40:19.628376 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.628289    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2658bd96-e109-4503-b54a-a4089afa3064" (UID: "2658bd96-e109-4503-b54a-a4089afa3064"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:40:19.628376 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.628366    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2658bd96-e109-4503-b54a-a4089afa3064-kube-api-access-n4nml" (OuterVolumeSpecName: "kube-api-access-n4nml") pod "2658bd96-e109-4503-b54a-a4089afa3064" (UID: "2658bd96-e109-4503-b54a-a4089afa3064"). InnerVolumeSpecName "kube-api-access-n4nml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:19.727765 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.727730    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4nml\" (UniqueName: \"kubernetes.io/projected/2658bd96-e109-4503-b54a-a4089afa3064-kube-api-access-n4nml\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:19.727765 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.727760    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:19.727765 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:19.727769    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2658bd96-e109-4503-b54a-a4089afa3064-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:20.447476 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.447441    2555 generic.go:356] "Generic (PLEG): container finished" podID="2658bd96-e109-4503-b54a-a4089afa3064" containerID="f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b" exitCode=0
Sep 15 09:40:20.447943 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.447498    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"
Sep 15 09:40:20.447943 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.447525    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4" event={"ID":"2658bd96-e109-4503-b54a-a4089afa3064","Type":"ContainerDied","Data":"f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b"}
Sep 15 09:40:20.447943 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.447577    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4" event={"ID":"2658bd96-e109-4503-b54a-a4089afa3064","Type":"ContainerDied","Data":"204351b120aa7a32351182cf73807ba2ba30fe63ec696f666c0ad80c870ad8f8"}
Sep 15 09:40:20.447943 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.447600    2555 scope.go:117] "RemoveContainer" containerID="f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b"
Sep 15 09:40:20.458640 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.458614    2555 scope.go:117] "RemoveContainer" containerID="f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b"
Sep 15 09:40:20.458971 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:40:20.458949    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b\": container with ID starting with f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b not found: ID does not exist" containerID="f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b"
Sep 15 09:40:20.459051 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.458982    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b"} err="failed to get container status \"f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b\": rpc error: code = NotFound desc = could not find container \"f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b\": container with ID starting with f95b1f159036dd833175d49ec24e878c6d8f926972acd15772b37ac58cee0e3b not found: ID does not exist"
Sep 15 09:40:20.470411 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.470388    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"]
Sep 15 09:40:20.474312 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.474290    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6920e5-6d79bf9f68-pzzq4"]
Sep 15 09:40:20.957556 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:20.957520    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2658bd96-e109-4503-b54a-a4089afa3064" path="/var/lib/kubelet/pods/2658bd96-e109-4503-b54a-a4089afa3064/volumes"
Sep 15 09:40:36.854214 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:36.854177    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"]
Sep 15 09:40:36.854725 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:36.854501    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs" podUID="fab287e5-4c00-4beb-b559-3b998932e60a" containerName="maas-api" containerID="cri-o://c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d" gracePeriod=30
Sep 15 09:40:37.105444 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.105388    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:40:37.202325 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.202294    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-maas-api-tls\") pod \"fab287e5-4c00-4beb-b559-3b998932e60a\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") "
Sep 15 09:40:37.202507 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.202361    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-metrics-certs\") pod \"fab287e5-4c00-4beb-b559-3b998932e60a\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") "
Sep 15 09:40:37.202507 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.202449    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab287e5-4c00-4beb-b559-3b998932e60a-openshift-service-ca\") pod \"fab287e5-4c00-4beb-b559-3b998932e60a\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") "
Sep 15 09:40:37.202636 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.202533    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcwjp\" (UniqueName: \"kubernetes.io/projected/fab287e5-4c00-4beb-b559-3b998932e60a-kube-api-access-mcwjp\") pod \"fab287e5-4c00-4beb-b559-3b998932e60a\" (UID: \"fab287e5-4c00-4beb-b559-3b998932e60a\") "
Sep 15 09:40:37.203106 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.203077    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fab287e5-4c00-4beb-b559-3b998932e60a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fab287e5-4c00-4beb-b559-3b998932e60a" (UID: "fab287e5-4c00-4beb-b559-3b998932e60a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:37.204650 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.204617    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fab287e5-4c00-4beb-b559-3b998932e60a-kube-api-access-mcwjp" (OuterVolumeSpecName: "kube-api-access-mcwjp") pod "fab287e5-4c00-4beb-b559-3b998932e60a" (UID: "fab287e5-4c00-4beb-b559-3b998932e60a"). InnerVolumeSpecName "kube-api-access-mcwjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:37.204650 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.204635    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fab287e5-4c00-4beb-b559-3b998932e60a" (UID: "fab287e5-4c00-4beb-b559-3b998932e60a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:40:37.204878 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.204841    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fab287e5-4c00-4beb-b559-3b998932e60a" (UID: "fab287e5-4c00-4beb-b559-3b998932e60a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:40:37.303704 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.303671    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcwjp\" (UniqueName: \"kubernetes.io/projected/fab287e5-4c00-4beb-b559-3b998932e60a-kube-api-access-mcwjp\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:37.303704 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.303702    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:37.303993 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.303716    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fab287e5-4c00-4beb-b559-3b998932e60a-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:37.303993 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.303726    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab287e5-4c00-4beb-b559-3b998932e60a-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:37.555018 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.554981    2555 generic.go:356] "Generic (PLEG): container finished" podID="fab287e5-4c00-4beb-b559-3b998932e60a" containerID="c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d" exitCode=0
Sep 15 09:40:37.555209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.555034    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"
Sep 15 09:40:37.555209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.555070    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs" event={"ID":"fab287e5-4c00-4beb-b559-3b998932e60a","Type":"ContainerDied","Data":"c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d"}
Sep 15 09:40:37.555209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.555132    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs" event={"ID":"fab287e5-4c00-4beb-b559-3b998932e60a","Type":"ContainerDied","Data":"d70f43059eb93ab9963274b6a8496d4387420a082b46b99a5c6da4e8d26903cf"}
Sep 15 09:40:37.555209 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.555161    2555 scope.go:117] "RemoveContainer" containerID="c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d"
Sep 15 09:40:37.568994 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.568976    2555 scope.go:117] "RemoveContainer" containerID="c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d"
Sep 15 09:40:37.569285 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:40:37.569264    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d\": container with ID starting with c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d not found: ID does not exist" containerID="c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d"
Sep 15 09:40:37.569348 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.569295    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d"} err="failed to get container status \"c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d\": rpc error: code = NotFound desc = could not find container \"c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d\": container with ID starting with c197fae0f03c197be6b52077557502275d5ee29f79f64d4c5e9660e3e549d83d not found: ID does not exist"
Sep 15 09:40:37.578073 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.578051    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"]
Sep 15 09:40:37.580814 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:37.580793    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-f79800-6ff4b4f76f-x9dcs"]
Sep 15 09:40:38.957025 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:38.956984    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fab287e5-4c00-4beb-b559-3b998932e60a" path="/var/lib/kubelet/pods/fab287e5-4c00-4beb-b559-3b998932e60a/volumes"
Sep 15 09:40:54.275055 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.275017    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"]
Sep 15 09:40:54.275609 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.275553    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z" podUID="f457ec46-5071-4177-937f-e673ae62b70d" containerName="maas-api" containerID="cri-o://f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6" gracePeriod=30
Sep 15 09:40:54.528861 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.528793    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:40:54.566003 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.565972    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-maas-api-tls\") pod \"f457ec46-5071-4177-937f-e673ae62b70d\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") "
Sep 15 09:40:54.566173 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.566067    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f457ec46-5071-4177-937f-e673ae62b70d-openshift-service-ca\") pod \"f457ec46-5071-4177-937f-e673ae62b70d\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") "
Sep 15 09:40:54.566222 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.566175    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrc22\" (UniqueName: \"kubernetes.io/projected/f457ec46-5071-4177-937f-e673ae62b70d-kube-api-access-mrc22\") pod \"f457ec46-5071-4177-937f-e673ae62b70d\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") "
Sep 15 09:40:54.566222 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.566200    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-metrics-certs\") pod \"f457ec46-5071-4177-937f-e673ae62b70d\" (UID: \"f457ec46-5071-4177-937f-e673ae62b70d\") "
Sep 15 09:40:54.566524 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.566483    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f457ec46-5071-4177-937f-e673ae62b70d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f457ec46-5071-4177-937f-e673ae62b70d" (UID: "f457ec46-5071-4177-937f-e673ae62b70d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:54.568141 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.568108    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f457ec46-5071-4177-937f-e673ae62b70d" (UID: "f457ec46-5071-4177-937f-e673ae62b70d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:40:54.568689 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.568665    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f457ec46-5071-4177-937f-e673ae62b70d" (UID: "f457ec46-5071-4177-937f-e673ae62b70d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:40:54.568779 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.568672    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f457ec46-5071-4177-937f-e673ae62b70d-kube-api-access-mrc22" (OuterVolumeSpecName: "kube-api-access-mrc22") pod "f457ec46-5071-4177-937f-e673ae62b70d" (UID: "f457ec46-5071-4177-937f-e673ae62b70d"). InnerVolumeSpecName "kube-api-access-mrc22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:54.662606 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.662569    2555 generic.go:356] "Generic (PLEG): container finished" podID="f457ec46-5071-4177-937f-e673ae62b70d" containerID="f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6" exitCode=0
Sep 15 09:40:54.662782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.662613    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"
Sep 15 09:40:54.662782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.662648    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z" event={"ID":"f457ec46-5071-4177-937f-e673ae62b70d","Type":"ContainerDied","Data":"f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6"}
Sep 15 09:40:54.662782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.662702    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z" event={"ID":"f457ec46-5071-4177-937f-e673ae62b70d","Type":"ContainerDied","Data":"02bc4e42e84103801f915b8592770879abaa3e0acccf71fd40091c75f337ee4d"}
Sep 15 09:40:54.662782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.662726    2555 scope.go:117] "RemoveContainer" containerID="f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6"
Sep 15 09:40:54.667285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.667259    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrc22\" (UniqueName: \"kubernetes.io/projected/f457ec46-5071-4177-937f-e673ae62b70d-kube-api-access-mrc22\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:54.667377 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.667289    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:54.667377 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.667305    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f457ec46-5071-4177-937f-e673ae62b70d-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:54.667377 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.667318    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f457ec46-5071-4177-937f-e673ae62b70d-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:40:54.673419 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.673402    2555 scope.go:117] "RemoveContainer" containerID="f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6"
Sep 15 09:40:54.673694 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:40:54.673673    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6\": container with ID starting with f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6 not found: ID does not exist" containerID="f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6"
Sep 15 09:40:54.673742 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.673704    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6"} err="failed to get container status \"f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6\": rpc error: code = NotFound desc = could not find container \"f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6\": container with ID starting with f7800842bb49560642c474be8be717ab4ec347d06985be68ac9b90080e86d8f6 not found: ID does not exist"
Sep 15 09:40:54.685021 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.684996    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"]
Sep 15 09:40:54.688299 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.688279    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8dd3bd-8588f966b9-fzp2z"]
Sep 15 09:40:54.957173 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:40:54.957081    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f457ec46-5071-4177-937f-e673ae62b70d" path="/var/lib/kubelet/pods/f457ec46-5071-4177-937f-e673ae62b70d/volumes"
Sep 15 09:43:39.946721 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:39.946682    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"]
Sep 15 09:43:39.947335 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:39.946905    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l" podUID="deaa045b-27a8-48d3-abd5-fc31cbb5ff08" containerName="manager" containerID="cri-o://8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3" gracePeriod=10
Sep 15 09:43:40.200349 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.200282    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:43:40.212303 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.212278    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mvg2\" (UniqueName: \"kubernetes.io/projected/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-kube-api-access-8mvg2\") pod \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\" (UID: \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\") "
Sep 15 09:43:40.212429 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.212389    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-extensions-socket-volume\") pod \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\" (UID: \"deaa045b-27a8-48d3-abd5-fc31cbb5ff08\") "
Sep 15 09:43:40.212764 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.212742    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "deaa045b-27a8-48d3-abd5-fc31cbb5ff08" (UID: "deaa045b-27a8-48d3-abd5-fc31cbb5ff08"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:43:40.214398 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.214380    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-kube-api-access-8mvg2" (OuterVolumeSpecName: "kube-api-access-8mvg2") pod "deaa045b-27a8-48d3-abd5-fc31cbb5ff08" (UID: "deaa045b-27a8-48d3-abd5-fc31cbb5ff08"). InnerVolumeSpecName "kube-api-access-8mvg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:43:40.313135 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.313098    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-extensions-socket-volume\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:43:40.313135 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.313128    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mvg2\" (UniqueName: \"kubernetes.io/projected/deaa045b-27a8-48d3-abd5-fc31cbb5ff08-kube-api-access-8mvg2\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:43:40.662182 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.662144    2555 generic.go:356] "Generic (PLEG): container finished" podID="deaa045b-27a8-48d3-abd5-fc31cbb5ff08" containerID="8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3" exitCode=0
Sep 15 09:43:40.662356 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.662193    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"
Sep 15 09:43:40.662356 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.662228    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l" event={"ID":"deaa045b-27a8-48d3-abd5-fc31cbb5ff08","Type":"ContainerDied","Data":"8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3"}
Sep 15 09:43:40.662356 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.662284    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l" event={"ID":"deaa045b-27a8-48d3-abd5-fc31cbb5ff08","Type":"ContainerDied","Data":"fe691a0208e2795b125a73a80ff0f2db50d54f4a5bc0bd488f1ceec5e2b2c8f1"}
Sep 15 09:43:40.662356 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.662306    2555 scope.go:117] "RemoveContainer" containerID="8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3"
Sep 15 09:43:40.672719 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.672700    2555 scope.go:117] "RemoveContainer" containerID="8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3"
Sep 15 09:43:40.673055 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:43:40.673031    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3\": container with ID starting with 8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3 not found: ID does not exist" containerID="8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3"
Sep 15 09:43:40.673133 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.673066    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3"} err="failed to get container status \"8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3\": rpc error: code = NotFound desc = could not find container \"8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3\": container with ID starting with 8e6e0b44a4cc9a0c004839d623cc84e418a4aeec65069c76eff87f252351b0a3 not found: ID does not exist"
Sep 15 09:43:40.685018 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.684987    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"]
Sep 15 09:43:40.688363 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.688339    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xt79l"]
Sep 15 09:43:40.954791 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:43:40.954712    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deaa045b-27a8-48d3-abd5-fc31cbb5ff08" path="/var/lib/kubelet/pods/deaa045b-27a8-48d3-abd5-fc31cbb5ff08/volumes"
Sep 15 09:44:40.624924 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.624876    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"]
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625333    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deaa045b-27a8-48d3-abd5-fc31cbb5ff08" containerName="manager"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625346    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="deaa045b-27a8-48d3-abd5-fc31cbb5ff08" containerName="manager"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625370    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28d87fd8-40ad-4006-bbad-443c5829d817" containerName="maas-api"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625377    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="28d87fd8-40ad-4006-bbad-443c5829d817" containerName="maas-api"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625386    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37783af0-a187-4213-8e1a-3730b78e441c" containerName="payload-processing"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625391    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="37783af0-a187-4213-8e1a-3730b78e441c" containerName="payload-processing"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625399    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fab287e5-4c00-4beb-b559-3b998932e60a" containerName="maas-api"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625404    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fab287e5-4c00-4beb-b559-3b998932e60a" containerName="maas-api"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625414    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f457ec46-5071-4177-937f-e673ae62b70d" containerName="maas-api"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625418    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f457ec46-5071-4177-937f-e673ae62b70d" containerName="maas-api"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625428    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2658bd96-e109-4503-b54a-a4089afa3064" containerName="maas-api"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625433    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2658bd96-e109-4503-b54a-a4089afa3064" containerName="maas-api"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625495    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2658bd96-e109-4503-b54a-a4089afa3064" containerName="maas-api"
Sep 15 09:44:40.625495 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625504    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fab287e5-4c00-4beb-b559-3b998932e60a" containerName="maas-api"
Sep 15 09:44:40.626185 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625510    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="28d87fd8-40ad-4006-bbad-443c5829d817" containerName="maas-api"
Sep 15 09:44:40.626185 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625518    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="deaa045b-27a8-48d3-abd5-fc31cbb5ff08" containerName="manager"
Sep 15 09:44:40.626185 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625525    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f457ec46-5071-4177-937f-e673ae62b70d" containerName="maas-api"
Sep 15 09:44:40.626185 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.625536    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="37783af0-a187-4213-8e1a-3730b78e441c" containerName="payload-processing"
Sep 15 09:44:40.628731 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.628716    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:44:40.631461 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.631435    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mbtvw\""
Sep 15 09:44:40.640431 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.640406    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"]
Sep 15 09:44:40.654828 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.654791    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/118dcbb5-0a6d-4d48-b6a7-6775851712b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-j8hc5\" (UID: \"118dcbb5-0a6d-4d48-b6a7-6775851712b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:44:40.654986 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.654961    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4xxw\" (UniqueName: \"kubernetes.io/projected/118dcbb5-0a6d-4d48-b6a7-6775851712b0-kube-api-access-d4xxw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-j8hc5\" (UID: \"118dcbb5-0a6d-4d48-b6a7-6775851712b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:44:40.756365 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.756326    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4xxw\" (UniqueName: \"kubernetes.io/projected/118dcbb5-0a6d-4d48-b6a7-6775851712b0-kube-api-access-d4xxw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-j8hc5\" (UID: \"118dcbb5-0a6d-4d48-b6a7-6775851712b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:44:40.756527 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.756399    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/118dcbb5-0a6d-4d48-b6a7-6775851712b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-j8hc5\" (UID: \"118dcbb5-0a6d-4d48-b6a7-6775851712b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:44:40.756783 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.756765    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/118dcbb5-0a6d-4d48-b6a7-6775851712b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-j8hc5\" (UID: \"118dcbb5-0a6d-4d48-b6a7-6775851712b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:44:40.769484 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.769450    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4xxw\" (UniqueName: \"kubernetes.io/projected/118dcbb5-0a6d-4d48-b6a7-6775851712b0-kube-api-access-d4xxw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-j8hc5\" (UID: \"118dcbb5-0a6d-4d48-b6a7-6775851712b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:44:40.940285 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:40.940204    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:44:41.246648 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:41.246618    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"]
Sep 15 09:44:41.247378 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:44:41.247347    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118dcbb5_0a6d_4d48_b6a7_6775851712b0.slice/crio-2d0273d97a4c20be0a34dfb08692af323dc1bed4fe00c4299be747e0f44d6a0a WatchSource:0}: Error finding container 2d0273d97a4c20be0a34dfb08692af323dc1bed4fe00c4299be747e0f44d6a0a: Status 404 returned error can't find the container with id 2d0273d97a4c20be0a34dfb08692af323dc1bed4fe00c4299be747e0f44d6a0a
Sep 15 09:44:42.033860 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:42.033814    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5" event={"ID":"118dcbb5-0a6d-4d48-b6a7-6775851712b0","Type":"ContainerStarted","Data":"832d9f8365c2afdbcfb9d53715270fe5eca9d101c22f2ccea7b82bc55bc91d0b"}
Sep 15 09:44:42.034321 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:42.033916    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5" event={"ID":"118dcbb5-0a6d-4d48-b6a7-6775851712b0","Type":"ContainerStarted","Data":"2d0273d97a4c20be0a34dfb08692af323dc1bed4fe00c4299be747e0f44d6a0a"}
Sep 15 09:44:42.034321 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:42.033939    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:44:42.055957 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:42.055901    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5" podStartSLOduration=2.055885409 podStartE2EDuration="2.055885409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:44:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:44:42.055332787 +0000 UTC m=+2269.645157134" watchObservedRunningTime="2026-09-15 09:44:42.055885409 +0000 UTC m=+2269.645709756"
Sep 15 09:44:53.041817 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:44:53.041785    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-j8hc5"
Sep 15 09:46:41.359465 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:41.359425    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"]
Sep 15 09:46:41.359994 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:41.359717    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp" podUID="ec7160ef-cd8e-42d2-9f99-f7a16c56229d" containerName="maas-api" containerID="cri-o://3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d" gracePeriod=30
Sep 15 09:46:42.611710 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.611681    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:46:42.705931 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.705824    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-metrics-certs\") pod \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") "
Sep 15 09:46:42.705931 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.705883    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-maas-api-tls\") pod \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") "
Sep 15 09:46:42.705931 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.705919    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp6vv\" (UniqueName: \"kubernetes.io/projected/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-kube-api-access-rp6vv\") pod \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") "
Sep 15 09:46:42.707899 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.707867    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ec7160ef-cd8e-42d2-9f99-f7a16c56229d" (UID: "ec7160ef-cd8e-42d2-9f99-f7a16c56229d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:46:42.708014 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.707902    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec7160ef-cd8e-42d2-9f99-f7a16c56229d" (UID: "ec7160ef-cd8e-42d2-9f99-f7a16c56229d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:46:42.708014 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.707941    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-kube-api-access-rp6vv" (OuterVolumeSpecName: "kube-api-access-rp6vv") pod "ec7160ef-cd8e-42d2-9f99-f7a16c56229d" (UID: "ec7160ef-cd8e-42d2-9f99-f7a16c56229d"). InnerVolumeSpecName "kube-api-access-rp6vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:46:42.757760 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.757721    2555 generic.go:356] "Generic (PLEG): container finished" podID="ec7160ef-cd8e-42d2-9f99-f7a16c56229d" containerID="3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d" exitCode=0
Sep 15 09:46:42.757946 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.757791    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"
Sep 15 09:46:42.757946 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.757818    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp" event={"ID":"ec7160ef-cd8e-42d2-9f99-f7a16c56229d","Type":"ContainerDied","Data":"3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d"}
Sep 15 09:46:42.757946 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.757895    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4884bd-s9zdp" event={"ID":"ec7160ef-cd8e-42d2-9f99-f7a16c56229d","Type":"ContainerDied","Data":"0be10a4080293786a7a1e68f2c954a157c286d6602c08b69cf6a01864a219c67"}
Sep 15 09:46:42.757946 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.757920    2555 scope.go:117] "RemoveContainer" containerID="3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d"
Sep 15 09:46:42.767869 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.767828    2555 scope.go:117] "RemoveContainer" containerID="3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d"
Sep 15 09:46:42.768120 ip-10-0-140-124 kubenswrapper[2555]: E0915 09:46:42.768103    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d\": container with ID starting with 3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d not found: ID does not exist" containerID="3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d"
Sep 15 09:46:42.768172 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.768127    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d"} err="failed to get container status \"3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d\": rpc error: code = NotFound desc = could not find container \"3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d\": container with ID starting with 3a887951dd710a14ccf17ce078157ad4ed045addbf9695f6bccfe042a8e6735d not found: ID does not exist"
Sep 15 09:46:42.807068 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.807037    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-openshift-service-ca\") pod \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\" (UID: \"ec7160ef-cd8e-42d2-9f99-f7a16c56229d\") "
Sep 15 09:46:42.807313 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.807300    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-metrics-certs\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:46:42.807357 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.807316    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-maas-api-tls\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:46:42.807357 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.807326    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp6vv\" (UniqueName: \"kubernetes.io/projected/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-kube-api-access-rp6vv\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:46:42.807357 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.807344    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec7160ef-cd8e-42d2-9f99-f7a16c56229d" (UID: "ec7160ef-cd8e-42d2-9f99-f7a16c56229d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:46:42.908582 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:42.908527    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7160ef-cd8e-42d2-9f99-f7a16c56229d-openshift-service-ca\") on node \"ip-10-0-140-124.ec2.internal\" DevicePath \"\""
Sep 15 09:46:43.074185 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:43.074150    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"]
Sep 15 09:46:43.077704 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:43.077679    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4884bd-s9zdp"]
Sep 15 09:46:44.958046 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:46:44.958010    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec7160ef-cd8e-42d2-9f99-f7a16c56229d" path="/var/lib/kubelet/pods/ec7160ef-cd8e-42d2-9f99-f7a16c56229d/volumes"
Sep 15 09:47:00.043538 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:00.043503    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qc974_7dcc2ead-7733-47ea-b964-90b1d0f31d51/manager/0.log"
Sep 15 09:47:00.167515 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:00.167481    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j7j96_a6211768-4056-4db1-8b7c-6e0bd710d8f5/manager/0.log"
Sep 15 09:47:00.864962 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:00.864932    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dcfd7f98-j9zf8_b109500a-e462-45de-b13b-ed55f8d86f6c/copy-manifests/0.log"
Sep 15 09:47:00.884426 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:00.884392    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dcfd7f98-j9zf8_b109500a-e462-45de-b13b-ed55f8d86f6c/manager/0.log"
Sep 15 09:47:01.650178 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:01.650145    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-k2hbq_5a966c6b-ef7d-4df0-8733-775f01e187ed/postgres/0.log"
Sep 15 09:47:02.511511 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:02.511478    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-8475h_3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7/manager/0.log"
Sep 15 09:47:02.621373 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:02.621331    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-224kr_ca67e4e6-d472-4cc6-a634-da8cf8f58ec2/manager/0.log"
Sep 15 09:47:02.721770 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:02.721748    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6dtrg_6effc90f-5c92-49d2-b59f-967977bc70ee/kuadrant-console-plugin/0.log"
Sep 15 09:47:02.850153 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:02.850067    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-j8hc5_118dcbb5-0a6d-4d48-b6a7-6775851712b0/manager/0.log"
Sep 15 09:47:03.087347 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:03.087320    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-mpwvb_3c6d0438-a48d-49aa-89e1-6c63de4ccee1/manager/0.log"
Sep 15 09:47:03.797829 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:03.797793    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d5b88c986-dfz4g_489ca57d-8eed-47be-83ba-bd1571102daf/kube-auth-proxy/0.log"
Sep 15 09:47:04.036275 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:04.036244    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-gqczn_5ddb13bf-48e5-4157-ab97-9a62b9465a4a/payload-pre-processing/0.log"
Sep 15 09:47:04.607397 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:04.607364    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-j2mbh_8b773126-9a7a-44a2-bf75-df877f87a1a5/main/0.log"
Sep 15 09:47:04.853936 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:04.853902    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-8dpc4_bab1112e-bd2c-4f8b-874b-1483edcf94e0/main/0.log"
Sep 15 09:47:05.075782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:05.075745    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fklwqh_f06d0df0-d958-44b8-9c50-0fc969da5e22/main/0.log"
Sep 15 09:47:11.107218 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.107178    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mwkv/must-gather-65xv5"]
Sep 15 09:47:11.107782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.107751    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec7160ef-cd8e-42d2-9f99-f7a16c56229d" containerName="maas-api"
Sep 15 09:47:11.107782 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.107774    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec7160ef-cd8e-42d2-9f99-f7a16c56229d" containerName="maas-api"
Sep 15 09:47:11.108004 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.107893    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec7160ef-cd8e-42d2-9f99-f7a16c56229d" containerName="maas-api"
Sep 15 09:47:11.111172 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.111152    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mwkv/must-gather-65xv5"
Sep 15 09:47:11.114421 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.114402    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8mwkv\"/\"default-dockercfg-r2jw9\""
Sep 15 09:47:11.115383 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.115365    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mwkv\"/\"openshift-service-ca.crt\""
Sep 15 09:47:11.115443 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.115365    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mwkv\"/\"kube-root-ca.crt\""
Sep 15 09:47:11.120736 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.120710    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mwkv/must-gather-65xv5"]
Sep 15 09:47:11.279890 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.279830    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpq8j\" (UniqueName: \"kubernetes.io/projected/2726e79c-59b7-4132-b4d1-39e6db57fd16-kube-api-access-gpq8j\") pod \"must-gather-65xv5\" (UID: \"2726e79c-59b7-4132-b4d1-39e6db57fd16\") " pod="openshift-must-gather-8mwkv/must-gather-65xv5"
Sep 15 09:47:11.280059 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.279981    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2726e79c-59b7-4132-b4d1-39e6db57fd16-must-gather-output\") pod \"must-gather-65xv5\" (UID: \"2726e79c-59b7-4132-b4d1-39e6db57fd16\") " pod="openshift-must-gather-8mwkv/must-gather-65xv5"
Sep 15 09:47:11.381072 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.380976    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpq8j\" (UniqueName: \"kubernetes.io/projected/2726e79c-59b7-4132-b4d1-39e6db57fd16-kube-api-access-gpq8j\") pod \"must-gather-65xv5\" (UID: \"2726e79c-59b7-4132-b4d1-39e6db57fd16\") " pod="openshift-must-gather-8mwkv/must-gather-65xv5"
Sep 15 09:47:11.381072 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.381058    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2726e79c-59b7-4132-b4d1-39e6db57fd16-must-gather-output\") pod \"must-gather-65xv5\" (UID: \"2726e79c-59b7-4132-b4d1-39e6db57fd16\") " pod="openshift-must-gather-8mwkv/must-gather-65xv5"
Sep 15 09:47:11.381467 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.381433    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2726e79c-59b7-4132-b4d1-39e6db57fd16-must-gather-output\") pod \"must-gather-65xv5\" (UID: \"2726e79c-59b7-4132-b4d1-39e6db57fd16\") " pod="openshift-must-gather-8mwkv/must-gather-65xv5"
Sep 15 09:47:11.391383 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.391349    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpq8j\" (UniqueName: \"kubernetes.io/projected/2726e79c-59b7-4132-b4d1-39e6db57fd16-kube-api-access-gpq8j\") pod \"must-gather-65xv5\" (UID: \"2726e79c-59b7-4132-b4d1-39e6db57fd16\") " pod="openshift-must-gather-8mwkv/must-gather-65xv5"
Sep 15 09:47:11.422469 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.422433    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mwkv/must-gather-65xv5"
Sep 15 09:47:11.696467 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.696435    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mwkv/must-gather-65xv5"]
Sep 15 09:47:11.697357 ip-10-0-140-124 kubenswrapper[2555]: W0915 09:47:11.697332    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2726e79c_59b7_4132_b4d1_39e6db57fd16.slice/crio-dc763a6fd88dd2920984e1fbf3ba7d409eb074b37d6654412558bbe702051e1d WatchSource:0}: Error finding container dc763a6fd88dd2920984e1fbf3ba7d409eb074b37d6654412558bbe702051e1d: Status 404 returned error can't find the container with id dc763a6fd88dd2920984e1fbf3ba7d409eb074b37d6654412558bbe702051e1d
Sep 15 09:47:11.699196 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.699180    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:47:11.931636 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:11.931601    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mwkv/must-gather-65xv5" event={"ID":"2726e79c-59b7-4132-b4d1-39e6db57fd16","Type":"ContainerStarted","Data":"dc763a6fd88dd2920984e1fbf3ba7d409eb074b37d6654412558bbe702051e1d"}
Sep 15 09:47:12.959444 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:12.959308    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mwkv/must-gather-65xv5" event={"ID":"2726e79c-59b7-4132-b4d1-39e6db57fd16","Type":"ContainerStarted","Data":"5a750ef929ae239c7baac971d4be385bf3a7a0bba30473c5d99f4b9c4d709174"}
Sep 15 09:47:12.959444 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:12.959354    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mwkv/must-gather-65xv5" event={"ID":"2726e79c-59b7-4132-b4d1-39e6db57fd16","Type":"ContainerStarted","Data":"c68df9bd3b49020e913027844ba1d9e62dd4cfb9756882e668a811b1da589132"}
Sep 15 09:47:12.972509 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:12.972445    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mwkv/must-gather-65xv5" podStartSLOduration=1.095580158 podStartE2EDuration="1.972422633s" totalImagesPullingTime="876.842475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:47:12.969159526 +0000 UTC m=+2420.558983886" watchObservedRunningTime="2026-09-15 09:47:12.972422633 +0000 UTC m=+2420.562246982"
Sep 15 09:47:14.200685 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:14.200651    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hm2qh_59c90c42-51b9-47a7-8ad3-1361a7008c65/global-pull-secret-syncer/0.log"
Sep 15 09:47:14.317894 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:14.317860    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vczs2_122a3a00-a350-402e-a45e-0c11f278ab5f/konnectivity-agent/0.log"
Sep 15 09:47:14.367386 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:14.367354    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-124.ec2.internal_cba8b8d5513f3abf7095e6b7b748e517/haproxy/0.log"
Sep 15 09:47:19.085505 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:19.085422    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-8475h_3d7b0a8a-764e-4322-b3ab-0aa869fbcbd7/manager/0.log"
Sep 15 09:47:19.122175 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:19.122130    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-224kr_ca67e4e6-d472-4cc6-a634-da8cf8f58ec2/manager/0.log"
Sep 15 09:47:19.152025 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:19.151990    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6dtrg_6effc90f-5c92-49d2-b59f-967977bc70ee/kuadrant-console-plugin/0.log"
Sep 15 09:47:19.196466 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:19.196428    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-j8hc5_118dcbb5-0a6d-4d48-b6a7-6775851712b0/manager/0.log"
Sep 15 09:47:19.315776 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:19.315741    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-mpwvb_3c6d0438-a48d-49aa-89e1-6c63de4ccee1/manager/0.log"
Sep 15 09:47:20.867514 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:20.867486    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9a62c5d-12ba-4fae-8d47-bcdc23cfba15/alertmanager/0.log"
Sep 15 09:47:20.904757 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:20.904722    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9a62c5d-12ba-4fae-8d47-bcdc23cfba15/config-reloader/0.log"
Sep 15 09:47:20.928203 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:20.928175    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9a62c5d-12ba-4fae-8d47-bcdc23cfba15/kube-rbac-proxy-web/0.log"
Sep 15 09:47:20.957740 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:20.956472    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9a62c5d-12ba-4fae-8d47-bcdc23cfba15/kube-rbac-proxy/0.log"
Sep 15 09:47:20.985794 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:20.985765    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9a62c5d-12ba-4fae-8d47-bcdc23cfba15/kube-rbac-proxy-metric/0.log"
Sep 15 09:47:21.008649 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.008617    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9a62c5d-12ba-4fae-8d47-bcdc23cfba15/prom-label-proxy/0.log"
Sep 15 09:47:21.032866 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.032819    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9a62c5d-12ba-4fae-8d47-bcdc23cfba15/init-config-reloader/0.log"
Sep 15 09:47:21.071167 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.071128    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-ksxzd_d6cd90bf-9aed-4a54-baed-0474366ddf5b/cluster-monitoring-operator/0.log"
Sep 15 09:47:21.234794 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.234760    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-x46js_c8e400e2-6bbb-407b-a13c-f08a18851cb6/monitoring-plugin/0.log"
Sep 15 09:47:21.486741 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.486553    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhg8f_5d39d301-40b2-4030-aa2e-0d010d36145d/node-exporter/0.log"
Sep 15 09:47:21.514872 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.514827    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhg8f_5d39d301-40b2-4030-aa2e-0d010d36145d/kube-rbac-proxy/0.log"
Sep 15 09:47:21.545370 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.545310    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhg8f_5d39d301-40b2-4030-aa2e-0d010d36145d/init-textfile/0.log"
Sep 15 09:47:21.582986 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.582152    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-8vx68_4090c9f9-39fd-4647-a59b-fd2b216b6889/kube-rbac-proxy-main/0.log"
Sep 15 09:47:21.615964 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.615929    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-8vx68_4090c9f9-39fd-4647-a59b-fd2b216b6889/kube-rbac-proxy-self/0.log"
Sep 15 09:47:21.641785 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.641750    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-8vx68_4090c9f9-39fd-4647-a59b-fd2b216b6889/openshift-state-metrics/0.log"
Sep 15 09:47:21.906159 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.906049    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-wrr5p_1b3bdae7-0447-43a9-8711-3e54dfa357e1/prometheus-operator/0.log"
Sep 15 09:47:21.951253 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.951211    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-wrr5p_1b3bdae7-0447-43a9-8711-3e54dfa357e1/kube-rbac-proxy/0.log"
Sep 15 09:47:21.976399 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:21.976371    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-twjzw_f2ea1967-abf7-445f-9fa3-65171d7d507a/prometheus-operator-admission-webhook/0.log"
Sep 15 09:47:22.011389 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:22.011349    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-689dd8966d-nwrhc_6a5a42a1-987f-4305-86a2-e4b02b039095/telemeter-client/0.log"
Sep 15 09:47:22.039582 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:22.039555    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-689dd8966d-nwrhc_6a5a42a1-987f-4305-86a2-e4b02b039095/reload/0.log"
Sep 15 09:47:22.063477 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:22.063449    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-689dd8966d-nwrhc_6a5a42a1-987f-4305-86a2-e4b02b039095/kube-rbac-proxy/0.log"
Sep 15 09:47:24.816415 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:24.816379    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75d9cd795b-4xzgk_20030d8c-7d67-49ee-a2b6-64a66eeeff7f/console/0.log"
Sep 15 09:47:24.851377 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:24.851322    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"]
Sep 15 09:47:24.859968 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:24.859922    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:24.866871 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:24.866829    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"]
Sep 15 09:47:24.935447 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:24.935357    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-podres\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:24.935789 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:24.935725    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qn5d\" (UniqueName: \"kubernetes.io/projected/a39a9e8f-703d-4542-ad3d-4f0d87209172-kube-api-access-8qn5d\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:24.935956 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:24.935923    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-lib-modules\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:24.936101 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:24.936071    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-sys\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:24.936184 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:24.936124    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-proc\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.037251 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.037206    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-sys\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.037455 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.037278    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-proc\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.037455 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.037340    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-podres\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.037455 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.037369    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qn5d\" (UniqueName: \"kubernetes.io/projected/a39a9e8f-703d-4542-ad3d-4f0d87209172-kube-api-access-8qn5d\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.037455 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.037409    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-lib-modules\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.037455 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.037438    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-proc\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.037766 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.037537    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-podres\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.037766 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.037565    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-lib-modules\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.037766 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.037575    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a39a9e8f-703d-4542-ad3d-4f0d87209172-sys\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.045097 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.045071    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qn5d\" (UniqueName: \"kubernetes.io/projected/a39a9e8f-703d-4542-ad3d-4f0d87209172-kube-api-access-8qn5d\") pod \"perf-node-gather-daemonset-pqjpq\" (UID: \"a39a9e8f-703d-4542-ad3d-4f0d87209172\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.176132 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.176051    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:25.518568 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.518529    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"]
Sep 15 09:47:25.647755 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:25.647714    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-n9bb7_e706f2c9-46e9-43d0-a23e-c7c5d207e4ce/volume-data-source-validator/0.log"
Sep 15 09:47:26.076027 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:26.075984    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq" event={"ID":"a39a9e8f-703d-4542-ad3d-4f0d87209172","Type":"ContainerStarted","Data":"d4a87437f252cf3ed7645a5c8995520f76765286f2fdbd17dde5518e64192520"}
Sep 15 09:47:26.076680 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:26.076654    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq" event={"ID":"a39a9e8f-703d-4542-ad3d-4f0d87209172","Type":"ContainerStarted","Data":"eb4e5a1f9a66f96464e6ce784deb8babefd8cbc21bf36c7e6194229deb7b85d2"}
Sep 15 09:47:26.076869 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:26.076834    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:26.092770 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:26.092702    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq" podStartSLOduration=2.092682442 podStartE2EDuration="2.092682442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:47:26.091387872 +0000 UTC m=+2433.681212218" watchObservedRunningTime="2026-09-15 09:47:26.092682442 +0000 UTC m=+2433.682506792"
Sep 15 09:47:26.856613 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:26.856579    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5mlqf_f2a57a6a-206a-4619-8db7-6a4b72556702/dns/0.log"
Sep 15 09:47:26.879854 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:26.879824    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5mlqf_f2a57a6a-206a-4619-8db7-6a4b72556702/kube-rbac-proxy/0.log"
Sep 15 09:47:27.053194 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:27.053166    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvd2g_413e8187-a2ca-44b8-afcf-8c6110442c6f/dns-node-resolver/0.log"
Sep 15 09:47:27.629431 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:27.629401    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67cbb975ff-g5mvm_6ab58407-dc71-4075-a155-268d583c05f0/registry/0.log"
Sep 15 09:47:27.679375 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:27.679341    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s5kmk_50c5aa27-d229-4edc-9bf9-2142ce3e2bc5/node-ca/0.log"
Sep 15 09:47:29.630890 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:29.630837    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d5b88c986-dfz4g_489ca57d-8eed-47be-83ba-bd1571102daf/kube-auth-proxy/0.log"
Sep 15 09:47:29.701715 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:29.701668    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-gqczn_5ddb13bf-48e5-4157-ab97-9a62b9465a4a/payload-pre-processing/0.log"
Sep 15 09:47:30.703015 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:30.702979    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zqfz6_46b63c97-b3cf-4388-b759-cfbd781a1827/serve-healthcheck-canary/0.log"
Sep 15 09:47:31.181038 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:31.180904    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-tptsl_cc60eeb8-97da-45c7-b698-3c135ab7f08e/insights-operator/0.log"
Sep 15 09:47:31.182067 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:31.182039    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-tptsl_cc60eeb8-97da-45c7-b698-3c135ab7f08e/insights-operator/1.log"
Sep 15 09:47:31.208548 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:31.208496    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2pgl7_14f53453-227e-4a22-b572-76fd63c0027a/kube-rbac-proxy/0.log"
Sep 15 09:47:31.230736 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:31.230694    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2pgl7_14f53453-227e-4a22-b572-76fd63c0027a/exporter/0.log"
Sep 15 09:47:31.253825 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:31.253793    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2pgl7_14f53453-227e-4a22-b572-76fd63c0027a/extractor/0.log"
Sep 15 09:47:33.103202 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:33.103172    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-pqjpq"
Sep 15 09:47:33.561939 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:33.561887    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qc974_7dcc2ead-7733-47ea-b964-90b1d0f31d51/manager/0.log"
Sep 15 09:47:34.091937 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:34.091895    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j7j96_a6211768-4056-4db1-8b7c-6e0bd710d8f5/manager/0.log"
Sep 15 09:47:34.549168 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:34.549130    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dcfd7f98-j9zf8_b109500a-e462-45de-b13b-ed55f8d86f6c/manager/0.log"
Sep 15 09:47:34.568617 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:34.568590    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dcfd7f98-j9zf8_b109500a-e462-45de-b13b-ed55f8d86f6c/copy-manifests/0.log"
Sep 15 09:47:35.741045 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:35.741006    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d5b88c986-dfz4g_489ca57d-8eed-47be-83ba-bd1571102daf/kube-auth-proxy/0.log"
Sep 15 09:47:35.803414 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:35.803362    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-gqczn_5ddb13bf-48e5-4157-ab97-9a62b9465a4a/payload-pre-processing/0.log"
Sep 15 09:47:36.007260 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:36.007229    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2crpb_1e26e945-7226-43a8-a22d-9896876ae368/openshift-lws-operator/0.log"
Sep 15 09:47:38.288020 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:38.287991    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d5b88c986-dfz4g_489ca57d-8eed-47be-83ba-bd1571102daf/kube-auth-proxy/0.log"
Sep 15 09:47:38.341912 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:38.341879    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-gqczn_5ddb13bf-48e5-4157-ab97-9a62b9465a4a/payload-pre-processing/0.log"
Sep 15 09:47:42.510960 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:42.510933    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rnghd_a65cdf45-fc8a-4bee-95c4-72fd9f36a211/kube-multus-additional-cni-plugins/0.log"
Sep 15 09:47:42.530928 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:42.530902    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rnghd_a65cdf45-fc8a-4bee-95c4-72fd9f36a211/egress-router-binary-copy/0.log"
Sep 15 09:47:42.553225 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:42.553200    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rnghd_a65cdf45-fc8a-4bee-95c4-72fd9f36a211/cni-plugins/0.log"
Sep 15 09:47:42.573454 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:42.573425    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rnghd_a65cdf45-fc8a-4bee-95c4-72fd9f36a211/bond-cni-plugin/0.log"
Sep 15 09:47:42.593522 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:42.593492    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rnghd_a65cdf45-fc8a-4bee-95c4-72fd9f36a211/routeoverride-cni/0.log"
Sep 15 09:47:42.613796 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:42.613772    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rnghd_a65cdf45-fc8a-4bee-95c4-72fd9f36a211/whereabouts-cni-bincopy/0.log"
Sep 15 09:47:42.634979 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:42.634954    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rnghd_a65cdf45-fc8a-4bee-95c4-72fd9f36a211/whereabouts-cni/0.log"
Sep 15 09:47:42.874877 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:42.874815    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-flrg9_2f0f4746-99dd-4108-8702-8d9c3085e39f/kube-multus/0.log"
Sep 15 09:47:43.001770 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:43.001735    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7qqhq_a1791e99-ae22-4734-96b8-eb1e70ce1d05/network-metrics-daemon/0.log"
Sep 15 09:47:43.017777 ip-10-0-140-124 kubenswrapper[2555]: I0915 09:47:43.017755    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7qqhq_a1791e99-ae22-4734-96b8-eb1e70ce1d05/kube-rbac-proxy/0.log"