Sep 09 20:38:50.332439 ip-10-0-135-158 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 20:38:50.332450 ip-10-0-135-158 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 20:38:50.332460 ip-10-0-135-158 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 20:38:50.332655 ip-10-0-135-158 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 20:39:00.575150 ip-10-0-135-158 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 20:39:00.575173 ip-10-0-135-158 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b528c65a1b6642e487e0f5de5df126fa --
Sep 09 20:40:40.828185 ip-10-0-135-158 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 20:40:41.212790 ip-10-0-135-158 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:40:41.212790 ip-10-0-135-158 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 20:40:41.212790 ip-10-0-135-158 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:40:41.212790 ip-10-0-135-158 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 20:40:41.212790 ip-10-0-135-158 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:40:41.213473 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.212844    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 20:40:41.215775 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215759    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:40:41.215775 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215775    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215779    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215782    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215785    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215788    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215791    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215794    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215797    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215800    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215803    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215806    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215809    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215811    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215814    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215817    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215819    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215822    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215829    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215831    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215834    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:40:41.215835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215837    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215839    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215842    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215844    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215847    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215850    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215853    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215856    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215858    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215861    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215863    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215865    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215868    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215870    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215873    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215875    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215878    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215880    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215883    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215885    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:40:41.216421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215887    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215889    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215892    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215894    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215909    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215917    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215920    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215922    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215925    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215929    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215933    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215936    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215938    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215941    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215945    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215948    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215950    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215953    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215956    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:40:41.217115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215958    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215961    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215963    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215965    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215968    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215971    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215973    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215975    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215978    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215980    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215982    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215985    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215987    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215990    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215993    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215995    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.215998    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216001    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216004    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:40:41.217577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216007    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216010    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216014    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216017    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216020    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216023    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216026    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216029    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216032    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216034    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216037    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216039    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216042    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216044    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216046    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216049    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216051    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216053    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216056    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:40:41.218074 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.216058    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:40:41.219441 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219425    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:40:41.219441 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219441    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219445    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219448    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219451    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219453    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219456    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219459    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219461    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219464    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219466    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219469    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219472    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219476    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219480    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219482    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219485    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219487    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219490    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219492    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:40:41.219505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219495    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219497    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219499    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219502    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219504    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219507    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219509    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219512    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219515    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219517    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219520    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219523    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219525    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219528    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219530    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219533    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219536    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219538    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219540    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219543    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:40:41.219984 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219545    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219547    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219550    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219552    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219554    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219557    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219559    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219561    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219564    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219566    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219568    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219571    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219573    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219575    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219579    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219581    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219584    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219586    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219589    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219591    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:40:41.220575 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219593    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219596    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219599    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219602    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219604    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219607    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219609    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219612    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219616    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219619    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219622    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219625    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219628    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219630    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219633    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219635    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219638    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219640    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219643    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:40:41.221089 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219645    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219647    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219651    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219654    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219657    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219659    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219662    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219667    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219670    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219673    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219676    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219680    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219683    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219686    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219688    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219691    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219694    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219696    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219699    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.219701    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:40:41.221537 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220082    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220087    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220090    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220093    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220095    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220098    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220101    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220103    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220107    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220111    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220114    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220117    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220120    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220123    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220126    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220128    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220131    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220134    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220136    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:40:41.222027 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220139    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220142    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220144    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220147    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220149    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220152    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220154    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220156    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220158    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220161    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220163    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220166    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220168    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220170    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220173    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220175    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220177    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220180    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220182    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220190    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:40:41.222484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220192    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220194    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220197    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220199    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220202    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220205    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220207    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220210    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220212    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220215    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220218    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220220    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220222    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220225    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220227    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220230    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220232    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220235    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220237    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:40:41.222961 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220239    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220242    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220244    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220246    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220249    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220251    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220253    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220256    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220258    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220260    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220263    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220265    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220268    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220271    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220274    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220276    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220279    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220282    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220285    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220288    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:40:41.223407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220290    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220292    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220295    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220297    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220301    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220305    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220308    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220311    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220313    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220316    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220318    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220320    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220323    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220325    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220328    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220330    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220332    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220335    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220337    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:40:41.223879 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220339    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.220342    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220416    2555 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220466    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220473    2555 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220477    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220486    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220489    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220492    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220497    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220500    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220503    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220506    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220509    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220512    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220515    2555 flags.go:64] FLAG: --cgroup-root=""
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220517    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220520    2555 flags.go:64] FLAG: --client-ca-file=""
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220523    2555 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220526    2555 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220530    2555 flags.go:64] FLAG: --cluster-domain=""
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220532    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220535    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220538    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 20:40:41.224372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220541    2555 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220544    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220547    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220550    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220553    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220556    2555 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220559    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220561    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220564    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220567    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220571    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220576    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220579    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220582    2555 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220586    2555 flags.go:64] FLAG: --enable-server="true"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220589    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220593    2555 flags.go:64] FLAG: --event-burst="100"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220596    2555 flags.go:64] FLAG: --event-qps="50"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220598    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220601    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220604    2555 flags.go:64] FLAG: --eviction-hard=""
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220607    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220610    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220613    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220616    2555 flags.go:64] FLAG: --eviction-soft=""
Sep 09 20:40:41.224964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220618    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220621    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220624    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220627    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220630    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220633    2555 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220635    2555 flags.go:64] FLAG: --feature-gates=""
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220639    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220641    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220644    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220647    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220650    2555 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220652    2555 flags.go:64] FLAG: --help="false"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220655    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220658    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220661    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220663    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220666    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220671    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220673    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220676    2555 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220680    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220683    2555 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 20:40:41.225574 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220686    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220689    2555 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220691    2555 flags.go:64] FLAG: --kube-reserved=""
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220694    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220697    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220700    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220702    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220705    2555 flags.go:64] FLAG: --lock-file=""
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220707    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220710    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220713    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220718    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220722    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220725    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220727    2555 flags.go:64] FLAG: --logging-format="text"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220730    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220733    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220736    2555 flags.go:64] FLAG: --manifest-url=""
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220738    2555 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220742    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220745    2555 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220748    2555 flags.go:64] FLAG: --max-pods="110"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220763    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220767    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220770    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 20:40:41.226168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220773    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220776    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220780    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220783    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220790    2555 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220796    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220799    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220802    2555 flags.go:64] FLAG: --pod-cidr=""
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220804    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220809    2555 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220812    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220815    2555 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220818    2555 flags.go:64] FLAG: --port="10250"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220821    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220823    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bc90e29480365afb"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220826    2555 flags.go:64] FLAG: --qos-reserved=""
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220829    2555 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220832    2555 flags.go:64] FLAG: --register-node="true"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220835    2555 flags.go:64] FLAG: --register-with-taints=""
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220838    2555 flags.go:64] FLAG: --registry-burst="10"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220841    2555 flags.go:64] FLAG: --registry-qps="5"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220844    2555 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220847    2555 flags.go:64] FLAG: --reserved-memory=""
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220850    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220853    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 20:40:41.226773 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220855    2555 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220858    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220861    2555 flags.go:64] FLAG: --runonce="false"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220863    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220866    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220869    2555 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220872    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220874    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220877    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220881    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220884    2555 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220887    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220889    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220893    2555 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220896    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220921    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220926    2555 flags.go:64] FLAG: --system-cgroups=""
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220928    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220934    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220937    2555 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220939    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220943    2555 flags.go:64] FLAG: --tls-min-version=""
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220945    2555 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220948    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220951    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 20:40:41.227384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220954    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220957    2555 flags.go:64] FLAG: --v="2"
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220961    2555 flags.go:64] FLAG: --version="false"
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220965    2555 flags.go:64] FLAG: --vmodule=""
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220969    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.220972    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221085    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221088    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221092    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221095    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221099    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221102    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221105    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221107    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221110    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221112    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221116    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221119    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221123    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221126    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221131    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:40:41.228032 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221133    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221136    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221138    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221141    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221144    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221147    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221149    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221152    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221155    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221157    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221159    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221162    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221164    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221166    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221169    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221172    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221174    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221177    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221179    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221181    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:40:41.228562 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221184    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221186    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221189    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221191    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221194    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221196    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221199    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221203    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221205    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221207    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221210    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221214    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221219    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221223    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221227    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221231    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221234    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221237    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221240    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:40:41.229067 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221242    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221244    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221247    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221249    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221252    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221254    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221257    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221259    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221261    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221267    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221270    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221272    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221275    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221277    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221279    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221282    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221284    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221286    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221289    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221291    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:40:41.229524 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221295    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221297    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221300    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221302    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221306    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221308    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221311    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221314    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221318    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221321    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221324    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221326    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221329    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221331    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221334    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221336    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221338    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221341    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221343    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:40:41.230029 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221345    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221348    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221350    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221353    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221356    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.221358    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.221921    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.229574    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.229588    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.229605    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.229611    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229670    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229675    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229678    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:40:41.230479 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229681    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229685    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229688    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229692    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229694    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229697    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229700    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229703    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229706    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229708    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229711    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229714    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229716    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229719    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229721    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229723    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229726    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229729    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229732    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229735    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:40:41.230855 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229737    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229741    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229743    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229746    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229749    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229752    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229754    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229757    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229760    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229762    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229765    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229767    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229770    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229772    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229774    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229777    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229779    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229781    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229784    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:40:41.231339 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229786    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229788    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229792    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229795    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229798    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229800    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229803    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229805    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229807    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229810    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229812    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229814    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229817    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229819    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229822    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229824    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229827    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229830    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229832    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:40:41.231799 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229835    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229838    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229840    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229843    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229845    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229848    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229850    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229852    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229855    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229857    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229860    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229862    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229864    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229867    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229869    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229871    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229874    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229876    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229879    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229881    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:40:41.232264 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229883    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229886    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229888    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229890    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229892    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229895    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229911    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229913    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229916    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229919    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229921    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229924    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229927    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229930    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229932    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229934    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229937    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:40:41.232741 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.229939    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.229944    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230078    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230084    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230087    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230090    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230092    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230095    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230098    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230100    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230103    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230107    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230110    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230113    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:40:41.233245 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230116    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230118    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230121    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230123    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230126    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230128    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230131    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230134    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230136    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230138    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230141    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230144    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230146    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230149    2555 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230151    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230153    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230156    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230158    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230160    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230163    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:40:41.233577 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230165    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230167    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230170    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230172    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230174    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230177    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230179    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230181    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230184    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230187    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230189    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230192    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230194    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230196    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230198    2555 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230201    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230203    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230205    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230208    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230210    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:40:41.234064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230213    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230215    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230217    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230220    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230222    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230225    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230227    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230229    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230232    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230234    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230237    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230239    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230241    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230243    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230246    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230249    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230253    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230256    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230259    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:40:41.234543 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230262    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230265    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230268    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230270    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230273    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230275    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230278    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230280    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230283    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230285    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230288    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230290    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230293    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230295    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230297    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230299    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230302    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230304    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230307    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230309    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:40:41.235013 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230312    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230314    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230316    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230319    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230321    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230323    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230325    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:41.230328    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.230332    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.230426    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.232518    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.233740    2555 server.go:1019] "Starting client certificate rotation"
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.233848    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 20:40:41.235484 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.233884    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 20:40:41.236337 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.236323    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 20:40:41.238434 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.238414    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 20:40:41.250207 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.250179    2555 log.go:25] "Validated CRI v1 runtime API"
Sep 09 20:40:41.254065 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.254044    2555 log.go:25] "Validated CRI v1 image API"
Sep 09 20:40:41.254917 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.254872    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 20:40:41.258411 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.258391    2555 fs.go:135] Filesystem UUIDs: map[61e70bb7-fd9b-4bd0-9212-ce8151f8b63d:/dev/nvme0n1p4 62cdc2bc-0fc8-4212-9396-2303610b7af8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 09 20:40:41.258484 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.258409    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 20:40:41.265039 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.264935    2555 manager.go:216] Machine: {Timestamp:2026-09-09 20:40:41.263591704 +0000 UTC m=+0.320128836 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3148195 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cf44182cc24b59c810f59f11f8f4f SystemUUID:ec2cf441-82cc-24b5-9c81-0f59f11f8f4f BootID:b528c65a-1b66-42e4-87e0-f5de5df126fa Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:ff:80:a6:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:ff:80:a6:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:50:dd:5c:13:96 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 20:40:41.265039 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.265035    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 20:40:41.265145 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.265118    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 20:40:41.268387 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.268360    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 20:40:41.268551 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.268390    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 20:40:41.269233 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.269220    2555 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 20:40:41.269333 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.269239    2555 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 20:40:41.269333 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.269250    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 20:40:41.270110 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.270097    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 20:40:41.271384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.271372    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 20:40:41.274619 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.274604    2555 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 20:40:41.274768 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.274756    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 20:40:41.274830 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.274802    2555 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 20:40:41.274830 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.274824    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 20:40:41.274942 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.274841    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 20:40:41.274942 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.274938    2555 kubelet.go:398] "Adding apiserver pod source"
Sep 09 20:40:41.275023 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.274953    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 20:40:41.275346 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.275330    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 20:40:41.275419 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.275356    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 20:40:41.277474 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.277440    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 20:40:41.279737 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.279723    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 20:40:41.279801 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.279753    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 20:40:41.280595 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280584    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 20:40:41.280634 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280602    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 20:40:41.280634 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280608    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 20:40:41.280634 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280613    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 20:40:41.280634 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280621    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 20:40:41.280634 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280627    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 20:40:41.280758 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280639    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 20:40:41.280758 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280644    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 20:40:41.280758 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280652    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 20:40:41.280758 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280657    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 20:40:41.280758 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280698    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 20:40:41.280758 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.280704    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 20:40:41.281050 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.281035    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 20:40:41.282158 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.282146    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 20:40:41.282158 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.282157    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 20:40:41.285910 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.285884    2555 server.go:1268] "Started kubelet"
Sep 09 20:40:41.286043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.286010    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 20:40:41.286095 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.286015    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 20:40:41.286181 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.286168    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 20:40:41.286955 ip-10-0-135-158 systemd[1]: Started Kubernetes Kubelet.
Sep 09 20:40:41.290604 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.290563    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 20:40:41.291576 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.291522    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 20:40:41.291958 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.291937    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 20:40:41.292808 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.292789    2555 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 20:40:41.295295 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.295276    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 20:40:41.295295 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.295285    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 20:40:41.295394 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.295284    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 20:40:41.295628 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.294686    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-158.ec2.internal.18d3c1b09cd57926  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-158.ec2.internal,UID:ip-10-0-135-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-158.ec2.internal,},FirstTimestamp:2026-09-09 20:40:41.285859622 +0000 UTC m=+0.342396753,LastTimestamp:2026-09-09 20:40:41.285859622 +0000 UTC m=+0.342396753,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-158.ec2.internal,}"
Sep 09 20:40:41.295873 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.295859    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 20:40:41.296017 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.295980    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:41.296551 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.296431    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 20:40:41.296551 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.296436    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 20:40:41.296551 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.296458    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 20:40:41.296551 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.296525    2555 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 20:40:41.296551 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.296532    2555 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 20:40:41.297703 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.297687    2555 factory.go:55] Registering systemd factory
Sep 09 20:40:41.297782 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.297729    2555 factory.go:223] Registration of the systemd container factory successfully
Sep 09 20:40:41.297971 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.297956    2555 factory.go:153] Registering CRI-O factory
Sep 09 20:40:41.297971 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.297973    2555 factory.go:223] Registration of the crio container factory successfully
Sep 09 20:40:41.298090 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.298014    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 20:40:41.298090 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.298028    2555 factory.go:103] Registering Raw factory
Sep 09 20:40:41.298090 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.298038    2555 manager.go:1196] Started watching for new ooms in manager
Sep 09 20:40:41.298216 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.298099    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 20:40:41.298440 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.297953    2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 20:40:41.298602 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.298588    2555 manager.go:349] Starting recovery of all containers
Sep 09 20:40:41.305136 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.304942    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 20:40:41.308594 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.308575    2555 manager.go:354] Recovery completed
Sep 09 20:40:41.311738 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.311721    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nks8j"
Sep 09 20:40:41.313005 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.312993    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:40:41.314760 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.314737    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:40:41.314851 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.314772    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:40:41.314851 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.314787    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:40:41.315417 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.315401    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 20:40:41.315417 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.315412    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 20:40:41.315417 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.315419    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:40:41.315546 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.315428    2555 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 20:40:41.316158 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.316143    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:40:41.316229 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.316167    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:40:41.316229 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.316191    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:40:41.316798 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.316779    2555 policy_none.go:49] "None policy: Start"
Sep 09 20:40:41.316893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.316803    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 20:40:41.316893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.316821    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 20:40:41.316998 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.316852    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-158.ec2.internal.18d3c1b09e8e5b23  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-158.ec2.internal,UID:ip-10-0-135-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-158.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-158.ec2.internal,},FirstTimestamp:2026-09-09 20:40:41.314753315 +0000 UTC m=+0.371290447,LastTimestamp:2026-09-09 20:40:41.314753315 +0000 UTC m=+0.371290447,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-158.ec2.internal,}"
Sep 09 20:40:41.318010 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.318000    2555 policy_none.go:47] "Start"
Sep 09 20:40:41.321925 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.321891    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nks8j"
Sep 09 20:40:41.325269 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.325169    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-158.ec2.internal.18d3c1b09e8ec23d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-158.ec2.internal,UID:ip-10-0-135-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-158.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-158.ec2.internal,},FirstTimestamp:2026-09-09 20:40:41.314779709 +0000 UTC m=+0.371316842,LastTimestamp:2026-09-09 20:40:41.314779709 +0000 UTC m=+0.371316842,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-158.ec2.internal,}"
Sep 09 20:40:41.352540 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.352523    2555 manager.go:337] "Starting Device Plugin manager"
Sep 09 20:40:41.370321 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.352572    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 20:40:41.370321 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.352586    2555 server.go:87] "Starting device plugin registration server"
Sep 09 20:40:41.370321 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.353009    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 20:40:41.370321 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.353022    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 20:40:41.370321 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.353143    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 20:40:41.370321 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.353210    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 20:40:41.370321 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.353219    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 20:40:41.370321 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.353839    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 20:40:41.370321 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.353881    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:41.423873 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.423844    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 20:40:41.424027 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.423925    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 20:40:41.424027 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.423957    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 20:40:41.424027 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.424003    2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 20:40:41.426391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.426370    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:40:41.453557 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.453531    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:40:41.454414 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.454399    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:40:41.454467 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.454430    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:40:41.454467 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.454441    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:40:41.454530 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.454468    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.460391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.460376    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.460431 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.460398    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-158.ec2.internal\": node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:41.478256 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.478159    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:41.524871 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.524836    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal"]
Sep 09 20:40:41.525045 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.524927    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:40:41.526479 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.526454    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:40:41.526571 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.526491    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:40:41.526571 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.526508    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:40:41.527841 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.527829    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:40:41.527976 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.527955    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.528024 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.527991    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:40:41.528526 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.528503    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:40:41.528526 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.528521    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:40:41.528624 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.528544    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:40:41.528624 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.528554    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:40:41.528624 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.528526    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:40:41.528624 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.528610    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:40:41.529822 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.529808    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.529892 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.529833    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:40:41.530540 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.530520    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:40:41.530540 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.530542    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:40:41.530633 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.530553    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:40:41.559522 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.559498    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-158.ec2.internal\" not found" node="ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.563830 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.563815    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-158.ec2.internal\" not found" node="ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.578257 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.578241    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:41.598909 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.598882    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ca53e03ff182c14b08d53f7da0d644e0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-158.ec2.internal\" (UID: \"ca53e03ff182c14b08d53f7da0d644e0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.599021 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.598921    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e260fc8595ceffeccd15b0b3453e3629-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal\" (UID: \"e260fc8595ceffeccd15b0b3453e3629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.599021 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.598940    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e260fc8595ceffeccd15b0b3453e3629-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal\" (UID: \"e260fc8595ceffeccd15b0b3453e3629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.679378 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.679335    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:41.699694 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.699675    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ca53e03ff182c14b08d53f7da0d644e0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-158.ec2.internal\" (UID: \"ca53e03ff182c14b08d53f7da0d644e0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.699747 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.699700    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e260fc8595ceffeccd15b0b3453e3629-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal\" (UID: \"e260fc8595ceffeccd15b0b3453e3629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.699747 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.699715    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e260fc8595ceffeccd15b0b3453e3629-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal\" (UID: \"e260fc8595ceffeccd15b0b3453e3629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.699805 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.699780    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e260fc8595ceffeccd15b0b3453e3629-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal\" (UID: \"e260fc8595ceffeccd15b0b3453e3629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.699805 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.699786    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ca53e03ff182c14b08d53f7da0d644e0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-158.ec2.internal\" (UID: \"ca53e03ff182c14b08d53f7da0d644e0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.699861 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.699798    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e260fc8595ceffeccd15b0b3453e3629-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal\" (UID: \"e260fc8595ceffeccd15b0b3453e3629\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.780166 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.780103    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:41.862608 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.862564    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.866930 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:41.866530    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:41.880606 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.880588    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:41.981213 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:41.981174    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:42.081770 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:42.081744    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:42.182254 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:42.182222    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:42.233806 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.233768    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 20:40:42.234238 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.233925    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 20:40:42.283197 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:42.283169    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:42.323509 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.323475    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 20:35:41 +0000 UTC" deadline="2028-05-18 20:43:25.462099038 +0000 UTC"
Sep 09 20:40:42.323509 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.323505    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14808h2m43.138597251s"
Sep 09 20:40:42.329645 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.329624    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:40:42.384073 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:42.384013    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:42.441548 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:42.441512    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca53e03ff182c14b08d53f7da0d644e0.slice/crio-c939c85ee48b88cb0a5904bb7510d83e31e349a5b2e6269f6106d230182b49c4 WatchSource:0}: Error finding container c939c85ee48b88cb0a5904bb7510d83e31e349a5b2e6269f6106d230182b49c4: Status 404 returned error can't find the container with id c939c85ee48b88cb0a5904bb7510d83e31e349a5b2e6269f6106d230182b49c4
Sep 09 20:40:42.441877 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:42.441859    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode260fc8595ceffeccd15b0b3453e3629.slice/crio-b718efaa66c88c56e729bddcad003e0cfef0e83e7d0e8941f654a96420002211 WatchSource:0}: Error finding container b718efaa66c88c56e729bddcad003e0cfef0e83e7d0e8941f654a96420002211: Status 404 returned error can't find the container with id b718efaa66c88c56e729bddcad003e0cfef0e83e7d0e8941f654a96420002211
Sep 09 20:40:42.446155 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.446142    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:40:42.477124 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.477093    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:40:42.478107 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.478093    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:40:42.478185 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.478121    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:40:42.478185 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.478131    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:40:42.484839 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:42.484825    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:42.499283 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.499269    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:40:42.585527 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:42.585506    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-158.ec2.internal\" not found"
Sep 09 20:40:42.625059 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.625036    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:40:42.697253 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.697183    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:42.709509 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.709487    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 20:40:42.710628 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.710610    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal"
Sep 09 20:40:42.718816 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:42.718801    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 20:40:43.276443 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.276411    2555 apiserver.go:52] "Watching apiserver"
Sep 09 20:40:43.285838 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.285804    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 20:40:43.287223 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.287185    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hh7dn","kube-system/konnectivity-agent-jw6lc","kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal","openshift-cluster-node-tuning-operator/tuned-v5gnk","openshift-image-registry/node-ca-52qg8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal","openshift-multus/multus-additional-cni-plugins-vn55g","openshift-multus/network-metrics-daemon-fqfwz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph","openshift-dns/node-resolver-7rzt9","openshift-multus/multus-98bmz","openshift-network-diagnostics/network-check-target-t8ztn","openshift-network-operator/iptables-alerter-f97qg","openshift-ovn-kubernetes/ovnkube-node-4ht2t"]
Sep 09 20:40:43.289741 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.289709    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.291315 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.291294    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.292376 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.292344    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 20:40:43.292584 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.292567    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 20:40:43.292789 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.292774    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 20:40:43.293591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.293026    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cvldf\""
Sep 09 20:40:43.293591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.293061    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.293591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.293291    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 20:40:43.293591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.293300    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 20:40:43.293892 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.293867    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:40:43.294302 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.294278    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 20:40:43.294608 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.294578    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.294785 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.294769    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jcxcx\""
Sep 09 20:40:43.295088 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.295060    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 20:40:43.295702 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.295685    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 20:40:43.295920 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.295888    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 20:40:43.296012 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.295993    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 20:40:43.296102 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.296086    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 20:40:43.296313 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.296294    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 20:40:43.296577 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.296557    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 20:40:43.296748 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.296728    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:40:43.296825 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.296749    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w54k8\""
Sep 09 20:40:43.297061 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.297043    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 20:40:43.297181 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.297162    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.297312 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.297293    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 20:40:43.297373 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.297322    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7q7rm\""
Sep 09 20:40:43.298994 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.298955    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:43.299094 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.299046    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:40:43.300785 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.300766    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 20:40:43.300881 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.300765    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 20:40:43.300949 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.300767    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 20:40:43.301030 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.300777    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.301297 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.301280    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vng9c\""
Sep 09 20:40:43.302301 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.302265    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:43.302393 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.302365    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:40:43.303682 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.303661    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 20:40:43.303930 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.303914    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28xmp\""
Sep 09 20:40:43.304113 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.304088    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 20:40:43.304210 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.304156    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 20:40:43.305312 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.305293    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:40:43.307747 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.307652    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 20:40:43.307747 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.307731    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4mbpn\""
Sep 09 20:40:43.308058 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.308041    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.308921 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.308898    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 20:40:43.309949 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.309893    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.310282 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310263    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-cni-netd\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.310386 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310296    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/231a1ab6-339b-4a16-942e-6de224b5e168-env-overrides\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.310386 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310327    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/231a1ab6-339b-4a16-942e-6de224b5e168-ovnkube-script-lib\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.310386 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310363    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqr24\" (UniqueName: \"kubernetes.io/projected/231a1ab6-339b-4a16-942e-6de224b5e168-kube-api-access-xqr24\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.310552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310390    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-sysctl-d\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.310552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310418    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-sysctl-conf\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.310552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310428    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 20:40:43.310552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310453    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx2vr\" (UniqueName: \"kubernetes.io/projected/aac5532c-a02c-44cc-9747-92bc07af2c66-kube-api-access-rx2vr\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.310552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310480    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1de80a2-8f79-4413-87bc-9499b5dce533-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.310552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310510    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73390ba-54dd-48f0-8c27-f201e82a8974-host-slash\") pod \"iptables-alerter-f97qg\" (UID: \"d73390ba-54dd-48f0-8c27-f201e82a8974\") " pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.310552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310536    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-run-systemd\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310562    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310587    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-host\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310615    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-tuned\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310641    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1de80a2-8f79-4413-87bc-9499b5dce533-cnibin\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310667    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d73390ba-54dd-48f0-8c27-f201e82a8974-iptables-alerter-script\") pod \"iptables-alerter-f97qg\" (UID: \"d73390ba-54dd-48f0-8c27-f201e82a8974\") " pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310693    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b5ntm\""
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310705    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pphtp\" (UniqueName: \"kubernetes.io/projected/d73390ba-54dd-48f0-8c27-f201e82a8974-kube-api-access-pphtp\") pod \"iptables-alerter-f97qg\" (UID: \"d73390ba-54dd-48f0-8c27-f201e82a8974\") " pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310746    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-kubelet\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310774    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-run-openvswitch\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310801    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310830    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-lib-modules\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310878    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d34c436a-fb65-4ffb-9965-4ac57316f6fc-host\") pod \"node-ca-52qg8\" (UID: \"d34c436a-fb65-4ffb-9965-4ac57316f6fc\") " pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.310896 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310891    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 20:40:43.311428 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310903    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1de80a2-8f79-4413-87bc-9499b5dce533-system-cni-dir\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.311428 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.310940    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-slash\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.311428 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311008    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-run-ovn\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.311428 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311164    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-var-lib-kubelet\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.311632 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311551    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1de80a2-8f79-4413-87bc-9499b5dce533-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.311632 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311594    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1de80a2-8f79-4413-87bc-9499b5dce533-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.311632 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311612    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-systemd-units\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.311784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311635    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-run-netns\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.311784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311661    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/231a1ab6-339b-4a16-942e-6de224b5e168-ovn-node-metrics-cert\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.311784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311677    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-modprobe-d\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.311784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311692    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-run\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.311784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311722    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-sys\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.311784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311733    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 20:40:43.311784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311748    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-log-socket\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.311784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311765    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/231a1ab6-339b-4a16-942e-6de224b5e168-ovnkube-config\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.311784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311780    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-sysconfig\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311794    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aac5532c-a02c-44cc-9747-92bc07af2c66-tmp\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311809    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-etc-openvswitch\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311849    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-node-log\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311864    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-kubernetes\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311878    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-systemd\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311890    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d34c436a-fb65-4ffb-9965-4ac57316f6fc-serviceca\") pod \"node-ca-52qg8\" (UID: \"d34c436a-fb65-4ffb-9965-4ac57316f6fc\") " pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311908    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzklb\" (UniqueName: \"kubernetes.io/projected/d1de80a2-8f79-4413-87bc-9499b5dce533-kube-api-access-hzklb\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311924    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311929    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-var-lib-openvswitch\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311945    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-cni-bin\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.311959    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n9pk\" (UniqueName: \"kubernetes.io/projected/d34c436a-fb65-4ffb-9965-4ac57316f6fc-kube-api-access-2n9pk\") pod \"node-ca-52qg8\" (UID: \"d34c436a-fb65-4ffb-9965-4ac57316f6fc\") " pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.311969    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:40:43.312187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.312021    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1de80a2-8f79-4413-87bc-9499b5dce533-cni-binary-copy\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.312793 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.312708    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7d425\""
Sep 09 20:40:43.312793 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.312778    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 20:40:43.337397 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.337096    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-brz88"
Sep 09 20:40:43.351599 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.351576    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-brz88"
Sep 09 20:40:43.358849 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.358831    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:40:43.398240 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.398209    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 20:40:43.412565 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412534    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-log-socket\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.412712 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412572    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/231a1ab6-339b-4a16-942e-6de224b5e168-ovnkube-config\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.412712 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412596    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aac5532c-a02c-44cc-9747-92bc07af2c66-tmp\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.412712 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412622    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-run-multus-certs\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.412712 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412673    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-log-socket\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.412910 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412690    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvwkh\" (UniqueName: \"kubernetes.io/projected/896892f0-5293-4476-9a21-57fdab876af2-kube-api-access-bvwkh\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.412910 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412755    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-node-log\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.412910 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412809    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-node-log\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.412910 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412840    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-kubernetes\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.412910 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412873    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-systemd\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412900    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d34c436a-fb65-4ffb-9965-4ac57316f6fc-serviceca\") pod \"node-ca-52qg8\" (UID: \"d34c436a-fb65-4ffb-9965-4ac57316f6fc\") " pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412953    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-system-cni-dir\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412965    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-systemd\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.412982    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-multus-socket-dir-parent\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413011    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-cni-bin\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413029    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-kubernetes\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413042    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-sys-fs\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413070    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33d147f1-c408-4f83-8a62-85daa68efe74-agent-certs\") pod \"konnectivity-agent-jw6lc\" (UID: \"33d147f1-c408-4f83-8a62-85daa68efe74\") " pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413096    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-cni-netd\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413099    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-cni-bin\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413122    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/231a1ab6-339b-4a16-942e-6de224b5e168-ovnkube-script-lib\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413153    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqr24\" (UniqueName: \"kubernetes.io/projected/231a1ab6-339b-4a16-942e-6de224b5e168-kube-api-access-xqr24\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.413211 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413153    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-cni-netd\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413291    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413363    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d34c436a-fb65-4ffb-9965-4ac57316f6fc-serviceca\") pod \"node-ca-52qg8\" (UID: \"d34c436a-fb65-4ffb-9965-4ac57316f6fc\") " pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413371    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/231a1ab6-339b-4a16-942e-6de224b5e168-ovnkube-config\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413479    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-sysctl-conf\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413501    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1de80a2-8f79-4413-87bc-9499b5dce533-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413518    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2918f9ef-71c5-4062-8256-0298b6c0ee39-hosts-file\") pod \"node-resolver-7rzt9\" (UID: \"2918f9ef-71c5-4062-8256-0298b6c0ee39\") " pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413543    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-multus-conf-dir\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413588    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413643    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73390ba-54dd-48f0-8c27-f201e82a8974-host-slash\") pod \"iptables-alerter-f97qg\" (UID: \"d73390ba-54dd-48f0-8c27-f201e82a8974\") " pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413665    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-sysctl-conf\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413690    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/231a1ab6-339b-4a16-942e-6de224b5e168-ovnkube-script-lib\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413696    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-host\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413694    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1de80a2-8f79-4413-87bc-9499b5dce533-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413695    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73390ba-54dd-48f0-8c27-f201e82a8974-host-slash\") pod \"iptables-alerter-f97qg\" (UID: \"d73390ba-54dd-48f0-8c27-f201e82a8974\") " pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413745    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-tuned\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413788    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-host\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413794    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-multus-cni-dir\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.413875 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413848    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-var-lib-cni-bin\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413894    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-var-lib-cni-multus\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413954    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1de80a2-8f79-4413-87bc-9499b5dce533-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.413981    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2spx\" (UniqueName: \"kubernetes.io/projected/67f0be98-a4eb-41c6-8886-231d1c4f5263-kube-api-access-f2spx\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414010    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-lib-modules\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414134    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d34c436a-fb65-4ffb-9965-4ac57316f6fc-host\") pod \"node-ca-52qg8\" (UID: \"d34c436a-fb65-4ffb-9965-4ac57316f6fc\") " pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414179    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d34c436a-fb65-4ffb-9965-4ac57316f6fc-host\") pod \"node-ca-52qg8\" (UID: \"d34c436a-fb65-4ffb-9965-4ac57316f6fc\") " pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414218    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7zmf\" (UniqueName: \"kubernetes.io/projected/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-kube-api-access-x7zmf\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414243    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-lib-modules\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414279    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8389da71-7435-4fe7-8ef9-698d0f2486c7-kubelet-config\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414318    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33d147f1-c408-4f83-8a62-85daa68efe74-konnectivity-ca\") pod \"konnectivity-agent-jw6lc\" (UID: \"33d147f1-c408-4f83-8a62-85daa68efe74\") " pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414357    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/896892f0-5293-4476-9a21-57fdab876af2-cni-binary-copy\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414385    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-slash\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414415    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-run-ovn\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414437    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8389da71-7435-4fe7-8ef9-698d0f2486c7-dbus\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414451    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1de80a2-8f79-4413-87bc-9499b5dce533-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414481    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-run-ovn\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.414720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414513    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-slash\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414514    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-var-lib-kubelet\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414548    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-modprobe-d\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414575    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-run\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414600    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-sys\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414627    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2918f9ef-71c5-4062-8256-0298b6c0ee39-tmp-dir\") pod \"node-resolver-7rzt9\" (UID: \"2918f9ef-71c5-4062-8256-0298b6c0ee39\") " pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414645    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-modprobe-d\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414654    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-sysconfig\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414681    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-socket-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414688    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-sys\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414713    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-etc-kubernetes\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414725    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-run\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414731    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-etc-openvswitch\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414763    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzklb\" (UniqueName: \"kubernetes.io/projected/d1de80a2-8f79-4413-87bc-9499b5dce533-kube-api-access-hzklb\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414786    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-sysconfig\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414830    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-etc-openvswitch\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414843    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:43.415528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414947    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-registration-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414982    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.414999    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-hostroot\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415027    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-var-lib-openvswitch\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415049    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9pk\" (UniqueName: \"kubernetes.io/projected/d34c436a-fb65-4ffb-9965-4ac57316f6fc-kube-api-access-2n9pk\") pod \"node-ca-52qg8\" (UID: \"d34c436a-fb65-4ffb-9965-4ac57316f6fc\") " pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415060    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-var-lib-openvswitch\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415066    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1de80a2-8f79-4413-87bc-9499b5dce533-cni-binary-copy\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415097    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-device-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415121    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-run-netns\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415145    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/231a1ab6-339b-4a16-942e-6de224b5e168-env-overrides\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415169    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-sysctl-d\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415193    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx2vr\" (UniqueName: \"kubernetes.io/projected/aac5532c-a02c-44cc-9747-92bc07af2c66-kube-api-access-rx2vr\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415217    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415240    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-run-systemd\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415263    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415289    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1de80a2-8f79-4413-87bc-9499b5dce533-cnibin\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415359    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-cnibin\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.416164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415508    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-run-k8s-cni-cncf-io\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415532    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415549    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1de80a2-8f79-4413-87bc-9499b5dce533-cni-binary-copy\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415578    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-run-systemd\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415591    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d73390ba-54dd-48f0-8c27-f201e82a8974-iptables-alerter-script\") pod \"iptables-alerter-f97qg\" (UID: \"d73390ba-54dd-48f0-8c27-f201e82a8974\") " pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415635    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1de80a2-8f79-4413-87bc-9499b5dce533-cnibin\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415669    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415709    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pphtp\" (UniqueName: \"kubernetes.io/projected/d73390ba-54dd-48f0-8c27-f201e82a8974-kube-api-access-pphtp\") pod \"iptables-alerter-f97qg\" (UID: \"d73390ba-54dd-48f0-8c27-f201e82a8974\") " pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415737    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-kubelet\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415812    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-sysctl-d\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415843    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-run-openvswitch\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415873    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415920    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1de80a2-8f79-4413-87bc-9499b5dce533-system-cni-dir\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415947    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/231a1ab6-339b-4a16-942e-6de224b5e168-env-overrides\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415951    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wtzm\" (UniqueName: \"kubernetes.io/projected/2918f9ef-71c5-4062-8256-0298b6c0ee39-kube-api-access-5wtzm\") pod \"node-resolver-7rzt9\" (UID: \"2918f9ef-71c5-4062-8256-0298b6c0ee39\") " pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.415996    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416026    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-kubelet\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.416929 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416055    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-run-openvswitch\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416085    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1de80a2-8f79-4413-87bc-9499b5dce533-system-cni-dir\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416100    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-var-lib-kubelet\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416147    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1de80a2-8f79-4413-87bc-9499b5dce533-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416188    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/896892f0-5293-4476-9a21-57fdab876af2-multus-daemon-config\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416240    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d73390ba-54dd-48f0-8c27-f201e82a8974-iptables-alerter-script\") pod \"iptables-alerter-f97qg\" (UID: \"d73390ba-54dd-48f0-8c27-f201e82a8974\") " pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416242    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aac5532c-a02c-44cc-9747-92bc07af2c66-var-lib-kubelet\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416259    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-systemd-units\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416378    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-run-netns\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416388    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-systemd-units\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416420    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/231a1ab6-339b-4a16-942e-6de224b5e168-host-run-netns\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416422    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/231a1ab6-339b-4a16-942e-6de224b5e168-ovn-node-metrics-cert\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.417788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.416740    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1de80a2-8f79-4413-87bc-9499b5dce533-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.418400 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.418035    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aac5532c-a02c-44cc-9747-92bc07af2c66-etc-tuned\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.418400 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.418049    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aac5532c-a02c-44cc-9747-92bc07af2c66-tmp\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.419191 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.419167    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/231a1ab6-339b-4a16-942e-6de224b5e168-ovn-node-metrics-cert\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.423292 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.423260    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqr24\" (UniqueName: \"kubernetes.io/projected/231a1ab6-339b-4a16-942e-6de224b5e168-kube-api-access-xqr24\") pod \"ovnkube-node-4ht2t\" (UID: \"231a1ab6-339b-4a16-942e-6de224b5e168\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.427020 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.426988    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx2vr\" (UniqueName: \"kubernetes.io/projected/aac5532c-a02c-44cc-9747-92bc07af2c66-kube-api-access-rx2vr\") pod \"tuned-v5gnk\" (UID: \"aac5532c-a02c-44cc-9747-92bc07af2c66\") " pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.427133 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.427022    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzklb\" (UniqueName: \"kubernetes.io/projected/d1de80a2-8f79-4413-87bc-9499b5dce533-kube-api-access-hzklb\") pod \"multus-additional-cni-plugins-vn55g\" (UID: \"d1de80a2-8f79-4413-87bc-9499b5dce533\") " pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.427133 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.427073    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n9pk\" (UniqueName: \"kubernetes.io/projected/d34c436a-fb65-4ffb-9965-4ac57316f6fc-kube-api-access-2n9pk\") pod \"node-ca-52qg8\" (UID: \"d34c436a-fb65-4ffb-9965-4ac57316f6fc\") " pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.429920 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.429854    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal" event={"ID":"ca53e03ff182c14b08d53f7da0d644e0","Type":"ContainerStarted","Data":"c939c85ee48b88cb0a5904bb7510d83e31e349a5b2e6269f6106d230182b49c4"}
Sep 09 20:40:43.431283 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.431257    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal" event={"ID":"e260fc8595ceffeccd15b0b3453e3629","Type":"ContainerStarted","Data":"b718efaa66c88c56e729bddcad003e0cfef0e83e7d0e8941f654a96420002211"}
Sep 09 20:40:43.433028 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.433007    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pphtp\" (UniqueName: \"kubernetes.io/projected/d73390ba-54dd-48f0-8c27-f201e82a8974-kube-api-access-pphtp\") pod \"iptables-alerter-f97qg\" (UID: \"d73390ba-54dd-48f0-8c27-f201e82a8974\") " pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.517184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517150    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/896892f0-5293-4476-9a21-57fdab876af2-multus-daemon-config\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517185    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-run-multus-certs\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517202    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvwkh\" (UniqueName: \"kubernetes.io/projected/896892f0-5293-4476-9a21-57fdab876af2-kube-api-access-bvwkh\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517218    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-system-cni-dir\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517289    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-run-multus-certs\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517344    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-multus-socket-dir-parent\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517385    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-sys-fs\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.517416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33d147f1-c408-4f83-8a62-85daa68efe74-agent-certs\") pod \"konnectivity-agent-jw6lc\" (UID: \"33d147f1-c408-4f83-8a62-85daa68efe74\") " pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517422    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2918f9ef-71c5-4062-8256-0298b6c0ee39-hosts-file\") pod \"node-resolver-7rzt9\" (UID: \"2918f9ef-71c5-4062-8256-0298b6c0ee39\") " pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517438    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-multus-conf-dir\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517462    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517477    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-multus-socket-dir-parent\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517479    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-multus-cni-dir\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517523    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-multus-cni-dir\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517527    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-var-lib-cni-bin\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517555    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-var-lib-cni-multus\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2spx\" (UniqueName: \"kubernetes.io/projected/67f0be98-a4eb-41c6-8886-231d1c4f5263-kube-api-access-f2spx\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517591    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-var-lib-cni-multus\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517607    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7zmf\" (UniqueName: \"kubernetes.io/projected/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-kube-api-access-x7zmf\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517624    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-multus-conf-dir\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517629    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8389da71-7435-4fe7-8ef9-698d0f2486c7-kubelet-config\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517649    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33d147f1-c408-4f83-8a62-85daa68efe74-konnectivity-ca\") pod \"konnectivity-agent-jw6lc\" (UID: \"33d147f1-c408-4f83-8a62-85daa68efe74\") " pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517664    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-sys-fs\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.517675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517677    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/896892f0-5293-4476-9a21-57fdab876af2-cni-binary-copy\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517822    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/896892f0-5293-4476-9a21-57fdab876af2-multus-daemon-config\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517867    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-var-lib-cni-bin\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517894    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8389da71-7435-4fe7-8ef9-698d0f2486c7-kubelet-config\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.517934    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-system-cni-dir\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518001    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2918f9ef-71c5-4062-8256-0298b6c0ee39-hosts-file\") pod \"node-resolver-7rzt9\" (UID: \"2918f9ef-71c5-4062-8256-0298b6c0ee39\") " pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518184    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8389da71-7435-4fe7-8ef9-698d0f2486c7-dbus\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518223    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-var-lib-kubelet\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518273    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2918f9ef-71c5-4062-8256-0298b6c0ee39-tmp-dir\") pod \"node-resolver-7rzt9\" (UID: \"2918f9ef-71c5-4062-8256-0298b6c0ee39\") " pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518281    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-var-lib-kubelet\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518314    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-socket-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518340    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-etc-kubernetes\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518366    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:43.518391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518372    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33d147f1-c408-4f83-8a62-85daa68efe74-konnectivity-ca\") pod \"konnectivity-agent-jw6lc\" (UID: \"33d147f1-c408-4f83-8a62-85daa68efe74\") " pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518391    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-registration-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518435    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-etc-kubernetes\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518443    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518446    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8389da71-7435-4fe7-8ef9-698d0f2486c7-dbus\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518481    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-hostroot\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518509    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-device-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.518529    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518535    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-run-netns\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518550    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-socket-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518567    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518601    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-device-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.518623    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret podName:8389da71-7435-4fe7-8ef9-698d0f2486c7 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:44.018580943 +0000 UTC m=+3.075118067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret") pod "global-pull-secret-syncer-hh7dn" (UID: "8389da71-7435-4fe7-8ef9-698d0f2486c7") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518623    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2918f9ef-71c5-4062-8256-0298b6c0ee39-tmp-dir\") pod \"node-resolver-7rzt9\" (UID: \"2918f9ef-71c5-4062-8256-0298b6c0ee39\") " pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518634    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-hostroot\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518643    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-cnibin\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518673    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-run-k8s-cni-cncf-io\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.518946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518676    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/896892f0-5293-4476-9a21-57fdab876af2-cni-binary-copy\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518700    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518684    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518720    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-registration-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.518726    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518675    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-run-netns\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518732    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wtzm\" (UniqueName: \"kubernetes.io/projected/2918f9ef-71c5-4062-8256-0298b6c0ee39-kube-api-access-5wtzm\") pod \"node-resolver-7rzt9\" (UID: \"2918f9ef-71c5-4062-8256-0298b6c0ee39\") " pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518760    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-host-run-k8s-cni-cncf-io\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.518798    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs podName:67f0be98-a4eb-41c6-8886-231d1c4f5263 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:44.018780096 +0000 UTC m=+3.075317231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs") pod "network-metrics-daemon-fqfwz" (UID: "67f0be98-a4eb-41c6-8886-231d1c4f5263") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518810    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/896892f0-5293-4476-9a21-57fdab876af2-cnibin\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.519623 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.518833    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.520902 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.520880    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33d147f1-c408-4f83-8a62-85daa68efe74-agent-certs\") pod \"konnectivity-agent-jw6lc\" (UID: \"33d147f1-c408-4f83-8a62-85daa68efe74\") " pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:40:43.528571 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.528506    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:40:43.528571 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.528537    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:40:43.528571 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.528552    2555 projected.go:196] Error preparing data for projected volume kube-api-access-l9lxz for pod openshift-network-diagnostics/network-check-target-t8ztn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:43.528811 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:43.528621    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz podName:b0e51598-ae97-4892-8111-8a845c7b998f nodeName:}" failed. No retries permitted until 2026-09-09 20:40:44.028603493 +0000 UTC m=+3.085140630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l9lxz" (UniqueName: "kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz") pod "network-check-target-t8ztn" (UID: "b0e51598-ae97-4892-8111-8a845c7b998f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:43.530366 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.530340    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2spx\" (UniqueName: \"kubernetes.io/projected/67f0be98-a4eb-41c6-8886-231d1c4f5263-kube-api-access-f2spx\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:43.531149 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.531121    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7zmf\" (UniqueName: \"kubernetes.io/projected/d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb-kube-api-access-x7zmf\") pod \"aws-ebs-csi-driver-node-8gxph\" (UID: \"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.531810 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.531788    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvwkh\" (UniqueName: \"kubernetes.io/projected/896892f0-5293-4476-9a21-57fdab876af2-kube-api-access-bvwkh\") pod \"multus-98bmz\" (UID: \"896892f0-5293-4476-9a21-57fdab876af2\") " pod="openshift-multus/multus-98bmz"
Sep 09 20:40:43.532817 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.532792    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wtzm\" (UniqueName: \"kubernetes.io/projected/2918f9ef-71c5-4062-8256-0298b6c0ee39-kube-api-access-5wtzm\") pod \"node-resolver-7rzt9\" (UID: \"2918f9ef-71c5-4062-8256-0298b6c0ee39\") " pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.604736 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.604651    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vn55g"
Sep 09 20:40:43.613798 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.613760    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f97qg"
Sep 09 20:40:43.625176 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.625150    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:40:43.633016 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.632996    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v5gnk"
Sep 09 20:40:43.639669 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.639647    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52qg8"
Sep 09 20:40:43.646571 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.646548    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph"
Sep 09 20:40:43.653383 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.653362    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:40:43.661016 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.660998    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7rzt9"
Sep 09 20:40:43.666053 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:43.666030    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-98bmz"
Sep 09 20:40:44.023036 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.022814    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:44.023224 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.023050    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:44.023224 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.022994    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:44.023224 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.023186    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs podName:67f0be98-a4eb-41c6-8886-231d1c4f5263 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:45.023162474 +0000 UTC m=+4.079699612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs") pod "network-metrics-daemon-fqfwz" (UID: "67f0be98-a4eb-41c6-8886-231d1c4f5263") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:44.023224 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.023201    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:44.023456 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.023251    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret podName:8389da71-7435-4fe7-8ef9-698d0f2486c7 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:45.023233208 +0000 UTC m=+4.079770344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret") pod "global-pull-secret-syncer-hh7dn" (UID: "8389da71-7435-4fe7-8ef9-698d0f2486c7") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:44.123828 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.123793    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:44.124036 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.123924    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:40:44.124036 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.123960    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:40:44.124036 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.123969    2555 projected.go:196] Error preparing data for projected volume kube-api-access-l9lxz for pod openshift-network-diagnostics/network-check-target-t8ztn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:44.124036 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.124028    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz podName:b0e51598-ae97-4892-8111-8a845c7b998f nodeName:}" failed. No retries permitted until 2026-09-09 20:40:45.124013539 +0000 UTC m=+4.180550810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9lxz" (UniqueName: "kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz") pod "network-check-target-t8ztn" (UID: "b0e51598-ae97-4892-8111-8a845c7b998f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:44.354499 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.354449    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:35:43 +0000 UTC" deadline="2028-02-12 16:42:05.366005703 +0000 UTC"
Sep 09 20:40:44.354499 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.354484    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12500h1m21.011526135s"
Sep 09 20:40:44.415426 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:44.415392    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1de80a2_8f79_4413_87bc_9499b5dce533.slice/crio-31b04569c0504774595a7faf9d794702250f7941e155daead20776c1a2773354 WatchSource:0}: Error finding container 31b04569c0504774595a7faf9d794702250f7941e155daead20776c1a2773354: Status 404 returned error can't find the container with id 31b04569c0504774595a7faf9d794702250f7941e155daead20776c1a2773354
Sep 09 20:40:44.416786 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:44.416752    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2918f9ef_71c5_4062_8256_0298b6c0ee39.slice/crio-a4fd7663e940c284bf7acb50762d1789cf4c9f698ab3fbd646f6860515caf3a6 WatchSource:0}: Error finding container a4fd7663e940c284bf7acb50762d1789cf4c9f698ab3fbd646f6860515caf3a6: Status 404 returned error can't find the container with id a4fd7663e940c284bf7acb50762d1789cf4c9f698ab3fbd646f6860515caf3a6
Sep 09 20:40:44.417704 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:44.417675    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73390ba_54dd_48f0_8c27_f201e82a8974.slice/crio-fab85476bc8703cd06d00523a670ce51c237bab7acd53b12e2afe351cf9de6c5 WatchSource:0}: Error finding container fab85476bc8703cd06d00523a670ce51c237bab7acd53b12e2afe351cf9de6c5: Status 404 returned error can't find the container with id fab85476bc8703cd06d00523a670ce51c237bab7acd53b12e2afe351cf9de6c5
Sep 09 20:40:44.419756 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:44.419072    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71c9ecd_fb9d_47f2_9c6c_d24f73260bdb.slice/crio-feb8b6ea15e5b97235d67012fbfe4eb3bdb5e51314f99d0c32ea04226bbaefb6 WatchSource:0}: Error finding container feb8b6ea15e5b97235d67012fbfe4eb3bdb5e51314f99d0c32ea04226bbaefb6: Status 404 returned error can't find the container with id feb8b6ea15e5b97235d67012fbfe4eb3bdb5e51314f99d0c32ea04226bbaefb6
Sep 09 20:40:44.419756 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:44.419556    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d147f1_c408_4f83_8a62_85daa68efe74.slice/crio-be0ecc7a0eecb5c69b21e4ce25d5deaf510f4fc6c7e6f10ebcd999878c4e3a09 WatchSource:0}: Error finding container be0ecc7a0eecb5c69b21e4ce25d5deaf510f4fc6c7e6f10ebcd999878c4e3a09: Status 404 returned error can't find the container with id be0ecc7a0eecb5c69b21e4ce25d5deaf510f4fc6c7e6f10ebcd999878c4e3a09
Sep 09 20:40:44.421365 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:44.420937    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896892f0_5293_4476_9a21_57fdab876af2.slice/crio-8f3a89ddfdc474e656672c766d33b573310b7db641040a078625fc9eee5cf3c1 WatchSource:0}: Error finding container 8f3a89ddfdc474e656672c766d33b573310b7db641040a078625fc9eee5cf3c1: Status 404 returned error can't find the container with id 8f3a89ddfdc474e656672c766d33b573310b7db641040a078625fc9eee5cf3c1
Sep 09 20:40:44.422751 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:44.422332    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231a1ab6_339b_4a16_942e_6de224b5e168.slice/crio-66054c71c7eb40eb5818f1947b08e746401336b2614d379600b67cafc4e9da56 WatchSource:0}: Error finding container 66054c71c7eb40eb5818f1947b08e746401336b2614d379600b67cafc4e9da56: Status 404 returned error can't find the container with id 66054c71c7eb40eb5818f1947b08e746401336b2614d379600b67cafc4e9da56
Sep 09 20:40:44.423421 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:44.423035    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34c436a_fb65_4ffb_9965_4ac57316f6fc.slice/crio-af702e7538a9a713d856e3040997e15c1b5bc1951092431c470aaf105bd1db76 WatchSource:0}: Error finding container af702e7538a9a713d856e3040997e15c1b5bc1951092431c470aaf105bd1db76: Status 404 returned error can't find the container with id af702e7538a9a713d856e3040997e15c1b5bc1951092431c470aaf105bd1db76
Sep 09 20:40:44.424245 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.424224    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:44.424370 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.424348    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:40:44.424432 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.424384    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:44.424528 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:44.424504    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:40:44.425895 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:40:44.425873    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac5532c_a02c_44cc_9747_92bc07af2c66.slice/crio-a9096d00d13be9103f901dc7ca69c6c4b539c7022b08a35c8b23219ad42371a8 WatchSource:0}: Error finding container a9096d00d13be9103f901dc7ca69c6c4b539c7022b08a35c8b23219ad42371a8: Status 404 returned error can't find the container with id a9096d00d13be9103f901dc7ca69c6c4b539c7022b08a35c8b23219ad42371a8
Sep 09 20:40:44.436160 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.436092    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v5gnk" event={"ID":"aac5532c-a02c-44cc-9747-92bc07af2c66","Type":"ContainerStarted","Data":"a9096d00d13be9103f901dc7ca69c6c4b539c7022b08a35c8b23219ad42371a8"}
Sep 09 20:40:44.437550 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.437519    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52qg8" event={"ID":"d34c436a-fb65-4ffb-9965-4ac57316f6fc","Type":"ContainerStarted","Data":"af702e7538a9a713d856e3040997e15c1b5bc1951092431c470aaf105bd1db76"}
Sep 09 20:40:44.439222 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.439200    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" event={"ID":"231a1ab6-339b-4a16-942e-6de224b5e168","Type":"ContainerStarted","Data":"66054c71c7eb40eb5818f1947b08e746401336b2614d379600b67cafc4e9da56"}
Sep 09 20:40:44.440649 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.440613    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph" event={"ID":"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb","Type":"ContainerStarted","Data":"feb8b6ea15e5b97235d67012fbfe4eb3bdb5e51314f99d0c32ea04226bbaefb6"}
Sep 09 20:40:44.442229 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.442204    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f97qg" event={"ID":"d73390ba-54dd-48f0-8c27-f201e82a8974","Type":"ContainerStarted","Data":"fab85476bc8703cd06d00523a670ce51c237bab7acd53b12e2afe351cf9de6c5"}
Sep 09 20:40:44.443415 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.443392    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7rzt9" event={"ID":"2918f9ef-71c5-4062-8256-0298b6c0ee39","Type":"ContainerStarted","Data":"a4fd7663e940c284bf7acb50762d1789cf4c9f698ab3fbd646f6860515caf3a6"}
Sep 09 20:40:44.444675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.444652    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-98bmz" event={"ID":"896892f0-5293-4476-9a21-57fdab876af2","Type":"ContainerStarted","Data":"8f3a89ddfdc474e656672c766d33b573310b7db641040a078625fc9eee5cf3c1"}
Sep 09 20:40:44.445925 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.445900    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jw6lc" event={"ID":"33d147f1-c408-4f83-8a62-85daa68efe74","Type":"ContainerStarted","Data":"be0ecc7a0eecb5c69b21e4ce25d5deaf510f4fc6c7e6f10ebcd999878c4e3a09"}
Sep 09 20:40:44.447150 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:44.447127    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn55g" event={"ID":"d1de80a2-8f79-4413-87bc-9499b5dce533","Type":"ContainerStarted","Data":"31b04569c0504774595a7faf9d794702250f7941e155daead20776c1a2773354"}
Sep 09 20:40:45.029391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.029300    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:45.029391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.029363    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:45.029612 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:45.029494    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:45.029612 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:45.029564    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret podName:8389da71-7435-4fe7-8ef9-698d0f2486c7 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:47.029544034 +0000 UTC m=+6.086081171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret") pod "global-pull-secret-syncer-hh7dn" (UID: "8389da71-7435-4fe7-8ef9-698d0f2486c7") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:45.030389 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:45.030362    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:45.030496 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:45.030434    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs podName:67f0be98-a4eb-41c6-8886-231d1c4f5263 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:47.030415927 +0000 UTC m=+6.086953066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs") pod "network-metrics-daemon-fqfwz" (UID: "67f0be98-a4eb-41c6-8886-231d1c4f5263") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:45.130184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.130133    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:45.130398 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:45.130315    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:40:45.130398 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:45.130335    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:40:45.130398 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:45.130349    2555 projected.go:196] Error preparing data for projected volume kube-api-access-l9lxz for pod openshift-network-diagnostics/network-check-target-t8ztn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:45.130564 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:45.130411    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz podName:b0e51598-ae97-4892-8111-8a845c7b998f nodeName:}" failed. No retries permitted until 2026-09-09 20:40:47.130391651 +0000 UTC m=+6.186928774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9lxz" (UniqueName: "kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz") pod "network-check-target-t8ztn" (UID: "b0e51598-ae97-4892-8111-8a845c7b998f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:45.354948 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.354867    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:35:43 +0000 UTC" deadline="2028-04-02 10:10:35.220481812 +0000 UTC"
Sep 09 20:40:45.354948 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.354945    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13693h29m49.865541315s"
Sep 09 20:40:45.427676 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.427144    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:45.427676 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:45.427277    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:40:45.472882 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.472841    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal" event={"ID":"ca53e03ff182c14b08d53f7da0d644e0","Type":"ContainerStarted","Data":"e5462d654134a3754d3baa0f2263bdf1c840708979082c6554f46ea5f32ec17f"}
Sep 09 20:40:45.484677 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.484567    2555 generic.go:356] "Generic (PLEG): container finished" podID="e260fc8595ceffeccd15b0b3453e3629" containerID="785d6c2ee3af5de470a93c6f07c93492ef86a272c56fe8b943da41e87f8a82ac" exitCode=0
Sep 09 20:40:45.484677 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.484617    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal" event={"ID":"e260fc8595ceffeccd15b0b3453e3629","Type":"ContainerDied","Data":"785d6c2ee3af5de470a93c6f07c93492ef86a272c56fe8b943da41e87f8a82ac"}
Sep 09 20:40:45.506216 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:45.505864    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-158.ec2.internal" podStartSLOduration=3.505844642 podStartE2EDuration="3.505844642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:40:45.490257657 +0000 UTC m=+4.546794802" watchObservedRunningTime="2026-09-09 20:40:45.505844642 +0000 UTC m=+4.562381788"
Sep 09 20:40:46.424658 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:46.424595    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:46.425130 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:46.424723    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:40:46.425130 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:46.425105    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:46.425237 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:46.425217    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:40:46.500620 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:46.500584    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal" event={"ID":"e260fc8595ceffeccd15b0b3453e3629","Type":"ContainerStarted","Data":"990927161b8fe9ac0527e8caa27740837911ffc8eebc9961657b6868ccc440e2"}
Sep 09 20:40:47.050243 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:47.050201    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:47.050424 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:47.050258    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:47.050483 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:47.050440    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:47.050536 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:47.050504    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret podName:8389da71-7435-4fe7-8ef9-698d0f2486c7 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:51.0504876 +0000 UTC m=+10.107024723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret") pod "global-pull-secret-syncer-hh7dn" (UID: "8389da71-7435-4fe7-8ef9-698d0f2486c7") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:47.050931 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:47.050892    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:47.051025 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:47.050969    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs podName:67f0be98-a4eb-41c6-8886-231d1c4f5263 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:51.050952252 +0000 UTC m=+10.107489387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs") pod "network-metrics-daemon-fqfwz" (UID: "67f0be98-a4eb-41c6-8886-231d1c4f5263") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:47.151194 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:47.151156    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:47.151385 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:47.151353    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:40:47.151385 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:47.151379    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:40:47.151520 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:47.151393    2555 projected.go:196] Error preparing data for projected volume kube-api-access-l9lxz for pod openshift-network-diagnostics/network-check-target-t8ztn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:47.151520 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:47.151492    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz podName:b0e51598-ae97-4892-8111-8a845c7b998f nodeName:}" failed. No retries permitted until 2026-09-09 20:40:51.151470761 +0000 UTC m=+10.208007900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9lxz" (UniqueName: "kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz") pod "network-check-target-t8ztn" (UID: "b0e51598-ae97-4892-8111-8a845c7b998f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:47.427090 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:47.427014    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:47.427513 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:47.427142    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:40:48.424367 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:48.424329    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:48.424554 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:48.424474    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:40:48.424919 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:48.424881    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:48.425011 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:48.424990    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:40:49.424585 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:49.424553    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:49.424952 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:49.424702    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:40:50.424803 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:50.424767    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:50.425208 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:50.424872    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:40:50.425421 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:50.425257    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:50.425421 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:50.425358    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:40:51.084941 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:51.084880    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:51.084941 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:51.084939    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:51.085135 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:51.085069    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:51.085135 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:51.085118    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret podName:8389da71-7435-4fe7-8ef9-698d0f2486c7 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:59.085105363 +0000 UTC m=+18.141642483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret") pod "global-pull-secret-syncer-hh7dn" (UID: "8389da71-7435-4fe7-8ef9-698d0f2486c7") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:51.085495 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:51.085470    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:51.085600 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:51.085544    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs podName:67f0be98-a4eb-41c6-8886-231d1c4f5263 nodeName:}" failed. No retries permitted until 2026-09-09 20:40:59.085525827 +0000 UTC m=+18.142062967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs") pod "network-metrics-daemon-fqfwz" (UID: "67f0be98-a4eb-41c6-8886-231d1c4f5263") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:51.185447 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:51.185417    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:51.185610 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:51.185593    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:40:51.185653 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:51.185614    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:40:51.185653 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:51.185627    2555 projected.go:196] Error preparing data for projected volume kube-api-access-l9lxz for pod openshift-network-diagnostics/network-check-target-t8ztn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:51.185713 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:51.185681    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz podName:b0e51598-ae97-4892-8111-8a845c7b998f nodeName:}" failed. No retries permitted until 2026-09-09 20:40:59.185663469 +0000 UTC m=+18.242200604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9lxz" (UniqueName: "kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz") pod "network-check-target-t8ztn" (UID: "b0e51598-ae97-4892-8111-8a845c7b998f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:51.426207 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:51.425934    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:51.426614 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:51.426270    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:40:52.425136 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:52.425098    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:52.425310 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:52.425209    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:40:52.425594 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:52.425567    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:52.425687 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:52.425663    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:40:53.424808 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:53.424774    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:53.425292 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:53.424896    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:40:54.424598 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:54.424561    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:54.424598 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:54.424588    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:54.424831 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:54.424704    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:40:54.425150 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:54.424822    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:40:55.428004 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:55.427979    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:55.428428 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:55.428074    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:40:56.424519 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:56.424473    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:56.424715 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:56.424617    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:40:56.425471 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:56.425045    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:56.425471 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:56.425134    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:40:57.424889 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:57.424854    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:57.425355 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:57.424996    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:40:58.424712 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:58.424678    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:58.424932 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:58.424691    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:58.424932 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:58.424804    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:40:58.424932 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:58.424918    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:40:59.143137 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:59.143101    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:40:59.143137 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:59.143139    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:59.143370 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:59.143262    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:59.143370 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:59.143262    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:59.143370 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:59.143327    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs podName:67f0be98-a4eb-41c6-8886-231d1c4f5263 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:15.143310991 +0000 UTC m=+34.199848133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs") pod "network-metrics-daemon-fqfwz" (UID: "67f0be98-a4eb-41c6-8886-231d1c4f5263") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:40:59.143370 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:59.143347    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret podName:8389da71-7435-4fe7-8ef9-698d0f2486c7 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:15.14333656 +0000 UTC m=+34.199873694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret") pod "global-pull-secret-syncer-hh7dn" (UID: "8389da71-7435-4fe7-8ef9-698d0f2486c7") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:40:59.244379 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:59.244344    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:40:59.244565 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:59.244545    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:40:59.244641 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:59.244573    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:40:59.244641 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:59.244586    2555 projected.go:196] Error preparing data for projected volume kube-api-access-l9lxz for pod openshift-network-diagnostics/network-check-target-t8ztn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:59.244734 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:59.244653    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz podName:b0e51598-ae97-4892-8111-8a845c7b998f nodeName:}" failed. No retries permitted until 2026-09-09 20:41:15.24463458 +0000 UTC m=+34.301171714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9lxz" (UniqueName: "kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz") pod "network-check-target-t8ztn" (UID: "b0e51598-ae97-4892-8111-8a845c7b998f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:40:59.424510 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:40:59.424430    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:40:59.424662 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:40:59.424571    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:41:00.424745 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:00.424711    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:00.425203 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:00.424711    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:00.425203 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:00.424832    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:41:00.425203 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:00.424953    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:41:01.425949 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:01.425888    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:01.426391 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:01.426020    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:41:02.425105 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:02.425079    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:02.425238 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:02.425205    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:41:02.425513 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:02.425489    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:02.425604 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:02.425584    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:41:02.551851 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:02.551722    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jw6lc" event={"ID":"33d147f1-c408-4f83-8a62-85daa68efe74","Type":"ContainerStarted","Data":"8bf81fb0975e9ccb70e3f37b8fa3883beae115d8213d2f3b7201438cac5ec883"}
Sep 09 20:41:02.569350 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:02.568113    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jw6lc" podStartSLOduration=3.936110565 podStartE2EDuration="21.568091523s" totalImagesPullingTime="17.631980958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:02.567465809 +0000 UTC m=+21.624002953" watchObservedRunningTime="2026-09-09 20:41:02.568091523 +0000 UTC m=+21.624628666"
Sep 09 20:41:02.569350 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:02.568398    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-158.ec2.internal" podStartSLOduration=20.568385193 podStartE2EDuration="20.568385193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:40:46.517455118 +0000 UTC m=+5.573992261" watchObservedRunningTime="2026-09-09 20:41:02.568385193 +0000 UTC m=+21.624922341"
Sep 09 20:41:03.424362 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.424186    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:03.424546 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:03.424434    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:41:03.557141 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.557106    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" event={"ID":"231a1ab6-339b-4a16-942e-6de224b5e168","Type":"ContainerStarted","Data":"45c5034da36e39af424e10180d4685572b265e3279195563b36f3cd9b8d0974c"}
Sep 09 20:41:03.558040 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.557202    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" event={"ID":"231a1ab6-339b-4a16-942e-6de224b5e168","Type":"ContainerStarted","Data":"5d578d90d3a3189d227cf298164ee1e7c6ce8f4eead14c9a8e5494d9de5b1970"}
Sep 09 20:41:03.558040 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.557235    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" event={"ID":"231a1ab6-339b-4a16-942e-6de224b5e168","Type":"ContainerStarted","Data":"74b7f5e6c5b69f07016fbc5d2a6a53b7d64fb80d449e5d3f2ca0cc9bda5c0b94"}
Sep 09 20:41:03.558040 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.557270    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" event={"ID":"231a1ab6-339b-4a16-942e-6de224b5e168","Type":"ContainerStarted","Data":"d71cb1e62ca61b216fb1175211067b3985991ef106795458c8d5ba9f2f470766"}
Sep 09 20:41:03.558040 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.557316    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" event={"ID":"231a1ab6-339b-4a16-942e-6de224b5e168","Type":"ContainerStarted","Data":"907653c022056e721b367b1e068f02cb2a2c2326e0546d180a38363584db9abf"}
Sep 09 20:41:03.558040 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.557363    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" event={"ID":"231a1ab6-339b-4a16-942e-6de224b5e168","Type":"ContainerStarted","Data":"21ead68137bbfed53c31a9a6a384aa0fe9d2d7212f80e73e73ab4c596f813437"}
Sep 09 20:41:03.558652 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.558627    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph" event={"ID":"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb","Type":"ContainerStarted","Data":"0d17776c7525700f95cd56b5cdd57ca26a2c12654599354c101b9ae24240a3d8"}
Sep 09 20:41:03.560008 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.559966    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7rzt9" event={"ID":"2918f9ef-71c5-4062-8256-0298b6c0ee39","Type":"ContainerStarted","Data":"732adf04ed7afa96d0e07ec8c0c1ad668fad4d5211ca743182d9bd8846ceeed9"}
Sep 09 20:41:03.561402 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.561377    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-98bmz" event={"ID":"896892f0-5293-4476-9a21-57fdab876af2","Type":"ContainerStarted","Data":"4e1fed2c63899803d946f4311c06664b41e05c40b31ad6d00b3c6a0cf205e3b9"}
Sep 09 20:41:03.562819 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.562798    2555 generic.go:356] "Generic (PLEG): container finished" podID="d1de80a2-8f79-4413-87bc-9499b5dce533" containerID="2cbb6b7730af708d90bc316f758e197bb5978fe07f21bf9bb9461d4d141b97e6" exitCode=0
Sep 09 20:41:03.562930 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.562862    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn55g" event={"ID":"d1de80a2-8f79-4413-87bc-9499b5dce533","Type":"ContainerDied","Data":"2cbb6b7730af708d90bc316f758e197bb5978fe07f21bf9bb9461d4d141b97e6"}
Sep 09 20:41:03.564406 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.564382    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v5gnk" event={"ID":"aac5532c-a02c-44cc-9747-92bc07af2c66","Type":"ContainerStarted","Data":"a45ebed09973e28dc056b215a6211e9846c8678f345fff5657f1e36d048ffb7f"}
Sep 09 20:41:03.565951 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.565927    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52qg8" event={"ID":"d34c436a-fb65-4ffb-9965-4ac57316f6fc","Type":"ContainerStarted","Data":"90380f802bab715c704c77a49dda6a16b4f914d6841af07f5e515c6e3afe9fc7"}
Sep 09 20:41:03.575487 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.575440    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7rzt9" podStartSLOduration=4.638541651 podStartE2EDuration="22.575424795s" totalImagesPullingTime="17.936883144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:03.574988947 +0000 UTC m=+22.631526090" watchObservedRunningTime="2026-09-09 20:41:03.575424795 +0000 UTC m=+22.631961939"
Sep 09 20:41:03.591542 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.591503    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v5gnk" podStartSLOduration=4.652401354 podStartE2EDuration="22.591491893s" totalImagesPullingTime="17.939090539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:03.59110946 +0000 UTC m=+22.647646603" watchObservedRunningTime="2026-09-09 20:41:03.591491893 +0000 UTC m=+22.648029038"
Sep 09 20:41:03.608811 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.608772    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-98bmz" podStartSLOduration=4.621011812 podStartE2EDuration="22.608759956s" totalImagesPullingTime="17.987748144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:03.608586614 +0000 UTC m=+22.665123766" watchObservedRunningTime="2026-09-09 20:41:03.608759956 +0000 UTC m=+22.665297098"
Sep 09 20:41:03.640810 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.640764    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-52qg8" podStartSLOduration=4.711810969 podStartE2EDuration="22.640751716s" totalImagesPullingTime="17.928940747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:03.640405816 +0000 UTC m=+22.696942958" watchObservedRunningTime="2026-09-09 20:41:03.640751716 +0000 UTC m=+22.697288858"
Sep 09 20:41:03.813863 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:03.813839    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 20:41:04.365665 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.365372    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T20:41:03.813859442Z","UUID":"5b05136d-1b93-48f2-86ff-5d24eeba8619","Handler":null,"Name":"","Endpoint":""}
Sep 09 20:41:04.367035 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.367011    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 20:41:04.367187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.367047    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 20:41:04.425253 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.425218    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:04.425253 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.425250    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:04.425470 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:04.425349    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:41:04.425517 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:04.425475    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:41:04.463225 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.463190    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:41:04.463847 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.463827    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:41:04.571578 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.571542    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph" event={"ID":"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb","Type":"ContainerStarted","Data":"294d9028eadfd374cc48d7274ee13630553c4fbb09210eb2ad693f7019faea1c"}
Sep 09 20:41:04.573505 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.573435    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f97qg" event={"ID":"d73390ba-54dd-48f0-8c27-f201e82a8974","Type":"ContainerStarted","Data":"fca6a9013aa6c63f99a1b0d73db645a3372874b3a6b97de2328a66ba0389929d"}
Sep 09 20:41:04.588026 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:04.587983    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f97qg" podStartSLOduration=5.64769718 podStartE2EDuration="23.587964956s" totalImagesPullingTime="17.940267776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:04.58767724 +0000 UTC m=+23.644214426" watchObservedRunningTime="2026-09-09 20:41:04.587964956 +0000 UTC m=+23.644502122"
Sep 09 20:41:05.424834 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:05.424794    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:05.425029 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:05.424943    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:41:05.579802 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:05.579758    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" event={"ID":"231a1ab6-339b-4a16-942e-6de224b5e168","Type":"ContainerStarted","Data":"983d9dda21506bb7a87858fec2ba02831ab7eba2443b61a03bf172d3fb404aa7"}
Sep 09 20:41:05.582178 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:05.582153    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 20:41:05.582178 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:05.582164    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph" event={"ID":"d71c9ecd-fb9d-47f2-9c6c-d24f73260bdb","Type":"ContainerStarted","Data":"d4d53eaf9a1a6d1254c0ae2f428e7b6b2c68b081c946a46e108c85fe09b8f08b"}
Sep 09 20:41:05.605628 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:05.605580    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gxph" podStartSLOduration=4.2979397630000005 podStartE2EDuration="24.605562938s" totalImagesPullingTime="20.307623175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:05.604406142 +0000 UTC m=+24.660943283" watchObservedRunningTime="2026-09-09 20:41:05.605562938 +0000 UTC m=+24.662100081"
Sep 09 20:41:06.425202 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:06.425172    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:06.425372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:06.425208    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:06.425372 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:06.425285    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:41:06.425451 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:06.425408    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:41:07.425247 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:07.425160    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:07.425624 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:07.425292    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:41:08.425339 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.425105    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:08.425716 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.425154    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:08.425716 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:08.425357    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:41:08.425716 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:08.425457    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:41:08.592983 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.592942    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" event={"ID":"231a1ab6-339b-4a16-942e-6de224b5e168","Type":"ContainerStarted","Data":"2be591780b78371f592b1286d589406b8f53731432a37de3015358d089b890b1"}
Sep 09 20:41:08.593275 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.593228    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:41:08.593430 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.593312    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:41:08.593430 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.593365    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:41:08.595234 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.595210    2555 generic.go:356] "Generic (PLEG): container finished" podID="d1de80a2-8f79-4413-87bc-9499b5dce533" containerID="b779597cf552c860874c6a5abb285bfd886478576578ef282f8cb8caf06d2f04" exitCode=0
Sep 09 20:41:08.595340 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.595246    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn55g" event={"ID":"d1de80a2-8f79-4413-87bc-9499b5dce533","Type":"ContainerDied","Data":"b779597cf552c860874c6a5abb285bfd886478576578ef282f8cb8caf06d2f04"}
Sep 09 20:41:08.609161 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.609129    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:41:08.615982 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.614539    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:41:08.618790 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:08.618745    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t" podStartSLOduration=9.632805683 podStartE2EDuration="27.61873297s" totalImagesPullingTime="17.985927287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:08.618303064 +0000 UTC m=+27.674840221" watchObservedRunningTime="2026-09-09 20:41:08.61873297 +0000 UTC m=+27.675270111"
Sep 09 20:41:09.424999 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:09.424970    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:09.425155 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:09.425082    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:41:09.723225 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:09.723138    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t8ztn"]
Sep 09 20:41:09.723974 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:09.723258    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:09.723974 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:09.723341    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:41:09.728648 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:09.728624    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hh7dn"]
Sep 09 20:41:09.728764 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:09.728726    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:09.728861 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:09.728830    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:41:09.729485 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:09.729273    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fqfwz"]
Sep 09 20:41:09.729485 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:09.729374    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:09.729653 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:09.729488    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:41:10.601749 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:10.601717    2555 generic.go:356] "Generic (PLEG): container finished" podID="d1de80a2-8f79-4413-87bc-9499b5dce533" containerID="475b0d5fe760f1ddcdb55b6aa5c93b344d999cc38d327e4ccd519402cd1e9e5a" exitCode=0
Sep 09 20:41:10.601934 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:10.601800    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn55g" event={"ID":"d1de80a2-8f79-4413-87bc-9499b5dce533","Type":"ContainerDied","Data":"475b0d5fe760f1ddcdb55b6aa5c93b344d999cc38d327e4ccd519402cd1e9e5a"}
Sep 09 20:41:11.425498 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:11.425459    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:11.425983 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:11.425577    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:11.425983 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:11.425589    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:11.425983 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:11.425586    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:41:11.425983 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:11.425685    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:41:11.425983 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:11.425784    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:41:11.459758 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:11.459729    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:41:11.459888 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:11.459879    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 20:41:11.460615 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:11.460590    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jw6lc"
Sep 09 20:41:11.606365 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:11.606203    2555 generic.go:356] "Generic (PLEG): container finished" podID="d1de80a2-8f79-4413-87bc-9499b5dce533" containerID="8bde61db89b60093b55a674a856cd000150e074961b9145c202b75ca6f7e7cbd" exitCode=0
Sep 09 20:41:11.606499 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:11.606279    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn55g" event={"ID":"d1de80a2-8f79-4413-87bc-9499b5dce533","Type":"ContainerDied","Data":"8bde61db89b60093b55a674a856cd000150e074961b9145c202b75ca6f7e7cbd"}
Sep 09 20:41:13.424255 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:13.424222    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:13.424678 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:13.424219    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:13.424678 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:13.424342    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t8ztn" podUID="b0e51598-ae97-4892-8111-8a845c7b998f"
Sep 09 20:41:13.424678 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:13.424375    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:13.424678 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:13.424473    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hh7dn" podUID="8389da71-7435-4fe7-8ef9-698d0f2486c7"
Sep 09 20:41:13.424678 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:13.424563    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fqfwz" podUID="67f0be98-a4eb-41c6-8886-231d1c4f5263"
Sep 09 20:41:15.160597 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.160498    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:15.160597 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.160551    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:15.161278 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.160656    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:41:15.161278 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.160674    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:41:15.161278 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.160729    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs podName:67f0be98-a4eb-41c6-8886-231d1c4f5263 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:47.160708033 +0000 UTC m=+66.217245170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs") pod "network-metrics-daemon-fqfwz" (UID: "67f0be98-a4eb-41c6-8886-231d1c4f5263") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:41:15.161278 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.160750    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret podName:8389da71-7435-4fe7-8ef9-698d0f2486c7 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:47.160740254 +0000 UTC m=+66.217277380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret") pod "global-pull-secret-syncer-hh7dn" (UID: "8389da71-7435-4fe7-8ef9-698d0f2486c7") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:41:15.161488 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.161425    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-158.ec2.internal" event="NodeReady"
Sep 09 20:41:15.161564 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.161554    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 20:41:15.204582 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.204544    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rnztl"]
Sep 09 20:41:15.225130 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.225100    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lm7hp"]
Sep 09 20:41:15.225308 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.225243    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.228523 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.228307    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 20:41:15.229370 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.229195    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 20:41:15.229370 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.229274    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vs5mb\""
Sep 09 20:41:15.235444 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.235422    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rnztl"]
Sep 09 20:41:15.235565 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.235467    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lm7hp"]
Sep 09 20:41:15.235628 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.235566    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lm7hp"
Sep 09 20:41:15.238314 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.238295    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 20:41:15.238529 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.238510    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 20:41:15.238722 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.238705    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 20:41:15.238963 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.238942    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-87t46\""
Sep 09 20:41:15.261071 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.261038    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:15.261279 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.261261    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:41:15.261364 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.261287    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:41:15.261364 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.261300    2555 projected.go:196] Error preparing data for projected volume kube-api-access-l9lxz for pod openshift-network-diagnostics/network-check-target-t8ztn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:41:15.261364 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.261352    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz podName:b0e51598-ae97-4892-8111-8a845c7b998f nodeName:}" failed. No retries permitted until 2026-09-09 20:41:47.261339531 +0000 UTC m=+66.317876654 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9lxz" (UniqueName: "kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz") pod "network-check-target-t8ztn" (UID: "b0e51598-ae97-4892-8111-8a845c7b998f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:41:15.361974 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.361934    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76b01924-bfed-4f5a-bc20-211a744910f6-cert\") pod \"ingress-canary-lm7hp\" (UID: \"76b01924-bfed-4f5a-bc20-211a744910f6\") " pod="openshift-ingress-canary/ingress-canary-lm7hp"
Sep 09 20:41:15.362164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.361996    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e606789c-9c2a-441a-8652-fa003893a458-config-volume\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.362164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.362067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh99n\" (UniqueName: \"kubernetes.io/projected/e606789c-9c2a-441a-8652-fa003893a458-kube-api-access-vh99n\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.362164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.362157    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29w6g\" (UniqueName: \"kubernetes.io/projected/76b01924-bfed-4f5a-bc20-211a744910f6-kube-api-access-29w6g\") pod \"ingress-canary-lm7hp\" (UID: \"76b01924-bfed-4f5a-bc20-211a744910f6\") " pod="openshift-ingress-canary/ingress-canary-lm7hp"
Sep 09 20:41:15.362334 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.362187    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.362334 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.362236    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e606789c-9c2a-441a-8652-fa003893a458-tmp-dir\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.424462 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.424374    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:15.424462 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.424425    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:15.424679 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.424375    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:15.427703 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.427680    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q6qnd\""
Sep 09 20:41:15.428175 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.428152    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sl49q\""
Sep 09 20:41:15.428292 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.428213    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 20:41:15.428292 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.428241    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 20:41:15.428547 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.428524    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 20:41:15.428649 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.428532    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 20:41:15.463923 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.463607    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76b01924-bfed-4f5a-bc20-211a744910f6-cert\") pod \"ingress-canary-lm7hp\" (UID: \"76b01924-bfed-4f5a-bc20-211a744910f6\") " pod="openshift-ingress-canary/ingress-canary-lm7hp"
Sep 09 20:41:15.463923 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.463670    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e606789c-9c2a-441a-8652-fa003893a458-config-volume\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.463923 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.463707    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh99n\" (UniqueName: \"kubernetes.io/projected/e606789c-9c2a-441a-8652-fa003893a458-kube-api-access-vh99n\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.463923 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.463756    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29w6g\" (UniqueName: \"kubernetes.io/projected/76b01924-bfed-4f5a-bc20-211a744910f6-kube-api-access-29w6g\") pod \"ingress-canary-lm7hp\" (UID: \"76b01924-bfed-4f5a-bc20-211a744910f6\") " pod="openshift-ingress-canary/ingress-canary-lm7hp"
Sep 09 20:41:15.463923 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.463781    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.463923 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.463830    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e606789c-9c2a-441a-8652-fa003893a458-tmp-dir\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.464285 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.464192    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:41:15.464285 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.464259    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls podName:e606789c-9c2a-441a-8652-fa003893a458 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:15.964238179 +0000 UTC m=+35.020775317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls") pod "dns-default-rnztl" (UID: "e606789c-9c2a-441a-8652-fa003893a458") : secret "dns-default-metrics-tls" not found
Sep 09 20:41:15.464385 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.464319    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e606789c-9c2a-441a-8652-fa003893a458-config-volume\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.464661 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.464639    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e606789c-9c2a-441a-8652-fa003893a458-tmp-dir\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.468579 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.468550    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76b01924-bfed-4f5a-bc20-211a744910f6-cert\") pod \"ingress-canary-lm7hp\" (UID: \"76b01924-bfed-4f5a-bc20-211a744910f6\") " pod="openshift-ingress-canary/ingress-canary-lm7hp"
Sep 09 20:41:15.473081 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.473056    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh99n\" (UniqueName: \"kubernetes.io/projected/e606789c-9c2a-441a-8652-fa003893a458-kube-api-access-vh99n\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.473510 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.473463    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29w6g\" (UniqueName: \"kubernetes.io/projected/76b01924-bfed-4f5a-bc20-211a744910f6-kube-api-access-29w6g\") pod \"ingress-canary-lm7hp\" (UID: \"76b01924-bfed-4f5a-bc20-211a744910f6\") " pod="openshift-ingress-canary/ingress-canary-lm7hp"
Sep 09 20:41:15.546259 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.546219    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lm7hp"
Sep 09 20:41:15.967606 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:15.967570    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:15.967770 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.967694    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:41:15.967770 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:15.967747    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls podName:e606789c-9c2a-441a-8652-fa003893a458 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:16.967732043 +0000 UTC m=+36.024269163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls") pod "dns-default-rnztl" (UID: "e606789c-9c2a-441a-8652-fa003893a458") : secret "dns-default-metrics-tls" not found
Sep 09 20:41:16.086775 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:16.086685    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lm7hp"]
Sep 09 20:41:16.092503 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:16.092358    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b01924_bfed_4f5a_bc20_211a744910f6.slice/crio-d1feb80437574980646447beef6573f5c733b27fc7a822c9a2a1711d72920214 WatchSource:0}: Error finding container d1feb80437574980646447beef6573f5c733b27fc7a822c9a2a1711d72920214: Status 404 returned error can't find the container with id d1feb80437574980646447beef6573f5c733b27fc7a822c9a2a1711d72920214
Sep 09 20:41:16.621404 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:16.621322    2555 generic.go:356] "Generic (PLEG): container finished" podID="d1de80a2-8f79-4413-87bc-9499b5dce533" containerID="8ad09bcdba9c79423d136f8cac690ab477accbdaac61b6627b46bee7ecf57538" exitCode=0
Sep 09 20:41:16.621404 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:16.621388    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn55g" event={"ID":"d1de80a2-8f79-4413-87bc-9499b5dce533","Type":"ContainerDied","Data":"8ad09bcdba9c79423d136f8cac690ab477accbdaac61b6627b46bee7ecf57538"}
Sep 09 20:41:16.622676 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:16.622651    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lm7hp" event={"ID":"76b01924-bfed-4f5a-bc20-211a744910f6","Type":"ContainerStarted","Data":"d1feb80437574980646447beef6573f5c733b27fc7a822c9a2a1711d72920214"}
Sep 09 20:41:16.975594 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:16.975506    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:16.975757 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:16.975666    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:41:16.975757 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:16.975745    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls podName:e606789c-9c2a-441a-8652-fa003893a458 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:18.975723657 +0000 UTC m=+38.032260790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls") pod "dns-default-rnztl" (UID: "e606789c-9c2a-441a-8652-fa003893a458") : secret "dns-default-metrics-tls" not found
Sep 09 20:41:17.630421 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:17.630374    2555 generic.go:356] "Generic (PLEG): container finished" podID="d1de80a2-8f79-4413-87bc-9499b5dce533" containerID="bf05758779366775a5d502f16b21f8b265299731fb29847b0e237eab78faa169" exitCode=0
Sep 09 20:41:17.631012 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:17.630448    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn55g" event={"ID":"d1de80a2-8f79-4413-87bc-9499b5dce533","Type":"ContainerDied","Data":"bf05758779366775a5d502f16b21f8b265299731fb29847b0e237eab78faa169"}
Sep 09 20:41:18.635920 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:18.635877    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn55g" event={"ID":"d1de80a2-8f79-4413-87bc-9499b5dce533","Type":"ContainerStarted","Data":"dbdf4fe01b66d41ec8be52460d4c460cf732e73f27afe4e12a66e5c62aa7650f"}
Sep 09 20:41:18.666019 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:18.665972    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vn55g" podStartSLOduration=8.741612444 podStartE2EDuration="37.66595635s" totalImagesPullingTime="28.924343906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:18.664469319 +0000 UTC m=+37.721006463" watchObservedRunningTime="2026-09-09 20:41:18.66595635 +0000 UTC m=+37.722493490"
Sep 09 20:41:18.993513 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:18.993410    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:18.996373 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:18.993883    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:41:18.996373 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:18.994008    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls podName:e606789c-9c2a-441a-8652-fa003893a458 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:22.993975696 +0000 UTC m=+42.050512833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls") pod "dns-default-rnztl" (UID: "e606789c-9c2a-441a-8652-fa003893a458") : secret "dns-default-metrics-tls" not found
Sep 09 20:41:19.640111 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:19.640067    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lm7hp" event={"ID":"76b01924-bfed-4f5a-bc20-211a744910f6","Type":"ContainerStarted","Data":"0475dca0f8d8a1fe3e2fcb683f90e512004fcd2349a2c28529ef55fda7568b96"}
Sep 09 20:41:19.656313 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:19.656269    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lm7hp" podStartSLOduration=2.046173231 podStartE2EDuration="4.656255822s" totalImagesPullingTime="2.610082591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:19.655793081 +0000 UTC m=+38.712330304" watchObservedRunningTime="2026-09-09 20:41:19.656255822 +0000 UTC m=+38.712792964"
Sep 09 20:41:20.888385 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:20.888353    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976"]
Sep 09 20:41:20.912146 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:20.912119    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976"]
Sep 09 20:41:20.912314 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:20.912214    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976"
Sep 09 20:41:20.915893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:20.915870    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:41:20.915893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:20.915891    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 20:41:20.916077 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:20.915876    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vkqw4\""
Sep 09 20:41:20.985488 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:20.985455    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-gwqc5"]
Sep 09 20:41:21.003924 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.003873    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"]
Sep 09 20:41:21.004098 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.004021    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-gwqc5"
Sep 09 20:41:21.006653 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.006630    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8bts4\""
Sep 09 20:41:21.008059 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.008028    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqfwr\" (UniqueName: \"kubernetes.io/projected/72052fb4-4585-4dc4-bcdc-bf8e9992383f-kube-api-access-hqfwr\") pod \"volume-data-source-validator-695c895bd6-56976\" (UID: \"72052fb4-4585-4dc4-bcdc-bf8e9992383f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976"
Sep 09 20:41:21.029972 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.029936    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-gwqc5"]
Sep 09 20:41:21.029972 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.029977    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"]
Sep 09 20:41:21.030131 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.030019    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.032483 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.032462    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 20:41:21.032611 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.032594    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 20:41:21.032805 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.032770    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:41:21.032878 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.032828    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 20:41:21.032967 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.032875    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p6tf8\""
Sep 09 20:41:21.083687 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.083656    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"]
Sep 09 20:41:21.100586 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.100558    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"]
Sep 09 20:41:21.100739 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.100722    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.103218 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.103140    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 20:41:21.103218 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.103140    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 09 20:41:21.103509 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.103479    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fvd6s\""
Sep 09 20:41:21.104500 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.104478    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 20:41:21.104631 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.104517    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 09 20:41:21.109222 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.109195    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d448eeef-6f5e-444c-8738-add49b12fef0-serving-cert\") pod \"service-ca-operator-859f94c4b-zc2nl\" (UID: \"d448eeef-6f5e-444c-8738-add49b12fef0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.109471 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.109452    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d448eeef-6f5e-444c-8738-add49b12fef0-config\") pod \"service-ca-operator-859f94c4b-zc2nl\" (UID: \"d448eeef-6f5e-444c-8738-add49b12fef0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.109553 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.109488    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfp57\" (UniqueName: \"kubernetes.io/projected/d448eeef-6f5e-444c-8738-add49b12fef0-kube-api-access-sfp57\") pod \"service-ca-operator-859f94c4b-zc2nl\" (UID: \"d448eeef-6f5e-444c-8738-add49b12fef0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.109553 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.109526    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqfwr\" (UniqueName: \"kubernetes.io/projected/72052fb4-4585-4dc4-bcdc-bf8e9992383f-kube-api-access-hqfwr\") pod \"volume-data-source-validator-695c895bd6-56976\" (UID: \"72052fb4-4585-4dc4-bcdc-bf8e9992383f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976"
Sep 09 20:41:21.109655 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.109597    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh9nv\" (UniqueName: \"kubernetes.io/projected/bd04d8f6-a049-4fb2-8a66-023c93bcfaec-kube-api-access-bh9nv\") pod \"network-check-source-685456655f-gwqc5\" (UID: \"bd04d8f6-a049-4fb2-8a66-023c93bcfaec\") " pod="openshift-network-diagnostics/network-check-source-685456655f-gwqc5"
Sep 09 20:41:21.116776 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.116754    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"]
Sep 09 20:41:21.116843 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.116787    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"]
Sep 09 20:41:21.116885 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.116862    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.119980 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.119960    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 20:41:21.120182 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.120168    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 20:41:21.120255 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.120170    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 20:41:21.120313 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.120281    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:41:21.120313 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.120297    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nlsd7\""
Sep 09 20:41:21.125025 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.125007    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqfwr\" (UniqueName: \"kubernetes.io/projected/72052fb4-4585-4dc4-bcdc-bf8e9992383f-kube-api-access-hqfwr\") pod \"volume-data-source-validator-695c895bd6-56976\" (UID: \"72052fb4-4585-4dc4-bcdc-bf8e9992383f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976"
Sep 09 20:41:21.189652 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.189564    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67bfb6cf56-wpdkx"]
Sep 09 20:41:21.210348 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210320    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d448eeef-6f5e-444c-8738-add49b12fef0-serving-cert\") pod \"service-ca-operator-859f94c4b-zc2nl\" (UID: \"d448eeef-6f5e-444c-8738-add49b12fef0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.210516 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210363    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3310537b-0f4f-4410-84d5-351d96dca5c1-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6s6z4\" (UID: \"3310537b-0f4f-4410-84d5-351d96dca5c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.210516 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210391    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg8fp\" (UniqueName: \"kubernetes.io/projected/3310537b-0f4f-4410-84d5-351d96dca5c1-kube-api-access-zg8fp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6s6z4\" (UID: \"3310537b-0f4f-4410-84d5-351d96dca5c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.210516 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210464    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d930effb-3a2c-42ef-b110-901daa5ce831-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.210516 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210487    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.210699 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210543    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d448eeef-6f5e-444c-8738-add49b12fef0-config\") pod \"service-ca-operator-859f94c4b-zc2nl\" (UID: \"d448eeef-6f5e-444c-8738-add49b12fef0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.210699 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210581    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfp57\" (UniqueName: \"kubernetes.io/projected/d448eeef-6f5e-444c-8738-add49b12fef0-kube-api-access-sfp57\") pod \"service-ca-operator-859f94c4b-zc2nl\" (UID: \"d448eeef-6f5e-444c-8738-add49b12fef0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.210699 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210637    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh9nv\" (UniqueName: \"kubernetes.io/projected/bd04d8f6-a049-4fb2-8a66-023c93bcfaec-kube-api-access-bh9nv\") pod \"network-check-source-685456655f-gwqc5\" (UID: \"bd04d8f6-a049-4fb2-8a66-023c93bcfaec\") " pod="openshift-network-diagnostics/network-check-source-685456655f-gwqc5"
Sep 09 20:41:21.210699 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210658    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3310537b-0f4f-4410-84d5-351d96dca5c1-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6s6z4\" (UID: \"3310537b-0f4f-4410-84d5-351d96dca5c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.210880 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210697    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gftxf\" (UniqueName: \"kubernetes.io/projected/d930effb-3a2c-42ef-b110-901daa5ce831-kube-api-access-gftxf\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.210880 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210802    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bfb6cf56-wpdkx"]
Sep 09 20:41:21.211005 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.210896    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.211271 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.211224    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d448eeef-6f5e-444c-8738-add49b12fef0-config\") pod \"service-ca-operator-859f94c4b-zc2nl\" (UID: \"d448eeef-6f5e-444c-8738-add49b12fef0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.213136 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.213112    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d448eeef-6f5e-444c-8738-add49b12fef0-serving-cert\") pod \"service-ca-operator-859f94c4b-zc2nl\" (UID: \"d448eeef-6f5e-444c-8738-add49b12fef0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.213352 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.213329    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 20:41:21.213352 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.213360    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 20:41:21.213352 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.213339    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 20:41:21.213352 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.213443    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tj77j\""
Sep 09 20:41:21.219062 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.219041    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 20:41:21.220979 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.220961    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976"
Sep 09 20:41:21.229235 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.229215    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh9nv\" (UniqueName: \"kubernetes.io/projected/bd04d8f6-a049-4fb2-8a66-023c93bcfaec-kube-api-access-bh9nv\") pod \"network-check-source-685456655f-gwqc5\" (UID: \"bd04d8f6-a049-4fb2-8a66-023c93bcfaec\") " pod="openshift-network-diagnostics/network-check-source-685456655f-gwqc5"
Sep 09 20:41:21.231861 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.231834    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfp57\" (UniqueName: \"kubernetes.io/projected/d448eeef-6f5e-444c-8738-add49b12fef0-kube-api-access-sfp57\") pod \"service-ca-operator-859f94c4b-zc2nl\" (UID: \"d448eeef-6f5e-444c-8738-add49b12fef0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.311575 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.311546    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-image-registry-private-configuration\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.311706 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.311594    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d930effb-3a2c-42ef-b110-901daa5ce831-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.311706 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.311669    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.311823 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.311717    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-certificates\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.311823 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.311776    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dg49\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-kube-api-access-4dg49\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.311964 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.311844    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:21.311964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.311843    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-trusted-ca\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.311964 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.311932    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls podName:d930effb-3a2c-42ef-b110-901daa5ce831 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:21.811896231 +0000 UTC m=+40.868433353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-84lsb" (UID: "d930effb-3a2c-42ef-b110-901daa5ce831") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:21.312123 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.311968    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3310537b-0f4f-4410-84d5-351d96dca5c1-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6s6z4\" (UID: \"3310537b-0f4f-4410-84d5-351d96dca5c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.312123 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.312003    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gftxf\" (UniqueName: \"kubernetes.io/projected/d930effb-3a2c-42ef-b110-901daa5ce831-kube-api-access-gftxf\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.312123 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.312022    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/158cd735-a3e3-4c88-bbad-0afcb177aff9-ca-trust-extracted\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.312123 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.312037    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-bound-sa-token\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.312123 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.312074    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3310537b-0f4f-4410-84d5-351d96dca5c1-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6s6z4\" (UID: \"3310537b-0f4f-4410-84d5-351d96dca5c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.312123 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.312093    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg8fp\" (UniqueName: \"kubernetes.io/projected/3310537b-0f4f-4410-84d5-351d96dca5c1-kube-api-access-zg8fp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6s6z4\" (UID: \"3310537b-0f4f-4410-84d5-351d96dca5c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.312123 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.312114    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.312453 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.312129    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-installation-pull-secrets\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.312453 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.312405    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d930effb-3a2c-42ef-b110-901daa5ce831-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.312758 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.312734    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3310537b-0f4f-4410-84d5-351d96dca5c1-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6s6z4\" (UID: \"3310537b-0f4f-4410-84d5-351d96dca5c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.313737 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.313722    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-gwqc5"
Sep 09 20:41:21.314438 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.314419    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3310537b-0f4f-4410-84d5-351d96dca5c1-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6s6z4\" (UID: \"3310537b-0f4f-4410-84d5-351d96dca5c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.321290 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.321270    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg8fp\" (UniqueName: \"kubernetes.io/projected/3310537b-0f4f-4410-84d5-351d96dca5c1-kube-api-access-zg8fp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6s6z4\" (UID: \"3310537b-0f4f-4410-84d5-351d96dca5c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.321668 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.321653    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gftxf\" (UniqueName: \"kubernetes.io/projected/d930effb-3a2c-42ef-b110-901daa5ce831-kube-api-access-gftxf\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.338499 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.338484    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"
Sep 09 20:41:21.412752 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.412390    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/158cd735-a3e3-4c88-bbad-0afcb177aff9-ca-trust-extracted\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.412752 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.412424    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-bound-sa-token\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.412752 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.412461    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.412752 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.412477    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-installation-pull-secrets\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.412752 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.412518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-image-registry-private-configuration\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.412752 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.412637    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:41:21.412752 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.412660    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfb6cf56-wpdkx: secret "image-registry-tls" not found
Sep 09 20:41:21.412752 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.412734    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls podName:158cd735-a3e3-4c88-bbad-0afcb177aff9 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:21.912711173 +0000 UTC m=+40.969248298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls") pod "image-registry-67bfb6cf56-wpdkx" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9") : secret "image-registry-tls" not found
Sep 09 20:41:21.413281 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.412771    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-certificates\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.413281 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.412825    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dg49\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-kube-api-access-4dg49\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.413281 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.412927    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-trusted-ca\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.413281 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.412952    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/158cd735-a3e3-4c88-bbad-0afcb177aff9-ca-trust-extracted\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.413499 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.413423    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-certificates\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.415594 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.414168    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-trusted-ca\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.416340 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.416130    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-image-registry-private-configuration\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.417446 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.416929    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-installation-pull-secrets\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.424057 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.424028    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dg49\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-kube-api-access-4dg49\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.425159 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.424971    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"
Sep 09 20:41:21.425566 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.425546    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-bound-sa-token\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.518351 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.518294    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976"]
Sep 09 20:41:21.521833 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:21.521796    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72052fb4_4585_4dc4_bcdc_bf8e9992383f.slice/crio-7a839a88d0b5178d6e9597d0ffbca20a69e76f27191bee1d6f0a2f6ed4d60027 WatchSource:0}: Error finding container 7a839a88d0b5178d6e9597d0ffbca20a69e76f27191bee1d6f0a2f6ed4d60027: Status 404 returned error can't find the container with id 7a839a88d0b5178d6e9597d0ffbca20a69e76f27191bee1d6f0a2f6ed4d60027
Sep 09 20:41:21.617950 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.617918    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-gwqc5"]
Sep 09 20:41:21.620846 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:21.620816    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd04d8f6_a049_4fb2_8a66_023c93bcfaec.slice/crio-03bf42789fc1c29aa81064ca5edbd01151393671d491a68cad5fb43a56f4bb47 WatchSource:0}: Error finding container 03bf42789fc1c29aa81064ca5edbd01151393671d491a68cad5fb43a56f4bb47: Status 404 returned error can't find the container with id 03bf42789fc1c29aa81064ca5edbd01151393671d491a68cad5fb43a56f4bb47
Sep 09 20:41:21.638917 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.638876    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl"]
Sep 09 20:41:21.641257 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:21.641234    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd448eeef_6f5e_444c_8738_add49b12fef0.slice/crio-af521f8881f46a48c6fe25c19e8382714685e5ff191156aa49f4e8a3f07c16dc WatchSource:0}: Error finding container af521f8881f46a48c6fe25c19e8382714685e5ff191156aa49f4e8a3f07c16dc: Status 404 returned error can't find the container with id af521f8881f46a48c6fe25c19e8382714685e5ff191156aa49f4e8a3f07c16dc
Sep 09 20:41:21.645735 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.645709    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl" event={"ID":"d448eeef-6f5e-444c-8738-add49b12fef0","Type":"ContainerStarted","Data":"af521f8881f46a48c6fe25c19e8382714685e5ff191156aa49f4e8a3f07c16dc"}
Sep 09 20:41:21.646891 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.646870    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-gwqc5" event={"ID":"bd04d8f6-a049-4fb2-8a66-023c93bcfaec","Type":"ContainerStarted","Data":"03bf42789fc1c29aa81064ca5edbd01151393671d491a68cad5fb43a56f4bb47"}
Sep 09 20:41:21.648098 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.648068    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976" event={"ID":"72052fb4-4585-4dc4-bcdc-bf8e9992383f","Type":"ContainerStarted","Data":"7a839a88d0b5178d6e9597d0ffbca20a69e76f27191bee1d6f0a2f6ed4d60027"}
Sep 09 20:41:21.723271 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.723196    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4"]
Sep 09 20:41:21.726313 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:21.726285    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3310537b_0f4f_4410_84d5_351d96dca5c1.slice/crio-606280915d915a45e257dc0f6d283bae2f902555181c3d6074b29f7a71da2c21 WatchSource:0}: Error finding container 606280915d915a45e257dc0f6d283bae2f902555181c3d6074b29f7a71da2c21: Status 404 returned error can't find the container with id 606280915d915a45e257dc0f6d283bae2f902555181c3d6074b29f7a71da2c21
Sep 09 20:41:21.817084 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.817047    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:21.817277 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.817191    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:21.817277 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.817256    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls podName:d930effb-3a2c-42ef-b110-901daa5ce831 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:22.817236501 +0000 UTC m=+41.873773635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-84lsb" (UID: "d930effb-3a2c-42ef-b110-901daa5ce831") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:21.917619 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:21.917583    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:21.918053 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.917733    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:41:21.918053 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.917748    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfb6cf56-wpdkx: secret "image-registry-tls" not found
Sep 09 20:41:21.918053 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:21.917810    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls podName:158cd735-a3e3-4c88-bbad-0afcb177aff9 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:22.91779513 +0000 UTC m=+41.974332265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls") pod "image-registry-67bfb6cf56-wpdkx" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9") : secret "image-registry-tls" not found
Sep 09 20:41:22.653660 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:22.653615    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4" event={"ID":"3310537b-0f4f-4410-84d5-351d96dca5c1","Type":"ContainerStarted","Data":"606280915d915a45e257dc0f6d283bae2f902555181c3d6074b29f7a71da2c21"}
Sep 09 20:41:22.824164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:22.824126    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:22.824344 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:22.824313    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:22.824410 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:22.824400    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls podName:d930effb-3a2c-42ef-b110-901daa5ce831 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:24.824377298 +0000 UTC m=+43.880914454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-84lsb" (UID: "d930effb-3a2c-42ef-b110-901daa5ce831") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:22.925492 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:22.925405    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:22.925985 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:22.925660    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:41:22.925985 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:22.925676    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfb6cf56-wpdkx: secret "image-registry-tls" not found
Sep 09 20:41:22.925985 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:22.925733    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls podName:158cd735-a3e3-4c88-bbad-0afcb177aff9 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:24.925714601 +0000 UTC m=+43.982251735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls") pod "image-registry-67bfb6cf56-wpdkx" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9") : secret "image-registry-tls" not found
Sep 09 20:41:23.026132 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:23.026101    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:41:23.026281 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:23.026163    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:23.026281 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:23.026177    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls podName:e606789c-9c2a-441a-8652-fa003893a458 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:31.026157394 +0000 UTC m=+50.082694532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls") pod "dns-default-rnztl" (UID: "e606789c-9c2a-441a-8652-fa003893a458") : secret "dns-default-metrics-tls" not found
Sep 09 20:41:23.658022 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:23.657990    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976" event={"ID":"72052fb4-4585-4dc4-bcdc-bf8e9992383f","Type":"ContainerStarted","Data":"da1bc8d993137e9b9589587f1daabaa4e6ae8a7e620e5b544132aab03c966372"}
Sep 09 20:41:23.676878 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:23.676831    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-56976" podStartSLOduration=1.6941460990000001 podStartE2EDuration="3.676815036s" totalImagesPullingTime="1.982668937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:23.676010762 +0000 UTC m=+42.732547905" watchObservedRunningTime="2026-09-09 20:41:23.676815036 +0000 UTC m=+42.733352180"
Sep 09 20:41:24.842533 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:24.842467    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:24.843026 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:24.842652    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:24.843026 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:24.842730    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls podName:d930effb-3a2c-42ef-b110-901daa5ce831 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:28.842708605 +0000 UTC m=+47.899245730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-84lsb" (UID: "d930effb-3a2c-42ef-b110-901daa5ce831") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:24.943487 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:24.943450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:24.943632 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:24.943582    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:41:24.943632 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:24.943593    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfb6cf56-wpdkx: secret "image-registry-tls" not found
Sep 09 20:41:24.943699 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:24.943639    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls podName:158cd735-a3e3-4c88-bbad-0afcb177aff9 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:28.943627364 +0000 UTC m=+48.000164484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls") pod "image-registry-67bfb6cf56-wpdkx" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9") : secret "image-registry-tls" not found
Sep 09 20:41:26.553042 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.553009    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q7mtv"]
Sep 09 20:41:26.582119 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.582093    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q7mtv"]
Sep 09 20:41:26.582263 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.582178    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.584698 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.584677    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 20:41:26.584698 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.584694    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 20:41:26.584862 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.584741    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r8hx4\""
Sep 09 20:41:26.585045 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.585028    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 20:41:26.585045 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.585042    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 20:41:26.759801 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.759774    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-crio-socket\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.759995 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.759835    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.759995 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.759934    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-data-volume\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.760124 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.760006    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg9sc\" (UniqueName: \"kubernetes.io/projected/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-api-access-rg9sc\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.760124 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.760054    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.861161 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.861122    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-data-volume\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.861325 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.861188    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg9sc\" (UniqueName: \"kubernetes.io/projected/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-api-access-rg9sc\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.861325 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.861241    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.861325 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.861291    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-crio-socket\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.861495 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.861340    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.861495 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:26.861383    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:41:26.861495 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:26.861452    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:26.861495 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:26.861471    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:27.361448979 +0000 UTC m=+46.417986111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : configmap "kube-rbac-proxy" not found
Sep 09 20:41:26.861669 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:26.861501    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:27.361485493 +0000 UTC m=+46.418022626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:26.861669 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.861498    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-data-volume\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.861750 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.861673    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-crio-socket\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:26.869428 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:26.869408    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg9sc\" (UniqueName: \"kubernetes.io/projected/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-api-access-rg9sc\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:27.366954 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:27.366914    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:27.367126 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:27.367015    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:27.367126 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:27.367098    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:27.367225 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:27.367177    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:28.367156414 +0000 UTC m=+47.423693549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:27.367225 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:27.367103    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:41:27.367348 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:27.367229    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:28.36721415 +0000 UTC m=+47.423751270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : configmap "kube-rbac-proxy" not found
Sep 09 20:41:27.671238 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:27.671192    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4" event={"ID":"3310537b-0f4f-4410-84d5-351d96dca5c1","Type":"ContainerStarted","Data":"7b491408f669774cb32a3ba1f320893e420242a2a4e0224c13ce572c90091f2f"}
Sep 09 20:41:27.673662 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:27.673192    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl" event={"ID":"d448eeef-6f5e-444c-8738-add49b12fef0","Type":"ContainerStarted","Data":"ca1e3a5600cf77db1d0b71e1bc525f96ce92285fa4428403644e9dbff167f8be"}
Sep 09 20:41:27.675542 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:27.675513    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-gwqc5" event={"ID":"bd04d8f6-a049-4fb2-8a66-023c93bcfaec","Type":"ContainerStarted","Data":"36688a422ca173c61e1e099c821efd6b74849454fa0867a2d8e8548e96c1fee6"}
Sep 09 20:41:27.685754 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:27.685715    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4" podStartSLOduration=1.795786163 podStartE2EDuration="6.685700392s" totalImagesPullingTime="4.889914229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:27.6853966 +0000 UTC m=+46.741933742" watchObservedRunningTime="2026-09-09 20:41:27.685700392 +0000 UTC m=+46.742237536"
Sep 09 20:41:27.735647 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:27.735587    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-gwqc5" podStartSLOduration=2.73142265 podStartE2EDuration="7.735565584s" totalImagesPullingTime="5.004142934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:27.734730438 +0000 UTC m=+46.791267579" watchObservedRunningTime="2026-09-09 20:41:27.735565584 +0000 UTC m=+46.792102727"
Sep 09 20:41:27.752478 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:27.752410    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl" podStartSLOduration=2.777617125 podStartE2EDuration="7.752391831s" totalImagesPullingTime="4.974774706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:27.751083183 +0000 UTC m=+46.807620326" watchObservedRunningTime="2026-09-09 20:41:27.752391831 +0000 UTC m=+46.808928975"
Sep 09 20:41:28.312698 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:28.312663    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7rzt9_2918f9ef-71c5-4062-8256-0298b6c0ee39/dns-node-resolver/0.log"
Sep 09 20:41:28.376504 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:28.376462    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:28.376672 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:28.376561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:28.376672 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:28.376585    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:41:28.376672 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:28.376659    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:30.376630695 +0000 UTC m=+49.433167819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : configmap "kube-rbac-proxy" not found
Sep 09 20:41:28.376852 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:28.376716    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:28.376852 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:28.376774    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:30.376758745 +0000 UTC m=+49.433295879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:28.881010 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:28.880971    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:28.881379 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:28.881110    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:28.881379 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:28.881180    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls podName:d930effb-3a2c-42ef-b110-901daa5ce831 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:36.881164311 +0000 UTC m=+55.937701435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-84lsb" (UID: "d930effb-3a2c-42ef-b110-901daa5ce831") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:28.982335 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:28.982300    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:28.982490 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:28.982459    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:41:28.982490 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:28.982478    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfb6cf56-wpdkx: secret "image-registry-tls" not found
Sep 09 20:41:28.982559 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:28.982539    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls podName:158cd735-a3e3-4c88-bbad-0afcb177aff9 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:36.982519651 +0000 UTC m=+56.039056778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls") pod "image-registry-67bfb6cf56-wpdkx" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9") : secret "image-registry-tls" not found
Sep 09 20:41:29.312562 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:29.312526    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-52qg8_d34c436a-fb65-4ffb-9965-4ac57316f6fc/node-ca/0.log"
Sep 09 20:41:30.246098 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.246063    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-zbqs6"]
Sep 09 20:41:30.282679 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.282650    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-zbqs6"]
Sep 09 20:41:30.282815 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.282760    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.285589 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.285551    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 09 20:41:30.285748 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.285728    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 09 20:41:30.286628 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.286607    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-h8w46\""
Sep 09 20:41:30.286704 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.286610    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 09 20:41:30.286757 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.286613    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 09 20:41:30.311935 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.311916    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lm7hp_76b01924-bfed-4f5a-bc20-211a744910f6/serve-healthcheck-canary/0.log"
Sep 09 20:41:30.395368 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.395341    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ba050a82-3902-4d62-bc14-1f3360fde6b4-signing-cabundle\") pod \"service-ca-75d99c484-zbqs6\" (UID: \"ba050a82-3902-4d62-bc14-1f3360fde6b4\") " pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.395466 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.395385    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:30.395466 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.395433    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ba050a82-3902-4d62-bc14-1f3360fde6b4-signing-key\") pod \"service-ca-75d99c484-zbqs6\" (UID: \"ba050a82-3902-4d62-bc14-1f3360fde6b4\") " pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.395554 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.395500    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc6k4\" (UniqueName: \"kubernetes.io/projected/ba050a82-3902-4d62-bc14-1f3360fde6b4-kube-api-access-tc6k4\") pod \"service-ca-75d99c484-zbqs6\" (UID: \"ba050a82-3902-4d62-bc14-1f3360fde6b4\") " pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.395554 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.395519    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:30.395630 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:30.395566    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:30.395672 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:30.395646    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:34.395627064 +0000 UTC m=+53.452164199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:30.395716 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:30.395679    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:41:30.395752 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:30.395717    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:34.39570635 +0000 UTC m=+53.452243488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : configmap "kube-rbac-proxy" not found
Sep 09 20:41:30.498190 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.498097    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ba050a82-3902-4d62-bc14-1f3360fde6b4-signing-cabundle\") pod \"service-ca-75d99c484-zbqs6\" (UID: \"ba050a82-3902-4d62-bc14-1f3360fde6b4\") " pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.498190 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.498161    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ba050a82-3902-4d62-bc14-1f3360fde6b4-signing-key\") pod \"service-ca-75d99c484-zbqs6\" (UID: \"ba050a82-3902-4d62-bc14-1f3360fde6b4\") " pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.498416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.498220    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc6k4\" (UniqueName: \"kubernetes.io/projected/ba050a82-3902-4d62-bc14-1f3360fde6b4-kube-api-access-tc6k4\") pod \"service-ca-75d99c484-zbqs6\" (UID: \"ba050a82-3902-4d62-bc14-1f3360fde6b4\") " pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.498771 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.498746    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ba050a82-3902-4d62-bc14-1f3360fde6b4-signing-cabundle\") pod \"service-ca-75d99c484-zbqs6\" (UID: \"ba050a82-3902-4d62-bc14-1f3360fde6b4\") " pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.500708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.500690    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ba050a82-3902-4d62-bc14-1f3360fde6b4-signing-key\") pod \"service-ca-75d99c484-zbqs6\" (UID: \"ba050a82-3902-4d62-bc14-1f3360fde6b4\") " pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.507046 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.507028    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc6k4\" (UniqueName: \"kubernetes.io/projected/ba050a82-3902-4d62-bc14-1f3360fde6b4-kube-api-access-tc6k4\") pod \"service-ca-75d99c484-zbqs6\" (UID: \"ba050a82-3902-4d62-bc14-1f3360fde6b4\") " pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.592161 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.592127    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-zbqs6"
Sep 09 20:41:30.879979 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:30.879949    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-zbqs6"]
Sep 09 20:41:30.883335 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:30.883311    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba050a82_3902_4d62_bc14_1f3360fde6b4.slice/crio-6b75832bc9fa01db48f550321f8b1419ba76f754be2b72dd6db7547d81f97a5d WatchSource:0}: Error finding container 6b75832bc9fa01db48f550321f8b1419ba76f754be2b72dd6db7547d81f97a5d: Status 404 returned error can't find the container with id 6b75832bc9fa01db48f550321f8b1419ba76f754be2b72dd6db7547d81f97a5d
Sep 09 20:41:31.103191 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:31.103153    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:31.103461 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:31.103344    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:41:31.103461 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:31.103430    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls podName:e606789c-9c2a-441a-8652-fa003893a458 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:47.103407911 +0000 UTC m=+66.159945047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls") pod "dns-default-rnztl" (UID: "e606789c-9c2a-441a-8652-fa003893a458") : secret "dns-default-metrics-tls" not found
Sep 09 20:41:31.687733 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:31.687696    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-zbqs6" event={"ID":"ba050a82-3902-4d62-bc14-1f3360fde6b4","Type":"ContainerStarted","Data":"94e2d0bff283858e2856786e3af27dd77642e413519d5393a2c1edc9cbfcb2d2"}
Sep 09 20:41:31.688185 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:31.687744    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-zbqs6" event={"ID":"ba050a82-3902-4d62-bc14-1f3360fde6b4","Type":"ContainerStarted","Data":"6b75832bc9fa01db48f550321f8b1419ba76f754be2b72dd6db7547d81f97a5d"}
Sep 09 20:41:31.709651 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:31.709606    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-zbqs6" podStartSLOduration=1.709592148 podStartE2EDuration="1.709592148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:31.709359758 +0000 UTC m=+50.765896901" watchObservedRunningTime="2026-09-09 20:41:31.709592148 +0000 UTC m=+50.766129319"
Sep 09 20:41:34.431321 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:34.431285    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:34.431804 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:34.431350    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:34.431804 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:34.431401    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:41:34.431804 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:34.431476    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:42.431460007 +0000 UTC m=+61.487997142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : configmap "kube-rbac-proxy" not found
Sep 09 20:41:34.431804 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:34.431472    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:34.431804 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:34.431553    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls podName:8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a nodeName:}" failed. No retries permitted until 2026-09-09 20:41:42.431533562 +0000 UTC m=+61.488070703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q7mtv" (UID: "8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:41:36.950630 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:36.950571    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:36.951054 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:36.950726    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:36.951054 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:36.950806    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls podName:d930effb-3a2c-42ef-b110-901daa5ce831 nodeName:}" failed. No retries permitted until 2026-09-09 20:41:52.950788912 +0000 UTC m=+72.007326056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-84lsb" (UID: "d930effb-3a2c-42ef-b110-901daa5ce831") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:41:37.051741 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:37.051703    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:37.054242 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:37.054212    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") pod \"image-registry-67bfb6cf56-wpdkx\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") " pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:37.127349 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:37.127296    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:37.400127 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:37.400098    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bfb6cf56-wpdkx"]
Sep 09 20:41:37.405179 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:37.405149    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158cd735_a3e3_4c88_bbad_0afcb177aff9.slice/crio-0a56dbdcc51d7d7089ad1e5acad98afe3e753a5066fa12114d0e314d6e5cb548 WatchSource:0}: Error finding container 0a56dbdcc51d7d7089ad1e5acad98afe3e753a5066fa12114d0e314d6e5cb548: Status 404 returned error can't find the container with id 0a56dbdcc51d7d7089ad1e5acad98afe3e753a5066fa12114d0e314d6e5cb548
Sep 09 20:41:37.706874 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:37.706778    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx" event={"ID":"158cd735-a3e3-4c88-bbad-0afcb177aff9","Type":"ContainerStarted","Data":"2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615"}
Sep 09 20:41:37.706874 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:37.706839    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx" event={"ID":"158cd735-a3e3-4c88-bbad-0afcb177aff9","Type":"ContainerStarted","Data":"0a56dbdcc51d7d7089ad1e5acad98afe3e753a5066fa12114d0e314d6e5cb548"}
Sep 09 20:41:37.707123 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:37.706922    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:41:37.725527 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:37.725477    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx" podStartSLOduration=16.725460435 podStartE2EDuration="16.725460435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:37.725135118 +0000 UTC m=+56.781672273" watchObservedRunningTime="2026-09-09 20:41:37.725460435 +0000 UTC m=+56.781997576"
Sep 09 20:41:40.613035 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:40.613009    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ht2t"
Sep 09 20:41:42.502517 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:42.502468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:42.502932 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:42.502577    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:42.503170 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:42.503151    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:42.504913 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:42.504883    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7mtv\" (UID: \"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a\") " pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:42.793173 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:42.793149    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r8hx4\""
Sep 09 20:41:42.801994 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:42.801976    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q7mtv"
Sep 09 20:41:43.078421 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:43.078347    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q7mtv"]
Sep 09 20:41:43.081407 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:43.081382    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9f3a97_bfdb_49d7_bf8a_2dabb82fd26a.slice/crio-45c4520a4197ab48e37d15102860bd4d6bbcccb23ab56f8fd15978fe5a6862fc WatchSource:0}: Error finding container 45c4520a4197ab48e37d15102860bd4d6bbcccb23ab56f8fd15978fe5a6862fc: Status 404 returned error can't find the container with id 45c4520a4197ab48e37d15102860bd4d6bbcccb23ab56f8fd15978fe5a6862fc
Sep 09 20:41:43.726384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:43.726359    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7mtv" event={"ID":"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a","Type":"ContainerStarted","Data":"516eef63fee03aa9ea97fa234f19fed496b017196f7742e1238c849f5f420c93"}
Sep 09 20:41:43.726666 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:43.726413    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7mtv" event={"ID":"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a","Type":"ContainerStarted","Data":"45c4520a4197ab48e37d15102860bd4d6bbcccb23ab56f8fd15978fe5a6862fc"}
Sep 09 20:41:44.733228 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:44.733185    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7mtv" event={"ID":"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a","Type":"ContainerStarted","Data":"479cd8b7b48dbf1b31666d3af6dd10cc3d2b6afa920c0b2f46979bc72ae5782a"}
Sep 09 20:41:45.738290 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:45.738255    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7mtv" event={"ID":"8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a","Type":"ContainerStarted","Data":"e5089f6f31e7c8810cae0d152f3bcf34dc22feb37207bb3563d0dc118da96978"}
Sep 09 20:41:45.755934 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:45.755865    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q7mtv" podStartSLOduration=17.999374329 podStartE2EDuration="19.755849953s" totalImagesPullingTime="1.756475624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:41:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:45.754182351 +0000 UTC m=+64.810719494" watchObservedRunningTime="2026-09-09 20:41:45.755849953 +0000 UTC m=+64.812387094"
Sep 09 20:41:47.137572 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.137537    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:47.139998 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.139976    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e606789c-9c2a-441a-8652-fa003893a458-metrics-tls\") pod \"dns-default-rnztl\" (UID: \"e606789c-9c2a-441a-8652-fa003893a458\") " pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:47.238201 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.238161    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:47.238201 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.238201    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:47.240666 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.240641    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 20:41:47.242052 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.242017    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 20:41:47.250771 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.250734    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8389da71-7435-4fe7-8ef9-698d0f2486c7-original-pull-secret\") pod \"global-pull-secret-syncer-hh7dn\" (UID: \"8389da71-7435-4fe7-8ef9-698d0f2486c7\") " pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:47.250944 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.250816    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67f0be98-a4eb-41c6-8886-231d1c4f5263-metrics-certs\") pod \"network-metrics-daemon-fqfwz\" (UID: \"67f0be98-a4eb-41c6-8886-231d1c4f5263\") " pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:47.339533 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.339496    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:47.340040 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.340019    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vs5mb\""
Sep 09 20:41:47.342239 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.342217    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9lxz\" (UniqueName: \"kubernetes.io/projected/b0e51598-ae97-4892-8111-8a845c7b998f-kube-api-access-l9lxz\") pod \"network-check-target-t8ztn\" (UID: \"b0e51598-ae97-4892-8111-8a845c7b998f\") " pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:47.348225 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.348205    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:47.538572 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.538545    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q6qnd\""
Sep 09 20:41:47.544811 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.544787    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sl49q\""
Sep 09 20:41:47.546506 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.546491    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:47.547721 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.547701    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hh7dn"
Sep 09 20:41:47.552840 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.552760    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fqfwz"
Sep 09 20:41:47.623518 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.623487    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rnztl"]
Sep 09 20:41:47.626398 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:47.626346    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode606789c_9c2a_441a_8652_fa003893a458.slice/crio-83cee12e55efee8595ea57c2a205a846a128e6600591affdb4b23c976e95fe34 WatchSource:0}: Error finding container 83cee12e55efee8595ea57c2a205a846a128e6600591affdb4b23c976e95fe34: Status 404 returned error can't find the container with id 83cee12e55efee8595ea57c2a205a846a128e6600591affdb4b23c976e95fe34
Sep 09 20:41:47.744890 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.744854    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rnztl" event={"ID":"e606789c-9c2a-441a-8652-fa003893a458","Type":"ContainerStarted","Data":"83cee12e55efee8595ea57c2a205a846a128e6600591affdb4b23c976e95fe34"}
Sep 09 20:41:47.820086 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.820057    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t8ztn"]
Sep 09 20:41:47.822926 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:47.822885    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e51598_ae97_4892_8111_8a845c7b998f.slice/crio-f588ac2e3cc1e4c6fdf802204ff1b80dc59dcbb95a4dff196cec9b2c34f731fc WatchSource:0}: Error finding container f588ac2e3cc1e4c6fdf802204ff1b80dc59dcbb95a4dff196cec9b2c34f731fc: Status 404 returned error can't find the container with id f588ac2e3cc1e4c6fdf802204ff1b80dc59dcbb95a4dff196cec9b2c34f731fc
Sep 09 20:41:47.826054 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.826030    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fqfwz"]
Sep 09 20:41:47.828854 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:47.828780    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f0be98_a4eb_41c6_8886_231d1c4f5263.slice/crio-78d2e82e7bf7e9d2d4f0e8ea1fadd4b1684e5816988a092985d5f5fc9a8d7a12 WatchSource:0}: Error finding container 78d2e82e7bf7e9d2d4f0e8ea1fadd4b1684e5816988a092985d5f5fc9a8d7a12: Status 404 returned error can't find the container with id 78d2e82e7bf7e9d2d4f0e8ea1fadd4b1684e5816988a092985d5f5fc9a8d7a12
Sep 09 20:41:47.831031 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:47.831012    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hh7dn"]
Sep 09 20:41:47.834329 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:47.834303    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8389da71_7435_4fe7_8ef9_698d0f2486c7.slice/crio-a63b602cbad122206accdd5428df1d5620d926e0d8d16cb009eeb625b2b08128 WatchSource:0}: Error finding container a63b602cbad122206accdd5428df1d5620d926e0d8d16cb009eeb625b2b08128: Status 404 returned error can't find the container with id a63b602cbad122206accdd5428df1d5620d926e0d8d16cb009eeb625b2b08128
Sep 09 20:41:48.750647 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:48.750563    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fqfwz" event={"ID":"67f0be98-a4eb-41c6-8886-231d1c4f5263","Type":"ContainerStarted","Data":"78d2e82e7bf7e9d2d4f0e8ea1fadd4b1684e5816988a092985d5f5fc9a8d7a12"}
Sep 09 20:41:48.752069 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:48.752014    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hh7dn" event={"ID":"8389da71-7435-4fe7-8ef9-698d0f2486c7","Type":"ContainerStarted","Data":"a63b602cbad122206accdd5428df1d5620d926e0d8d16cb009eeb625b2b08128"}
Sep 09 20:41:48.754631 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:48.754587    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t8ztn" event={"ID":"b0e51598-ae97-4892-8111-8a845c7b998f","Type":"ContainerStarted","Data":"fabbbac664ff01f4ab05de5e7f4ccac0ed9aa5c5e03635d386ede647e4ab95f8"}
Sep 09 20:41:48.754770 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:48.754633    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t8ztn" event={"ID":"b0e51598-ae97-4892-8111-8a845c7b998f","Type":"ContainerStarted","Data":"f588ac2e3cc1e4c6fdf802204ff1b80dc59dcbb95a4dff196cec9b2c34f731fc"}
Sep 09 20:41:48.754770 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:48.754715    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:41:48.771634 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:48.771576    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t8ztn" podStartSLOduration=67.771541983 podStartE2EDuration="1m7.771541983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:48.769813883 +0000 UTC m=+67.826351026" watchObservedRunningTime="2026-09-09 20:41:48.771541983 +0000 UTC m=+67.828079127"
Sep 09 20:41:49.760963 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:49.760859    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rnztl" event={"ID":"e606789c-9c2a-441a-8652-fa003893a458","Type":"ContainerStarted","Data":"ac1c4243417c375b785ea514b8912babbca71091891d00b367202e4423ebf3cb"}
Sep 09 20:41:49.760963 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:49.760943    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rnztl" event={"ID":"e606789c-9c2a-441a-8652-fa003893a458","Type":"ContainerStarted","Data":"d92e86e64ca80d566ad05e8f8394c843625fbb24d640148106af45bff4a99f67"}
Sep 09 20:41:49.761441 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:49.761335    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rnztl"
Sep 09 20:41:49.763888 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:49.763488    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fqfwz" event={"ID":"67f0be98-a4eb-41c6-8886-231d1c4f5263","Type":"ContainerStarted","Data":"12c2886656b227672e15cbf0fb021b71d28dc5691d1e3d37d99f0d526df5ea9e"}
Sep 09 20:41:49.763888 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:49.763536    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fqfwz" event={"ID":"67f0be98-a4eb-41c6-8886-231d1c4f5263","Type":"ContainerStarted","Data":"f606e95ffdd4db5da7a7e20ed1e8324de4acb7835e1a04329a2058f1ac3b5963"}
Sep 09 20:41:49.778619 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:49.778551    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rnztl" podStartSLOduration=32.92392036 podStartE2EDuration="34.778530811s" totalImagesPullingTime="1.854610451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:49.776773652 +0000 UTC m=+68.833310794" watchObservedRunningTime="2026-09-09 20:41:49.778530811 +0000 UTC m=+68.835067955"
Sep 09 20:41:49.792104 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:49.792059    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fqfwz" podStartSLOduration=67.143478468 podStartE2EDuration="1m8.792044892s" totalImagesPullingTime="1.648566424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:49.79106997 +0000 UTC m=+68.847607112" watchObservedRunningTime="2026-09-09 20:41:49.792044892 +0000 UTC m=+68.848582033"
Sep 09 20:41:51.318938 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.318072    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-b7s5t"]
Sep 09 20:41:51.320467 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.320445    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-b7s5t"
Sep 09 20:41:51.322982 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.322953    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 20:41:51.323096 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.323008    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5zfx6\""
Sep 09 20:41:51.323096 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.323050    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 20:41:51.330337 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.330318    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67bfb6cf56-wpdkx"]
Sep 09 20:41:51.333550 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.333520    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-b7s5t"]
Sep 09 20:41:51.376262 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.376233    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd7fj\" (UniqueName: \"kubernetes.io/projected/143e5dbf-1f38-4def-a45b-29f993bc00df-kube-api-access-vd7fj\") pod \"downloads-85d98c998f-b7s5t\" (UID: \"143e5dbf-1f38-4def-a45b-29f993bc00df\") " pod="openshift-console/downloads-85d98c998f-b7s5t"
Sep 09 20:41:51.477256 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.477216    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7fj\" (UniqueName: \"kubernetes.io/projected/143e5dbf-1f38-4def-a45b-29f993bc00df-kube-api-access-vd7fj\") pod \"downloads-85d98c998f-b7s5t\" (UID: \"143e5dbf-1f38-4def-a45b-29f993bc00df\") " pod="openshift-console/downloads-85d98c998f-b7s5t"
Sep 09 20:41:51.486644 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.486617    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd7fj\" (UniqueName: \"kubernetes.io/projected/143e5dbf-1f38-4def-a45b-29f993bc00df-kube-api-access-vd7fj\") pod \"downloads-85d98c998f-b7s5t\" (UID: \"143e5dbf-1f38-4def-a45b-29f993bc00df\") " pod="openshift-console/downloads-85d98c998f-b7s5t"
Sep 09 20:41:51.632028 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:51.631929    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-b7s5t"
Sep 09 20:41:52.068355 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:52.068323    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-b7s5t"]
Sep 09 20:41:52.071824 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:52.071791    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143e5dbf_1f38_4def_a45b_29f993bc00df.slice/crio-3de0182f02892fc283fa95ef6a4ec84aa314e9f2b1158dbbf6803170228631f7 WatchSource:0}: Error finding container 3de0182f02892fc283fa95ef6a4ec84aa314e9f2b1158dbbf6803170228631f7: Status 404 returned error can't find the container with id 3de0182f02892fc283fa95ef6a4ec84aa314e9f2b1158dbbf6803170228631f7
Sep 09 20:41:52.777798 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:52.777750    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hh7dn" event={"ID":"8389da71-7435-4fe7-8ef9-698d0f2486c7","Type":"ContainerStarted","Data":"4129b6eb82652b86cbb44c38854ff5352ced275c57b3c048bc63f19317974870"}
Sep 09 20:41:52.779067 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:52.779041    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-b7s5t" event={"ID":"143e5dbf-1f38-4def-a45b-29f993bc00df","Type":"ContainerStarted","Data":"3de0182f02892fc283fa95ef6a4ec84aa314e9f2b1158dbbf6803170228631f7"}
Sep 09 20:41:52.792043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:52.792004    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hh7dn" podStartSLOduration=67.78740921 podStartE2EDuration="1m11.791988889s" totalImagesPullingTime="4.004579679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:52.791407973 +0000 UTC m=+71.847945113" watchObservedRunningTime="2026-09-09 20:41:52.791988889 +0000 UTC m=+71.848526035"
Sep 09 20:41:52.989191 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:52.989157    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:52.992136 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:52.992106    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d930effb-3a2c-42ef-b110-901daa5ce831-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-84lsb\" (UID: \"d930effb-3a2c-42ef-b110-901daa5ce831\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:53.214408 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:53.214372    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fvd6s\""
Sep 09 20:41:53.222701 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:53.222676    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"
Sep 09 20:41:53.498617 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:53.498543    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb"]
Sep 09 20:41:53.501460 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:53.501429    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd930effb_3a2c_42ef_b110_901daa5ce831.slice/crio-6a6983d7b244132f5b021cf3498251e7c983b2c302bf935c48a30fbb95bdbc98 WatchSource:0}: Error finding container 6a6983d7b244132f5b021cf3498251e7c983b2c302bf935c48a30fbb95bdbc98: Status 404 returned error can't find the container with id 6a6983d7b244132f5b021cf3498251e7c983b2c302bf935c48a30fbb95bdbc98
Sep 09 20:41:53.785244 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:53.785169    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb" event={"ID":"d930effb-3a2c-42ef-b110-901daa5ce831","Type":"ContainerStarted","Data":"6a6983d7b244132f5b021cf3498251e7c983b2c302bf935c48a30fbb95bdbc98"}
Sep 09 20:41:55.158605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.158569    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56c44fd567-d67ww"]
Sep 09 20:41:55.162209 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.162187    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.164860 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.164823    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 20:41:55.164860 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.164850    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 20:41:55.165144 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.165128    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 20:41:55.165863 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.165843    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 20:41:55.166159 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.166141    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 20:41:55.166292 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.166182    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jd646\""
Sep 09 20:41:55.171613 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.171588    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c44fd567-d67ww"]
Sep 09 20:41:55.307549 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.307514    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-oauth-config\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.307738 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.307564    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5695w\" (UniqueName: \"kubernetes.io/projected/b29c7d63-7e8f-4a54-a85b-9da761419bd9-kube-api-access-5695w\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.307738 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.307656    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-config\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.307738 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.307702    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-oauth-serving-cert\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.307891 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.307742    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-serving-cert\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.307891 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.307767    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-service-ca\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.409147 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.409058    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-config\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.409147 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.409114    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-oauth-serving-cert\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.409361 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.409148    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-serving-cert\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.409361 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.409170    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-service-ca\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.409361 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.409211    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-oauth-config\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.409361 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.409229    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5695w\" (UniqueName: \"kubernetes.io/projected/b29c7d63-7e8f-4a54-a85b-9da761419bd9-kube-api-access-5695w\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.409889 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.409858    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-config\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.410029 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.410005    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-oauth-serving-cert\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.410159 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.410131    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-service-ca\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.412700 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.412677    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-serving-cert\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.412828 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.412809    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-oauth-config\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.417550 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.417522    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5695w\" (UniqueName: \"kubernetes.io/projected/b29c7d63-7e8f-4a54-a85b-9da761419bd9-kube-api-access-5695w\") pod \"console-56c44fd567-d67ww\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") " pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.474683 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.474647    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:41:55.796106 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.796064    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb" event={"ID":"d930effb-3a2c-42ef-b110-901daa5ce831","Type":"ContainerStarted","Data":"29a01ca297ea8721635986993b7244f1f3452d3286e8e1ae47b26adeb3dc24fe"}
Sep 09 20:41:55.813990 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.813929    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-84lsb" podStartSLOduration=32.712118628 podStartE2EDuration="34.813885417s" totalImagesPullingTime="2.101766789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:41:55.813883007 +0000 UTC m=+74.870420149" watchObservedRunningTime="2026-09-09 20:41:55.813885417 +0000 UTC m=+74.870422548"
Sep 09 20:41:55.846839 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:55.846806    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c44fd567-d67ww"]
Sep 09 20:41:55.850757 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:55.850726    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29c7d63_7e8f_4a54_a85b_9da761419bd9.slice/crio-63049bb50da649cc56a7b443361ef2a9a85e9eee48f0fef6a1df7d3961f064ea WatchSource:0}: Error finding container 63049bb50da649cc56a7b443361ef2a9a85e9eee48f0fef6a1df7d3961f064ea: Status 404 returned error can't find the container with id 63049bb50da649cc56a7b443361ef2a9a85e9eee48f0fef6a1df7d3961f064ea
Sep 09 20:41:56.114692 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.114656    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"]
Sep 09 20:41:56.117959 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.117930    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"
Sep 09 20:41:56.120111 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.120085    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 20:41:56.120291 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.120096    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5skcp\""
Sep 09 20:41:56.126349 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.126324    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"]
Sep 09 20:41:56.217962 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.217895    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/72a06277-6430-460d-8b88-07153f40361c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-j7kml\" (UID: \"72a06277-6430-460d-8b88-07153f40361c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"
Sep 09 20:41:56.318568 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.318529    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/72a06277-6430-460d-8b88-07153f40361c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-j7kml\" (UID: \"72a06277-6430-460d-8b88-07153f40361c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"
Sep 09 20:41:56.318727 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:56.318686    2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 09 20:41:56.318785 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:41:56.318758    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a06277-6430-460d-8b88-07153f40361c-tls-certificates podName:72a06277-6430-460d-8b88-07153f40361c nodeName:}" failed. No retries permitted until 2026-09-09 20:41:56.818736675 +0000 UTC m=+75.875273812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/72a06277-6430-460d-8b88-07153f40361c-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-j7kml" (UID: "72a06277-6430-460d-8b88-07153f40361c") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 09 20:41:56.802798 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.802760    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c44fd567-d67ww" event={"ID":"b29c7d63-7e8f-4a54-a85b-9da761419bd9","Type":"ContainerStarted","Data":"63049bb50da649cc56a7b443361ef2a9a85e9eee48f0fef6a1df7d3961f064ea"}
Sep 09 20:41:56.823025 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.822992    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/72a06277-6430-460d-8b88-07153f40361c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-j7kml\" (UID: \"72a06277-6430-460d-8b88-07153f40361c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"
Sep 09 20:41:56.826762 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:56.826702    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/72a06277-6430-460d-8b88-07153f40361c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-j7kml\" (UID: \"72a06277-6430-460d-8b88-07153f40361c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"
Sep 09 20:41:57.031523 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:57.031484    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"
Sep 09 20:41:57.311442 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:57.311411    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"]
Sep 09 20:41:57.315227 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:41:57.315198    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a06277_6430_460d_8b88_07153f40361c.slice/crio-a9aad4d9279d6f72b88776052183e978fec03d5bcf7620de612768abe3d18e8c WatchSource:0}: Error finding container a9aad4d9279d6f72b88776052183e978fec03d5bcf7620de612768abe3d18e8c: Status 404 returned error can't find the container with id a9aad4d9279d6f72b88776052183e978fec03d5bcf7620de612768abe3d18e8c
Sep 09 20:41:57.808488 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:57.808440    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml" event={"ID":"72a06277-6430-460d-8b88-07153f40361c","Type":"ContainerStarted","Data":"a9aad4d9279d6f72b88776052183e978fec03d5bcf7620de612768abe3d18e8c"}
Sep 09 20:41:59.770583 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:41:59.770552    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rnztl"
Sep 09 20:42:00.822267 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:00.822229    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c44fd567-d67ww" event={"ID":"b29c7d63-7e8f-4a54-a85b-9da761419bd9","Type":"ContainerStarted","Data":"6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe"}
Sep 09 20:42:00.823814 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:00.823791    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml" event={"ID":"72a06277-6430-460d-8b88-07153f40361c","Type":"ContainerStarted","Data":"eebad795d0063b48bfbb6ed9113048269783aad78e2fac7e13971ab61ebde635"}
Sep 09 20:42:00.824025 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:00.824010    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"
Sep 09 20:42:00.829935 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:00.829888    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml"
Sep 09 20:42:00.839159 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:00.839111    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56c44fd567-d67ww" podStartSLOduration=1.563739565 podStartE2EDuration="5.839096231s" totalImagesPullingTime="4.275356666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:00.838822492 +0000 UTC m=+79.895359638" watchObservedRunningTime="2026-09-09 20:42:00.839096231 +0000 UTC m=+79.895633440"
Sep 09 20:42:00.852800 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:00.852757    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j7kml" podStartSLOduration=2.05138218 podStartE2EDuration="4.852744692s" totalImagesPullingTime="2.801362512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:00.852010428 +0000 UTC m=+79.908547571" watchObservedRunningTime="2026-09-09 20:42:00.852744692 +0000 UTC m=+79.909281833"
Sep 09 20:42:01.337003 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:01.336968    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:42:03.337328 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.337214    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-99745c9cf-2mlqn"]
Sep 09 20:42:03.340271 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.340251    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.349210 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.349040    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 20:42:03.350670 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.350648    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99745c9cf-2mlqn"]
Sep 09 20:42:03.473373 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.473343    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-serving-cert\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.473539 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.473386    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-console-config\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.473539 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.473446    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-trusted-ca-bundle\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.473539 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.473508    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-oauth-config\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.473539 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.473528    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-service-ca\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.473708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.473549    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-oauth-serving-cert\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.473708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.473614    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkqpg\" (UniqueName: \"kubernetes.io/projected/970cf7e5-02e7-40a7-9969-0abcff634572-kube-api-access-vkqpg\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.574050 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.574010    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkqpg\" (UniqueName: \"kubernetes.io/projected/970cf7e5-02e7-40a7-9969-0abcff634572-kube-api-access-vkqpg\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.574237 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.574069    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-serving-cert\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.574237 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.574103    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-console-config\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.574237 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.574130    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-trusted-ca-bundle\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.574237 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.574182    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-oauth-config\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.574237 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.574202    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-service-ca\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.574237 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.574224    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-oauth-serving-cert\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.575028 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.574990    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-oauth-serving-cert\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.575329 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.575263    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-service-ca\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.575462 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.575377    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-trusted-ca-bundle\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.575462 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.575385    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-console-config\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.577178 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.577158    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-oauth-config\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.577314 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.577291    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-serving-cert\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.581970 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.581951    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkqpg\" (UniqueName: \"kubernetes.io/projected/970cf7e5-02e7-40a7-9969-0abcff634572-kube-api-access-vkqpg\") pod \"console-99745c9cf-2mlqn\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") " pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:03.650648 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:03.650562    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:05.475397 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:05.475362    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:42:05.475884 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:05.475426    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:42:05.480704 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:05.480680    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:42:05.848423 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:05.848394    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:42:06.571972 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.571923    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lrwcb"]
Sep 09 20:42:06.574825 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.574802    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"]
Sep 09 20:42:06.576403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.575110    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.578857 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.577845    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.579355 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.579335    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dvqdx\""
Sep 09 20:42:06.580683 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.580161    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 20:42:06.580683 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.580507    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 20:42:06.580683 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.580514    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 20:42:06.580860 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.580736    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 20:42:06.580860 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.580758    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 20:42:06.584358 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.583026    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rbssn\""
Sep 09 20:42:06.584358 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.583247    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 20:42:06.584358 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.584138    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 20:42:06.596966 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.594668    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"]
Sep 09 20:42:06.701393 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701357    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-wtmp\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.701591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701450    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.701591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701499    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-tls\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.701591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701534    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa79e567-0b12-46bc-b317-5c312594c5f5-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.701591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701559    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27zzm\" (UniqueName: \"kubernetes.io/projected/1a9d3518-c4bc-4874-a211-20d33e2da7c0-kube-api-access-27zzm\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.701591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701589    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.701872 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701620    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aa79e567-0b12-46bc-b317-5c312594c5f5-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.701872 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701644    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9d3518-c4bc-4874-a211-20d33e2da7c0-metrics-client-ca\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.701872 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701680    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a9d3518-c4bc-4874-a211-20d33e2da7c0-root\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.701872 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701704    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a9d3518-c4bc-4874-a211-20d33e2da7c0-sys\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.701872 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701733    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-textfile\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.701872 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701760    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.701872 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701801    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn5q9\" (UniqueName: \"kubernetes.io/projected/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-api-access-mn5q9\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.701872 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701836    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.702331 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.701888    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.803004 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.802971    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.803200 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803031    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-wtmp\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.803200 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803054    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.803200 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803077    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-tls\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.803200 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803107    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa79e567-0b12-46bc-b317-5c312594c5f5-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.803200 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803130    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27zzm\" (UniqueName: \"kubernetes.io/projected/1a9d3518-c4bc-4874-a211-20d33e2da7c0-kube-api-access-27zzm\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.803200 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803161    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.803200 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803191    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aa79e567-0b12-46bc-b317-5c312594c5f5-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.803511 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803213    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9d3518-c4bc-4874-a211-20d33e2da7c0-metrics-client-ca\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.803511 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803247    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a9d3518-c4bc-4874-a211-20d33e2da7c0-root\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.803511 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803272    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a9d3518-c4bc-4874-a211-20d33e2da7c0-sys\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.803511 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803303    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-textfile\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.803511 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803335    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.803511 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803385    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn5q9\" (UniqueName: \"kubernetes.io/projected/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-api-access-mn5q9\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.803511 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.803418    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.803828 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:42:06.803529    2555 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 09 20:42:06.803828 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:42:06.803609    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-tls podName:aa79e567-0b12-46bc-b317-5c312594c5f5 nodeName:}" failed. No retries permitted until 2026-09-09 20:42:07.303587761 +0000 UTC m=+86.360124881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-fspcw" (UID: "aa79e567-0b12-46bc-b317-5c312594c5f5") : secret "kube-state-metrics-tls" not found
Sep 09 20:42:06.804468 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.804437    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.804609 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.804559    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-wtmp\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.806101 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.804955    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.806101 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:42:06.805304    2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 20:42:06.806101 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:42:06.805360    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-tls podName:1a9d3518-c4bc-4874-a211-20d33e2da7c0 nodeName:}" failed. No retries permitted until 2026-09-09 20:42:07.30534128 +0000 UTC m=+86.361878404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-tls") pod "node-exporter-lrwcb" (UID: "1a9d3518-c4bc-4874-a211-20d33e2da7c0") : secret "node-exporter-tls" not found
Sep 09 20:42:06.806101 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.805408    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a9d3518-c4bc-4874-a211-20d33e2da7c0-sys\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.806101 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.805493    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa79e567-0b12-46bc-b317-5c312594c5f5-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.806101 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.805672    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aa79e567-0b12-46bc-b317-5c312594c5f5-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.806101 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.805724    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a9d3518-c4bc-4874-a211-20d33e2da7c0-root\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.806101 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.805973    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9d3518-c4bc-4874-a211-20d33e2da7c0-metrics-client-ca\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.806575 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.806197    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-textfile\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.806697 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.806671    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.808613 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.808522    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:06.813975 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.813930    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27zzm\" (UniqueName: \"kubernetes.io/projected/1a9d3518-c4bc-4874-a211-20d33e2da7c0-kube-api-access-27zzm\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:06.814839 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:06.814817    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn5q9\" (UniqueName: \"kubernetes.io/projected/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-api-access-mn5q9\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:07.308213 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.308174    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:07.308378 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.308310    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-tls\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:07.311187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.311145    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a9d3518-c4bc-4874-a211-20d33e2da7c0-node-exporter-tls\") pod \"node-exporter-lrwcb\" (UID: \"1a9d3518-c4bc-4874-a211-20d33e2da7c0\") " pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:07.311454 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.311435    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa79e567-0b12-46bc-b317-5c312594c5f5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fspcw\" (UID: \"aa79e567-0b12-46bc-b317-5c312594c5f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:07.491210 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.491171    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lrwcb"
Sep 09 20:42:07.499722 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.499690    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"
Sep 09 20:42:07.615707 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.615616    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:42:07.618889 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.618869    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.621140 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.621116    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 20:42:07.621591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.621558    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 20:42:07.621687 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.621661    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 20:42:07.622186 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.622023    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 20:42:07.623114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.622825    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 20:42:07.623114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.622871    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vjm4s\""
Sep 09 20:42:07.623114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.622931    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 20:42:07.623114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.622832    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 20:42:07.623114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.623095    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 20:42:07.623397 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.623226    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 20:42:07.636483 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.636465    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:42:07.712118 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712081    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712287 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712137    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712287 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712172    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2zq\" (UniqueName: \"kubernetes.io/projected/52399550-ac1d-43d7-bd80-81ce65c532a7-kube-api-access-6f2zq\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712287 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712201    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52399550-ac1d-43d7-bd80-81ce65c532a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712287 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712225    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52399550-ac1d-43d7-bd80-81ce65c532a7-config-out\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712508 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712292    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52399550-ac1d-43d7-bd80-81ce65c532a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712508 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712320    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712508 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712349    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712508 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712374    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52399550-ac1d-43d7-bd80-81ce65c532a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712508 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712417    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712508 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712492    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-web-config\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712832 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712562    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.712832 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.712614    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52399550-ac1d-43d7-bd80-81ce65c532a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.814507 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.814469    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52399550-ac1d-43d7-bd80-81ce65c532a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.814699 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.814522    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.814699 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.814554    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.814699 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.814578    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2zq\" (UniqueName: \"kubernetes.io/projected/52399550-ac1d-43d7-bd80-81ce65c532a7-kube-api-access-6f2zq\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.814926 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.814874    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52399550-ac1d-43d7-bd80-81ce65c532a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815029 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.814964    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52399550-ac1d-43d7-bd80-81ce65c532a7-config-out\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815390 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.815061    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52399550-ac1d-43d7-bd80-81ce65c532a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815531 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.815419    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815531 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.815459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815531 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.815491    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52399550-ac1d-43d7-bd80-81ce65c532a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815698 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.815540    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52399550-ac1d-43d7-bd80-81ce65c532a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815698 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.815549    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815698 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.815628    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-web-config\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815698 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.815674    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.815698 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.815678    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52399550-ac1d-43d7-bd80-81ce65c532a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.816326 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.816304    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52399550-ac1d-43d7-bd80-81ce65c532a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.818786 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.818760    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52399550-ac1d-43d7-bd80-81ce65c532a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.819240 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.819216    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.820004 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.819953    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52399550-ac1d-43d7-bd80-81ce65c532a7-config-out\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.820972 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.820933    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.821104 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.821085    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.821419 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.821400    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.822016 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.821995    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-web-config\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.822362 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.822327    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.822497 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.822476    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52399550-ac1d-43d7-bd80-81ce65c532a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.829664 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.829641    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2zq\" (UniqueName: \"kubernetes.io/projected/52399550-ac1d-43d7-bd80-81ce65c532a7-kube-api-access-6f2zq\") pod \"alertmanager-main-0\" (UID: \"52399550-ac1d-43d7-bd80-81ce65c532a7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:07.932647 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:07.932564    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:42:09.311850 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:42:09.311801    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9d3518_c4bc_4874_a211_20d33e2da7c0.slice/crio-cf3aaa088d9d84e1f0ea08782d1071c54436f35e605f057791e37a16310f40bf WatchSource:0}: Error finding container cf3aaa088d9d84e1f0ea08782d1071c54436f35e605f057791e37a16310f40bf: Status 404 returned error can't find the container with id cf3aaa088d9d84e1f0ea08782d1071c54436f35e605f057791e37a16310f40bf
Sep 09 20:42:09.581997 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.581965    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99745c9cf-2mlqn"]
Sep 09 20:42:09.583070 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:42:09.582864    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa79e567_0b12_46bc_b317_5c312594c5f5.slice/crio-c1b10233a0628efdf665f34e0ea179607a404bbe36e74fd36f618af01a8134cd WatchSource:0}: Error finding container c1b10233a0628efdf665f34e0ea179607a404bbe36e74fd36f618af01a8134cd: Status 404 returned error can't find the container with id c1b10233a0628efdf665f34e0ea179607a404bbe36e74fd36f618af01a8134cd
Sep 09 20:42:09.583328 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.583301    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-fspcw"]
Sep 09 20:42:09.586790 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:42:09.586734    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970cf7e5_02e7_40a7_9969_0abcff634572.slice/crio-36d637e56b57faed7298a2afb82ae619fc36154a977365bb5da81be6b512eb5a WatchSource:0}: Error finding container 36d637e56b57faed7298a2afb82ae619fc36154a977365bb5da81be6b512eb5a: Status 404 returned error can't find the container with id 36d637e56b57faed7298a2afb82ae619fc36154a977365bb5da81be6b512eb5a
Sep 09 20:42:09.590545 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.590161    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:42:09.595102 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:42:09.595068    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52399550_ac1d_43d7_bd80_81ce65c532a7.slice/crio-ab75eb7ee5e586b7a6ffe9c67e824b74820f67bcd4d144aa074ae58c1b4b0452 WatchSource:0}: Error finding container ab75eb7ee5e586b7a6ffe9c67e824b74820f67bcd4d144aa074ae58c1b4b0452: Status 404 returned error can't find the container with id ab75eb7ee5e586b7a6ffe9c67e824b74820f67bcd4d144aa074ae58c1b4b0452
Sep 09 20:42:09.869413 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.869276    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw" event={"ID":"aa79e567-0b12-46bc-b317-5c312594c5f5","Type":"ContainerStarted","Data":"c1b10233a0628efdf665f34e0ea179607a404bbe36e74fd36f618af01a8134cd"}
Sep 09 20:42:09.871946 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.871847    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrwcb" event={"ID":"1a9d3518-c4bc-4874-a211-20d33e2da7c0","Type":"ContainerStarted","Data":"cf3aaa088d9d84e1f0ea08782d1071c54436f35e605f057791e37a16310f40bf"}
Sep 09 20:42:09.876826 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.874205    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-b7s5t" event={"ID":"143e5dbf-1f38-4def-a45b-29f993bc00df","Type":"ContainerStarted","Data":"ae3c43590be809a9ab8a0ac92e02814cface6c2cbc4ca4251cee6de1e72b9c9b"}
Sep 09 20:42:09.876826 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.876736    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-b7s5t"
Sep 09 20:42:09.879696 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.879516    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52399550-ac1d-43d7-bd80-81ce65c532a7","Type":"ContainerStarted","Data":"ab75eb7ee5e586b7a6ffe9c67e824b74820f67bcd4d144aa074ae58c1b4b0452"}
Sep 09 20:42:09.879696 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.879665    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-b7s5t"
Sep 09 20:42:09.882199 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.881644    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99745c9cf-2mlqn" event={"ID":"970cf7e5-02e7-40a7-9969-0abcff634572","Type":"ContainerStarted","Data":"68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9"}
Sep 09 20:42:09.882199 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.881685    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99745c9cf-2mlqn" event={"ID":"970cf7e5-02e7-40a7-9969-0abcff634572","Type":"ContainerStarted","Data":"36d637e56b57faed7298a2afb82ae619fc36154a977365bb5da81be6b512eb5a"}
Sep 09 20:42:09.916558 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.916482    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-b7s5t" podStartSLOduration=1.613638516 podStartE2EDuration="18.916457361s" totalImagesPullingTime="17.302818845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:09.893331247 +0000 UTC m=+88.949868390" watchObservedRunningTime="2026-09-09 20:42:09.916457361 +0000 UTC m=+88.972994499"
Sep 09 20:42:09.917279 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:09.917231    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-99745c9cf-2mlqn" podStartSLOduration=6.917213624 podStartE2EDuration="6.917213624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:09.913551758 +0000 UTC m=+88.970088901" watchObservedRunningTime="2026-09-09 20:42:09.917213624 +0000 UTC m=+88.973750766"
Sep 09 20:42:10.954368 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:10.954329    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56579dd9d4-qp97l"]
Sep 09 20:42:10.979650 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:10.979587    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56579dd9d4-qp97l"]
Sep 09 20:42:10.979800 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:10.979703    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:10.985610 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:10.985214    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 20:42:10.985610 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:10.985254    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-76ugjl3bhhug5\""
Sep 09 20:42:10.985610 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:10.985346    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 20:42:10.985610 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:10.985411    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-g24fs\""
Sep 09 20:42:10.985610 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:10.985467    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 20:42:10.986256 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:10.986075    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 20:42:11.145576 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.145525    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-secret-metrics-server-client-certs\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.145763 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.145586    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.145763 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.145633    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-secret-metrics-server-tls\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.145763 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.145659    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-audit-log\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.145974 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.145755    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-metrics-server-audit-profiles\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.146159 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.146041    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpjjh\" (UniqueName: \"kubernetes.io/projected/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-kube-api-access-gpjjh\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.146159 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.146082    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-client-ca-bundle\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.246764 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.246739    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-secret-metrics-server-tls\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.246893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.246769    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-audit-log\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.246893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.246807    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-metrics-server-audit-profiles\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.246893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.246849    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpjjh\" (UniqueName: \"kubernetes.io/projected/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-kube-api-access-gpjjh\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.246893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.246882    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-client-ca-bundle\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.247132 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.246960    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-secret-metrics-server-client-certs\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.247132 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.246996    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.247235 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.247168    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-audit-log\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.247713 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.247689    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.248175 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.248149    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-metrics-server-audit-profiles\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.250296 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.250251    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-secret-metrics-server-tls\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.250524 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.250502    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-client-ca-bundle\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.250714 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.250691    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-secret-metrics-server-client-certs\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.260370 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.259728    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpjjh\" (UniqueName: \"kubernetes.io/projected/8b716ad6-96c2-4eb4-9ac2-ba2394dadbde-kube-api-access-gpjjh\") pod \"metrics-server-56579dd9d4-qp97l\" (UID: \"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde\") " pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.293712 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.293485    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:11.357473 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.355039    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"]
Sep 09 20:42:11.389491 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.389384    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"]
Sep 09 20:42:11.389491 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.389482    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:11.393168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.392585    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 20:42:11.393168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.392832    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fth2r\""
Sep 09 20:42:11.549652 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.548949    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f66c97f8-ae57-4407-8559-643a46f53953-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-qtwsf\" (UID: \"f66c97f8-ae57-4407-8559-643a46f53953\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:11.549652 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.549018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkvvp\" (UniqueName: \"kubernetes.io/projected/f66c97f8-ae57-4407-8559-643a46f53953-kube-api-access-wkvvp\") pod \"monitoring-plugin-85bbbbbf4-qtwsf\" (UID: \"f66c97f8-ae57-4407-8559-643a46f53953\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:11.599277 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:42:11.599240    2555 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9d3518_c4bc_4874_a211_20d33e2da7c0.slice/crio-4acca14c1255921c130dab372869eed211732f789e8a8926617eead1837cb040.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9d3518_c4bc_4874_a211_20d33e2da7c0.slice/crio-conmon-4acca14c1255921c130dab372869eed211732f789e8a8926617eead1837cb040.scope\": RecentStats: unable to find data in memory cache]"
Sep 09 20:42:11.641090 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.641064    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56579dd9d4-qp97l"]
Sep 09 20:42:11.647447 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:42:11.647421    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b716ad6_96c2_4eb4_9ac2_ba2394dadbde.slice/crio-81293c35771c802fafb99163db65bfcba991e3086be7d1b880a6dc38184c1341 WatchSource:0}: Error finding container 81293c35771c802fafb99163db65bfcba991e3086be7d1b880a6dc38184c1341: Status 404 returned error can't find the container with id 81293c35771c802fafb99163db65bfcba991e3086be7d1b880a6dc38184c1341
Sep 09 20:42:11.649785 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.649760    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f66c97f8-ae57-4407-8559-643a46f53953-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-qtwsf\" (UID: \"f66c97f8-ae57-4407-8559-643a46f53953\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:11.649894 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.649821    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkvvp\" (UniqueName: \"kubernetes.io/projected/f66c97f8-ae57-4407-8559-643a46f53953-kube-api-access-wkvvp\") pod \"monitoring-plugin-85bbbbbf4-qtwsf\" (UID: \"f66c97f8-ae57-4407-8559-643a46f53953\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:11.652410 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.652383    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f66c97f8-ae57-4407-8559-643a46f53953-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-qtwsf\" (UID: \"f66c97f8-ae57-4407-8559-643a46f53953\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:11.658506 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.658483    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkvvp\" (UniqueName: \"kubernetes.io/projected/f66c97f8-ae57-4407-8559-643a46f53953-kube-api-access-wkvvp\") pod \"monitoring-plugin-85bbbbbf4-qtwsf\" (UID: \"f66c97f8-ae57-4407-8559-643a46f53953\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:11.704962 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.704660    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:11.894863 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.894772    2555 generic.go:356] "Generic (PLEG): container finished" podID="1a9d3518-c4bc-4874-a211-20d33e2da7c0" containerID="4acca14c1255921c130dab372869eed211732f789e8a8926617eead1837cb040" exitCode=0
Sep 09 20:42:11.895059 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.894945    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrwcb" event={"ID":"1a9d3518-c4bc-4874-a211-20d33e2da7c0","Type":"ContainerDied","Data":"4acca14c1255921c130dab372869eed211732f789e8a8926617eead1837cb040"}
Sep 09 20:42:11.897691 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.897538    2555 generic.go:356] "Generic (PLEG): container finished" podID="52399550-ac1d-43d7-bd80-81ce65c532a7" containerID="596054fa9cada775b88ab36d140f78f1c6f0ffb0f1eb83679bde72f42822bcec" exitCode=0
Sep 09 20:42:11.897691 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.897630    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52399550-ac1d-43d7-bd80-81ce65c532a7","Type":"ContainerDied","Data":"596054fa9cada775b88ab36d140f78f1c6f0ffb0f1eb83679bde72f42822bcec"}
Sep 09 20:42:11.900458 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:11.900375    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l" event={"ID":"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde","Type":"ContainerStarted","Data":"81293c35771c802fafb99163db65bfcba991e3086be7d1b880a6dc38184c1341"}
Sep 09 20:42:12.008185 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.007957    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"]
Sep 09 20:42:12.227115 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:42:12.227036    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66c97f8_ae57_4407_8559_643a46f53953.slice/crio-337ba3250e592117a06976bd9fcf5a1e69c5a978b83cca2df96bd0738bde7ccb WatchSource:0}: Error finding container 337ba3250e592117a06976bd9fcf5a1e69c5a978b83cca2df96bd0738bde7ccb: Status 404 returned error can't find the container with id 337ba3250e592117a06976bd9fcf5a1e69c5a978b83cca2df96bd0738bde7ccb
Sep 09 20:42:12.570685 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.570648    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99745c9cf-2mlqn"]
Sep 09 20:42:12.599072 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.599038    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d78f47c9d-c496v"]
Sep 09 20:42:12.615527 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.615501    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d78f47c9d-c496v"]
Sep 09 20:42:12.615670 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.615599    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.760319 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.760282    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-oauth-config\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.760461 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.760330    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-trusted-ca-bundle\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.760461 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.760363    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggvzt\" (UniqueName: \"kubernetes.io/projected/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-kube-api-access-ggvzt\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.760461 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.760395    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-service-ca\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.760461 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.760445    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-oauth-serving-cert\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.760678 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.760483    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-config\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.760678 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.760561    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-serving-cert\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.861609 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.861538    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-oauth-config\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.861609 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.861582    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-trusted-ca-bundle\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.861755 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.861611    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggvzt\" (UniqueName: \"kubernetes.io/projected/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-kube-api-access-ggvzt\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.861755 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.861643    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-service-ca\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.861755 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.861689    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-oauth-serving-cert\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.861755 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.861726    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-config\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.861968 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.861755    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-serving-cert\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.863541 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.863505    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-oauth-serving-cert\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.864153 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.864129    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-service-ca\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.873990 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.864650    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-config\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.873990 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.864731    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-trusted-ca-bundle\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.873990 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.865203    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-serving-cert\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.873990 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.865478    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-oauth-config\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.874825 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.874705    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggvzt\" (UniqueName: \"kubernetes.io/projected/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-kube-api-access-ggvzt\") pod \"console-6d78f47c9d-c496v\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") " pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.914198 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.913858    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw" event={"ID":"aa79e567-0b12-46bc-b317-5c312594c5f5","Type":"ContainerStarted","Data":"711c78b8e876d01baf4cdc16f2fd854518836ccec804cd25c178c25cb17f928a"}
Sep 09 20:42:12.920862 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.920396    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrwcb" event={"ID":"1a9d3518-c4bc-4874-a211-20d33e2da7c0","Type":"ContainerStarted","Data":"cdcd1a8b94c54c9e6e0ba5064a4b344cd00fd027f35b42e9c3ecb91dc4523745"}
Sep 09 20:42:12.920862 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.920463    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrwcb" event={"ID":"1a9d3518-c4bc-4874-a211-20d33e2da7c0","Type":"ContainerStarted","Data":"138c1b64503e2f598ee653d36db28ee2ed98bde1a51dea1c9210d2a26c5fc682"}
Sep 09 20:42:12.928017 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.927966    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf" event={"ID":"f66c97f8-ae57-4407-8559-643a46f53953","Type":"ContainerStarted","Data":"337ba3250e592117a06976bd9fcf5a1e69c5a978b83cca2df96bd0738bde7ccb"}
Sep 09 20:42:12.929306 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.929165    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:12.947523 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:12.947475    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lrwcb" podStartSLOduration=4.914553569 podStartE2EDuration="6.947455152s" totalImagesPullingTime="1.926855911s" totalInitContainerRuntime="106.045672ms" isStatefulPod=true podCreationTimestamp="2026-09-09 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:12.945034082 +0000 UTC m=+92.001571225" watchObservedRunningTime="2026-09-09 20:42:12.947455152 +0000 UTC m=+92.003992294"
Sep 09 20:42:13.282677 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:13.282640    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d78f47c9d-c496v"]
Sep 09 20:42:13.286718 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:42:13.286675    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded84fbef_3bd6_4f1a_b5a5_2dc3d22c0e89.slice/crio-a9e3741ac6e50ce889e52fef3a71955924cec093e9717f520d682e978e861e66 WatchSource:0}: Error finding container a9e3741ac6e50ce889e52fef3a71955924cec093e9717f520d682e978e861e66: Status 404 returned error can't find the container with id a9e3741ac6e50ce889e52fef3a71955924cec093e9717f520d682e978e861e66
Sep 09 20:42:13.651468 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:13.651383    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:13.936281 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:13.935810    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d78f47c9d-c496v" event={"ID":"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89","Type":"ContainerStarted","Data":"0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190"}
Sep 09 20:42:13.936281 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:13.935878    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d78f47c9d-c496v" event={"ID":"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89","Type":"ContainerStarted","Data":"a9e3741ac6e50ce889e52fef3a71955924cec093e9717f520d682e978e861e66"}
Sep 09 20:42:13.939624 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:13.939065    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw" event={"ID":"aa79e567-0b12-46bc-b317-5c312594c5f5","Type":"ContainerStarted","Data":"f2b06730f8a4e0d0f98003d7e5bcbf2033a3aac6abf8eb92bd182e8f5f63c23e"}
Sep 09 20:42:13.939624 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:13.939131    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw" event={"ID":"aa79e567-0b12-46bc-b317-5c312594c5f5","Type":"ContainerStarted","Data":"cb528c9cafc7d8541b0443b2561f8a48e699b362cf6211276de7e5774c54fae3"}
Sep 09 20:42:13.958302 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:13.958254    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d78f47c9d-c496v" podStartSLOduration=1.9582339229999999 podStartE2EDuration="1.958233923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:13.956559222 +0000 UTC m=+93.013096368" watchObservedRunningTime="2026-09-09 20:42:13.958233923 +0000 UTC m=+93.014771066"
Sep 09 20:42:13.974799 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:13.974746    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fspcw" podStartSLOduration=4.888390211 podStartE2EDuration="7.974725882s" totalImagesPullingTime="3.086335671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:13.974048303 +0000 UTC m=+93.030585444" watchObservedRunningTime="2026-09-09 20:42:13.974725882 +0000 UTC m=+93.031263025"
Sep 09 20:42:16.354771 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.354730    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx" podUID="158cd735-a3e3-4c88-bbad-0afcb177aff9" containerName="registry" containerID="cri-o://2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615" gracePeriod=30
Sep 09 20:42:16.677226 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.677196    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:42:16.803582 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.803556    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-image-registry-private-configuration\") pod \"158cd735-a3e3-4c88-bbad-0afcb177aff9\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") "
Sep 09 20:42:16.803708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.803607    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-certificates\") pod \"158cd735-a3e3-4c88-bbad-0afcb177aff9\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") "
Sep 09 20:42:16.803708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.803636    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-bound-sa-token\") pod \"158cd735-a3e3-4c88-bbad-0afcb177aff9\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") "
Sep 09 20:42:16.803708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.803701    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-installation-pull-secrets\") pod \"158cd735-a3e3-4c88-bbad-0afcb177aff9\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") "
Sep 09 20:42:16.803868 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.803731    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dg49\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-kube-api-access-4dg49\") pod \"158cd735-a3e3-4c88-bbad-0afcb177aff9\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") "
Sep 09 20:42:16.803868 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.803759    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/158cd735-a3e3-4c88-bbad-0afcb177aff9-ca-trust-extracted\") pod \"158cd735-a3e3-4c88-bbad-0afcb177aff9\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") "
Sep 09 20:42:16.803868 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.803792    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") pod \"158cd735-a3e3-4c88-bbad-0afcb177aff9\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") "
Sep 09 20:42:16.803868 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.803834    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-trusted-ca\") pod \"158cd735-a3e3-4c88-bbad-0afcb177aff9\" (UID: \"158cd735-a3e3-4c88-bbad-0afcb177aff9\") "
Sep 09 20:42:16.806126 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.804180    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "158cd735-a3e3-4c88-bbad-0afcb177aff9" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:42:16.806126 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.804421    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "158cd735-a3e3-4c88-bbad-0afcb177aff9" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:42:16.807010 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.806979    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "158cd735-a3e3-4c88-bbad-0afcb177aff9" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:42:16.807621 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.807396    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-kube-api-access-4dg49" (OuterVolumeSpecName: "kube-api-access-4dg49") pod "158cd735-a3e3-4c88-bbad-0afcb177aff9" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9"). InnerVolumeSpecName "kube-api-access-4dg49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:42:16.807621 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.807509    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "158cd735-a3e3-4c88-bbad-0afcb177aff9" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:42:16.808522 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.808493    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "158cd735-a3e3-4c88-bbad-0afcb177aff9" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:42:16.809120 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.809090    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "158cd735-a3e3-4c88-bbad-0afcb177aff9" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:42:16.814688 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.814663    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/158cd735-a3e3-4c88-bbad-0afcb177aff9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "158cd735-a3e3-4c88-bbad-0afcb177aff9" (UID: "158cd735-a3e3-4c88-bbad-0afcb177aff9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:42:16.905248 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.905212    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-installation-pull-secrets\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:16.905248 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.905246    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dg49\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-kube-api-access-4dg49\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:16.905248 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.905255    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/158cd735-a3e3-4c88-bbad-0afcb177aff9-ca-trust-extracted\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:16.905501 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.905265    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:16.905501 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.905273    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-trusted-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:16.905501 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.905282    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/158cd735-a3e3-4c88-bbad-0afcb177aff9-image-registry-private-configuration\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:16.905501 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.905290    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/158cd735-a3e3-4c88-bbad-0afcb177aff9-registry-certificates\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:16.905501 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.905298    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/158cd735-a3e3-4c88-bbad-0afcb177aff9-bound-sa-token\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:16.955919 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.955870    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf" event={"ID":"f66c97f8-ae57-4407-8559-643a46f53953","Type":"ContainerStarted","Data":"17ef7ad35df87b42eb5c8224baed937bb730b3ab2fb62c806ad17752cdc0c193"}
Sep 09 20:42:16.956130 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.956112    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:16.960274 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.960248    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52399550-ac1d-43d7-bd80-81ce65c532a7","Type":"ContainerStarted","Data":"cb1a183419b3e959dc7edc1dd2ab29e970f44c36ee0d98c1699a48aabcb76acc"}
Sep 09 20:42:16.960416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.960318    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52399550-ac1d-43d7-bd80-81ce65c532a7","Type":"ContainerStarted","Data":"f2e173f84269bb1dfdf84298e80023d5fc1973144c4e9f3b1670de2ed723d873"}
Sep 09 20:42:16.960416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.960363    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52399550-ac1d-43d7-bd80-81ce65c532a7","Type":"ContainerStarted","Data":"60140ff7c4b31fbe774729a420ed83a118d752b502815864802a6e1ed5f03ec6"}
Sep 09 20:42:16.960416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.960406    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52399550-ac1d-43d7-bd80-81ce65c532a7","Type":"ContainerStarted","Data":"aad2a8df3b92132602fd45f744edf30c37538ea0052c63b30d4948b00b8efa1c"}
Sep 09 20:42:16.960576 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.960447    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52399550-ac1d-43d7-bd80-81ce65c532a7","Type":"ContainerStarted","Data":"8876ce7a7db75c6ed618ddffd219dfe1cfe2a2f90d3e71aea20d6b7a814f41f9"}
Sep 09 20:42:16.961869 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.961827    2555 generic.go:356] "Generic (PLEG): container finished" podID="158cd735-a3e3-4c88-bbad-0afcb177aff9" containerID="2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615" exitCode=0
Sep 09 20:42:16.962001 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.961949    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx" event={"ID":"158cd735-a3e3-4c88-bbad-0afcb177aff9","Type":"ContainerDied","Data":"2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615"}
Sep 09 20:42:16.962001 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.961987    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx" event={"ID":"158cd735-a3e3-4c88-bbad-0afcb177aff9","Type":"ContainerDied","Data":"0a56dbdcc51d7d7089ad1e5acad98afe3e753a5066fa12114d0e314d6e5cb548"}
Sep 09 20:42:16.962001 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.961953    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bfb6cf56-wpdkx"
Sep 09 20:42:16.962163 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.962032    2555 scope.go:117] "RemoveContainer" containerID="2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615"
Sep 09 20:42:16.963957 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.963927    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l" event={"ID":"8b716ad6-96c2-4eb4-9ac2-ba2394dadbde","Type":"ContainerStarted","Data":"c9938f40e35a5806229a28950c8e6d4a5fbfdeb13310cf59fd1b3eef14c7ed59"}
Sep 09 20:42:16.968374 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.968351    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf"
Sep 09 20:42:16.973541 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.973495    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-qtwsf" podStartSLOduration=2.153829265 podStartE2EDuration="5.973477527s" totalImagesPullingTime="3.819648262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:16.971429893 +0000 UTC m=+96.027967054" watchObservedRunningTime="2026-09-09 20:42:16.973477527 +0000 UTC m=+96.030014669"
Sep 09 20:42:16.973637 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.973623    2555 scope.go:117] "RemoveContainer" containerID="2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615"
Sep 09 20:42:16.974076 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:42:16.974053    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615\": container with ID starting with 2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615 not found: ID does not exist" containerID="2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615"
Sep 09 20:42:16.974158 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.974087    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615"} err="failed to get container status \"2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615\": rpc error: code = NotFound desc = could not find container \"2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615\": container with ID starting with 2ce4524d2b0a28ac68cd6abfb7ae87f959cf3921197bc7ca33e5f12c082ca615 not found: ID does not exist"
Sep 09 20:42:16.991852 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:16.991802    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l" podStartSLOduration=2.5889355480000003 podStartE2EDuration="6.991788467s" totalImagesPullingTime="4.402852919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:16.990609641 +0000 UTC m=+96.047146785" watchObservedRunningTime="2026-09-09 20:42:16.991788467 +0000 UTC m=+96.048325608"
Sep 09 20:42:17.039022 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:17.038989    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67bfb6cf56-wpdkx"]
Sep 09 20:42:17.040401 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:17.040373    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67bfb6cf56-wpdkx"]
Sep 09 20:42:17.444237 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:17.444194    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="158cd735-a3e3-4c88-bbad-0afcb177aff9" path="/var/lib/kubelet/pods/158cd735-a3e3-4c88-bbad-0afcb177aff9/volumes"
Sep 09 20:42:18.979667 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:18.979628    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52399550-ac1d-43d7-bd80-81ce65c532a7","Type":"ContainerStarted","Data":"5df4699937723770d38cb668d2a16f6720904cc673464584d18fd0a33826e4bd"}
Sep 09 20:42:19.006267 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:19.006195    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.540701752 podStartE2EDuration="12.006171789s" totalImagesPullingTime="7.449723448s" totalInitContainerRuntime="15.746589ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:42:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:19.005741557 +0000 UTC m=+98.062278697" watchObservedRunningTime="2026-09-09 20:42:19.006171789 +0000 UTC m=+98.062709130"
Sep 09 20:42:19.766751 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:19.766725    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t8ztn"
Sep 09 20:42:22.929776 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:22.929739    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:22.930252 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:22.929844    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:22.934648 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:22.934629    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:23.001785 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:23.001756    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:42:23.047318 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:23.047286    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c44fd567-d67ww"]
Sep 09 20:42:31.294648 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:31.294610    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:31.295136 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:31.294675    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:37.594724 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.594621    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-99745c9cf-2mlqn" podUID="970cf7e5-02e7-40a7-9969-0abcff634572" containerName="console" containerID="cri-o://68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9" gracePeriod=15
Sep 09 20:42:37.831183 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.831157    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:37.890854 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.890779    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-trusted-ca-bundle\") pod \"970cf7e5-02e7-40a7-9969-0abcff634572\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") "
Sep 09 20:42:37.890854 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.890814    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-oauth-serving-cert\") pod \"970cf7e5-02e7-40a7-9969-0abcff634572\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") "
Sep 09 20:42:37.891049 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.890872    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-service-ca\") pod \"970cf7e5-02e7-40a7-9969-0abcff634572\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") "
Sep 09 20:42:37.891049 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.890922    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-serving-cert\") pod \"970cf7e5-02e7-40a7-9969-0abcff634572\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") "
Sep 09 20:42:37.891049 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.890951    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkqpg\" (UniqueName: \"kubernetes.io/projected/970cf7e5-02e7-40a7-9969-0abcff634572-kube-api-access-vkqpg\") pod \"970cf7e5-02e7-40a7-9969-0abcff634572\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") "
Sep 09 20:42:37.891049 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.890996    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-oauth-config\") pod \"970cf7e5-02e7-40a7-9969-0abcff634572\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") "
Sep 09 20:42:37.891049 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.891039    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-console-config\") pod \"970cf7e5-02e7-40a7-9969-0abcff634572\" (UID: \"970cf7e5-02e7-40a7-9969-0abcff634572\") "
Sep 09 20:42:37.891284 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.891226    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "970cf7e5-02e7-40a7-9969-0abcff634572" (UID: "970cf7e5-02e7-40a7-9969-0abcff634572"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:42:37.891340 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.891305    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "970cf7e5-02e7-40a7-9969-0abcff634572" (UID: "970cf7e5-02e7-40a7-9969-0abcff634572"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:42:37.891580 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.891555    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-console-config" (OuterVolumeSpecName: "console-config") pod "970cf7e5-02e7-40a7-9969-0abcff634572" (UID: "970cf7e5-02e7-40a7-9969-0abcff634572"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:42:37.891848 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.891599    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-service-ca" (OuterVolumeSpecName: "service-ca") pod "970cf7e5-02e7-40a7-9969-0abcff634572" (UID: "970cf7e5-02e7-40a7-9969-0abcff634572"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:42:37.893320 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.893295    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "970cf7e5-02e7-40a7-9969-0abcff634572" (UID: "970cf7e5-02e7-40a7-9969-0abcff634572"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:42:37.893399 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.893309    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/970cf7e5-02e7-40a7-9969-0abcff634572-kube-api-access-vkqpg" (OuterVolumeSpecName: "kube-api-access-vkqpg") pod "970cf7e5-02e7-40a7-9969-0abcff634572" (UID: "970cf7e5-02e7-40a7-9969-0abcff634572"). InnerVolumeSpecName "kube-api-access-vkqpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:42:37.893613 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.893596    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "970cf7e5-02e7-40a7-9969-0abcff634572" (UID: "970cf7e5-02e7-40a7-9969-0abcff634572"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:42:37.992134 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.992107    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:37.992134 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.992129    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:37.992134 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.992139    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkqpg\" (UniqueName: \"kubernetes.io/projected/970cf7e5-02e7-40a7-9969-0abcff634572-kube-api-access-vkqpg\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:37.992331 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.992147    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/970cf7e5-02e7-40a7-9969-0abcff634572-console-oauth-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:37.992331 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.992156    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-console-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:37.992331 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.992164    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-trusted-ca-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:37.992331 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:37.992171    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/970cf7e5-02e7-40a7-9969-0abcff634572-oauth-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:38.068865 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.068833    2555 generic.go:356] "Generic (PLEG): container finished" podID="970cf7e5-02e7-40a7-9969-0abcff634572" containerID="68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9" exitCode=0
Sep 09 20:42:38.069052 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.068890    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99745c9cf-2mlqn"
Sep 09 20:42:38.069052 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.068930    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99745c9cf-2mlqn" event={"ID":"970cf7e5-02e7-40a7-9969-0abcff634572","Type":"ContainerDied","Data":"68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9"}
Sep 09 20:42:38.069052 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.069003    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99745c9cf-2mlqn" event={"ID":"970cf7e5-02e7-40a7-9969-0abcff634572","Type":"ContainerDied","Data":"36d637e56b57faed7298a2afb82ae619fc36154a977365bb5da81be6b512eb5a"}
Sep 09 20:42:38.069052 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.069025    2555 scope.go:117] "RemoveContainer" containerID="68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9"
Sep 09 20:42:38.070728 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.070703    2555 generic.go:356] "Generic (PLEG): container finished" podID="3310537b-0f4f-4410-84d5-351d96dca5c1" containerID="7b491408f669774cb32a3ba1f320893e420242a2a4e0224c13ce572c90091f2f" exitCode=0
Sep 09 20:42:38.070850 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.070743    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4" event={"ID":"3310537b-0f4f-4410-84d5-351d96dca5c1","Type":"ContainerDied","Data":"7b491408f669774cb32a3ba1f320893e420242a2a4e0224c13ce572c90091f2f"}
Sep 09 20:42:38.071074 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.071058    2555 scope.go:117] "RemoveContainer" containerID="7b491408f669774cb32a3ba1f320893e420242a2a4e0224c13ce572c90091f2f"
Sep 09 20:42:38.081431 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.081384    2555 scope.go:117] "RemoveContainer" containerID="68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9"
Sep 09 20:42:38.081745 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:42:38.081726    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9\": container with ID starting with 68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9 not found: ID does not exist" containerID="68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9"
Sep 09 20:42:38.081794 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.081755    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9"} err="failed to get container status \"68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9\": rpc error: code = NotFound desc = could not find container \"68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9\": container with ID starting with 68ca5d715e7c42a042f0e2717942470879efad95f5e44a9bdbc96310a7d395e9 not found: ID does not exist"
Sep 09 20:42:38.113749 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.113716    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99745c9cf-2mlqn"]
Sep 09 20:42:38.123302 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:38.123276    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-99745c9cf-2mlqn"]
Sep 09 20:42:39.076534 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:39.076494    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6s6z4" event={"ID":"3310537b-0f4f-4410-84d5-351d96dca5c1","Type":"ContainerStarted","Data":"bc5464b3babecc7b3768eb7b4b883dcfd8911cd449982a071af8387fe51d82b2"}
Sep 09 20:42:39.430049 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:39.429970    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="970cf7e5-02e7-40a7-9969-0abcff634572" path="/var/lib/kubelet/pods/970cf7e5-02e7-40a7-9969-0abcff634572/volumes"
Sep 09 20:42:48.068504 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.068459    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56c44fd567-d67ww" podUID="b29c7d63-7e8f-4a54-a85b-9da761419bd9" containerName="console" containerID="cri-o://6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe" gracePeriod=15
Sep 09 20:42:48.340248 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.340185    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:42:48.496121 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.496090    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-serving-cert\") pod \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") "
Sep 09 20:42:48.496306 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.496140    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-config\") pod \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") "
Sep 09 20:42:48.496306 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.496180    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-oauth-serving-cert\") pod \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") "
Sep 09 20:42:48.496306 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.496240    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-oauth-config\") pod \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") "
Sep 09 20:42:48.496460 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.496305    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5695w\" (UniqueName: \"kubernetes.io/projected/b29c7d63-7e8f-4a54-a85b-9da761419bd9-kube-api-access-5695w\") pod \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") "
Sep 09 20:42:48.496460 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.496342    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-service-ca\") pod \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\" (UID: \"b29c7d63-7e8f-4a54-a85b-9da761419bd9\") "
Sep 09 20:42:48.496730 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.496590    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-config" (OuterVolumeSpecName: "console-config") pod "b29c7d63-7e8f-4a54-a85b-9da761419bd9" (UID: "b29c7d63-7e8f-4a54-a85b-9da761419bd9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:42:48.496730 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.496611    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b29c7d63-7e8f-4a54-a85b-9da761419bd9" (UID: "b29c7d63-7e8f-4a54-a85b-9da761419bd9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:42:48.496944 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.496798    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-service-ca" (OuterVolumeSpecName: "service-ca") pod "b29c7d63-7e8f-4a54-a85b-9da761419bd9" (UID: "b29c7d63-7e8f-4a54-a85b-9da761419bd9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:42:48.497175 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.497146    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:48.497235 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.497178    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-oauth-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:48.498587 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.498555    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29c7d63-7e8f-4a54-a85b-9da761419bd9-kube-api-access-5695w" (OuterVolumeSpecName: "kube-api-access-5695w") pod "b29c7d63-7e8f-4a54-a85b-9da761419bd9" (UID: "b29c7d63-7e8f-4a54-a85b-9da761419bd9"). InnerVolumeSpecName "kube-api-access-5695w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:42:48.498587 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.498565    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b29c7d63-7e8f-4a54-a85b-9da761419bd9" (UID: "b29c7d63-7e8f-4a54-a85b-9da761419bd9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:42:48.498724 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.498587    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b29c7d63-7e8f-4a54-a85b-9da761419bd9" (UID: "b29c7d63-7e8f-4a54-a85b-9da761419bd9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:42:48.598528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.598444    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:48.598528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.598479    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:48.598528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.598495    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29c7d63-7e8f-4a54-a85b-9da761419bd9-console-oauth-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:48.598528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:48.598510    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5695w\" (UniqueName: \"kubernetes.io/projected/b29c7d63-7e8f-4a54-a85b-9da761419bd9-kube-api-access-5695w\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:42:49.118091 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.118050    2555 generic.go:356] "Generic (PLEG): container finished" podID="b29c7d63-7e8f-4a54-a85b-9da761419bd9" containerID="6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe" exitCode=0
Sep 09 20:42:49.118449 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.118097    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c44fd567-d67ww"
Sep 09 20:42:49.118449 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.118120    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c44fd567-d67ww" event={"ID":"b29c7d63-7e8f-4a54-a85b-9da761419bd9","Type":"ContainerDied","Data":"6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe"}
Sep 09 20:42:49.118449 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.118168    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c44fd567-d67ww" event={"ID":"b29c7d63-7e8f-4a54-a85b-9da761419bd9","Type":"ContainerDied","Data":"63049bb50da649cc56a7b443361ef2a9a85e9eee48f0fef6a1df7d3961f064ea"}
Sep 09 20:42:49.118449 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.118212    2555 scope.go:117] "RemoveContainer" containerID="6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe"
Sep 09 20:42:49.130737 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.130718    2555 scope.go:117] "RemoveContainer" containerID="6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe"
Sep 09 20:42:49.131034 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:42:49.131013    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe\": container with ID starting with 6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe not found: ID does not exist" containerID="6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe"
Sep 09 20:42:49.131147 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.131041    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe"} err="failed to get container status \"6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe\": rpc error: code = NotFound desc = could not find container \"6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe\": container with ID starting with 6b409d5c73072226caa4097079d65d714e98e1e6f46216702b76b246c93fd5fe not found: ID does not exist"
Sep 09 20:42:49.143772 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.143733    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c44fd567-d67ww"]
Sep 09 20:42:49.145248 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.145226    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56c44fd567-d67ww"]
Sep 09 20:42:49.429520 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:49.429440    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b29c7d63-7e8f-4a54-a85b-9da761419bd9" path="/var/lib/kubelet/pods/b29c7d63-7e8f-4a54-a85b-9da761419bd9/volumes"
Sep 09 20:42:51.300513 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:51.300486    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:51.304377 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:51.304353    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56579dd9d4-qp97l"
Sep 09 20:42:53.136970 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:53.136932    2555 generic.go:356] "Generic (PLEG): container finished" podID="d448eeef-6f5e-444c-8738-add49b12fef0" containerID="ca1e3a5600cf77db1d0b71e1bc525f96ce92285fa4428403644e9dbff167f8be" exitCode=0
Sep 09 20:42:53.137391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:53.136985    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl" event={"ID":"d448eeef-6f5e-444c-8738-add49b12fef0","Type":"ContainerDied","Data":"ca1e3a5600cf77db1d0b71e1bc525f96ce92285fa4428403644e9dbff167f8be"}
Sep 09 20:42:53.137391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:53.137293    2555 scope.go:117] "RemoveContainer" containerID="ca1e3a5600cf77db1d0b71e1bc525f96ce92285fa4428403644e9dbff167f8be"
Sep 09 20:42:54.143021 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:54.142985    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zc2nl" event={"ID":"d448eeef-6f5e-444c-8738-add49b12fef0","Type":"ContainerStarted","Data":"c7aa60536e6a1e6b4be73a72324da30ef65af742df34df39a0ab681d4ed3111d"}
Sep 09 20:42:57.587792 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:42:57.587758    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lm7hp_76b01924-bfed-4f5a-bc20-211a744910f6/serve-healthcheck-canary/0.log"
Sep 09 20:43:30.845147 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845112    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b98474b9-4mn47"]
Sep 09 20:43:30.845605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845427    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="970cf7e5-02e7-40a7-9969-0abcff634572" containerName="console"
Sep 09 20:43:30.845605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845446    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="970cf7e5-02e7-40a7-9969-0abcff634572" containerName="console"
Sep 09 20:43:30.845605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845470    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="158cd735-a3e3-4c88-bbad-0afcb177aff9" containerName="registry"
Sep 09 20:43:30.845605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845479    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="158cd735-a3e3-4c88-bbad-0afcb177aff9" containerName="registry"
Sep 09 20:43:30.845605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845500    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b29c7d63-7e8f-4a54-a85b-9da761419bd9" containerName="console"
Sep 09 20:43:30.845605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845509    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b29c7d63-7e8f-4a54-a85b-9da761419bd9" containerName="console"
Sep 09 20:43:30.845605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845583    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="158cd735-a3e3-4c88-bbad-0afcb177aff9" containerName="registry"
Sep 09 20:43:30.845605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845596    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="970cf7e5-02e7-40a7-9969-0abcff634572" containerName="console"
Sep 09 20:43:30.845605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.845608    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b29c7d63-7e8f-4a54-a85b-9da761419bd9" containerName="console"
Sep 09 20:43:30.849670 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.849654    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:30.852451 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.852407    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 09 20:43:30.852451 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.852435    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ppsvs\""
Sep 09 20:43:30.852632 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.852480    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 09 20:43:30.852632 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.852414    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 09 20:43:30.852715 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.852676    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 09 20:43:30.852782 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.852767    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 09 20:43:30.859055 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.859034    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 09 20:43:30.861171 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.861153    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b98474b9-4mn47"]
Sep 09 20:43:30.937592 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.937559    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-secret-telemeter-client\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:30.937592 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.937602    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:30.937850 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.937626    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a597d9-691a-438e-8913-947d5a420526-serving-certs-ca-bundle\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:30.937850 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.937697    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-federate-client-tls\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:30.937850 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.937741    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1a597d9-691a-438e-8913-947d5a420526-metrics-client-ca\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:30.937850 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.937812    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-telemeter-client-tls\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:30.938037 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.937858    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvlsh\" (UniqueName: \"kubernetes.io/projected/f1a597d9-691a-438e-8913-947d5a420526-kube-api-access-wvlsh\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:30.938037 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:30.937885    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a597d9-691a-438e-8913-947d5a420526-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.039169 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.039139    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a597d9-691a-438e-8913-947d5a420526-serving-certs-ca-bundle\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.039316 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.039174    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-federate-client-tls\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.039316 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.039195    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1a597d9-691a-438e-8913-947d5a420526-metrics-client-ca\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.039316 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.039224    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-telemeter-client-tls\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.039316 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.039264    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvlsh\" (UniqueName: \"kubernetes.io/projected/f1a597d9-691a-438e-8913-947d5a420526-kube-api-access-wvlsh\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.039316 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.039287    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a597d9-691a-438e-8913-947d5a420526-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.039316 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.039306    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-secret-telemeter-client\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.039600 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.039339    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.040004 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.039976    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a597d9-691a-438e-8913-947d5a420526-serving-certs-ca-bundle\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.040375 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.040064    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1a597d9-691a-438e-8913-947d5a420526-metrics-client-ca\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.040375 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.040206    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a597d9-691a-438e-8913-947d5a420526-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.041976 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.041953    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-federate-client-tls\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.042063 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.042006    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.042105 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.042061    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-telemeter-client-tls\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.042136 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.042104    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f1a597d9-691a-438e-8913-947d5a420526-secret-telemeter-client\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.048060 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.048041    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvlsh\" (UniqueName: \"kubernetes.io/projected/f1a597d9-691a-438e-8913-947d5a420526-kube-api-access-wvlsh\") pod \"telemeter-client-7b98474b9-4mn47\" (UID: \"f1a597d9-691a-438e-8913-947d5a420526\") " pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.159283 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.159234    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47"
Sep 09 20:43:31.436518 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:31.436496    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b98474b9-4mn47"]
Sep 09 20:43:31.438835 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:43:31.438810    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a597d9_691a_438e_8913_947d5a420526.slice/crio-b6621ba7c01d56796717444f3661e4db519e9d40c51660dc92b75461c227949a WatchSource:0}: Error finding container b6621ba7c01d56796717444f3661e4db519e9d40c51660dc92b75461c227949a: Status 404 returned error can't find the container with id b6621ba7c01d56796717444f3661e4db519e9d40c51660dc92b75461c227949a
Sep 09 20:43:32.299106 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:32.299060    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47" event={"ID":"f1a597d9-691a-438e-8913-947d5a420526","Type":"ContainerStarted","Data":"b6621ba7c01d56796717444f3661e4db519e9d40c51660dc92b75461c227949a"}
Sep 09 20:43:34.309341 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.309303    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47" event={"ID":"f1a597d9-691a-438e-8913-947d5a420526","Type":"ContainerStarted","Data":"99e4242e02c4c6ee2ae91792891986450099d4950251c6316b0356e017ea8a56"}
Sep 09 20:43:34.309728 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.309368    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47" event={"ID":"f1a597d9-691a-438e-8913-947d5a420526","Type":"ContainerStarted","Data":"2bafa5b760e5606e44847eebe4d66ada2d3cc5cc34c13c3afd5ae50e48dea76d"}
Sep 09 20:43:34.309728 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.309398    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47" event={"ID":"f1a597d9-691a-438e-8913-947d5a420526","Type":"ContainerStarted","Data":"6d5c7acea055870ca0f0c8d38ee06f46d76e34aab8d473c8a2ed735e1c2b9eab"}
Sep 09 20:43:34.331333 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.331285    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b98474b9-4mn47" podStartSLOduration=1.915123598 podStartE2EDuration="4.331270263s" totalImagesPullingTime="2.416146665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:43:34.32898404 +0000 UTC m=+173.385521196" watchObservedRunningTime="2026-09-09 20:43:34.331270263 +0000 UTC m=+173.387807422"
Sep 09 20:43:34.414536 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.414500    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8f4bc697d-fpnl6"]
Sep 09 20:43:34.417075 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.417059    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.426805 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.426780    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f4bc697d-fpnl6"]
Sep 09 20:43:34.465239 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.465208    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8prv\" (UniqueName: \"kubernetes.io/projected/2e489fff-390d-4a73-8ba6-ceac1556bf8d-kube-api-access-k8prv\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.465366 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.465247    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-serving-cert\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.465366 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.465276    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-trusted-ca-bundle\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.465483 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.465375    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-oauth-serving-cert\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.465483 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.465420    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-service-ca\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.465483 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.465469    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-oauth-config\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.465599 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.465495    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-config\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.566563 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.566472    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-oauth-serving-cert\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.566563 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.566524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-service-ca\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.566563 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.566546    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-oauth-config\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.566563 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.566560    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-config\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.566859 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.566601    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8prv\" (UniqueName: \"kubernetes.io/projected/2e489fff-390d-4a73-8ba6-ceac1556bf8d-kube-api-access-k8prv\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.566859 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.566625    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-serving-cert\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.566859 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.566649    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-trusted-ca-bundle\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.567354 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.567331    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-service-ca\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.567438 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.567355    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-oauth-serving-cert\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.567579 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.567557    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-config\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.568074 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.568052    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-trusted-ca-bundle\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.569208 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.569188    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-serving-cert\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.569290 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.569228    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-oauth-config\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.576553 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.576532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8prv\" (UniqueName: \"kubernetes.io/projected/2e489fff-390d-4a73-8ba6-ceac1556bf8d-kube-api-access-k8prv\") pod \"console-8f4bc697d-fpnl6\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") " pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.726846 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.726809    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:34.995106 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:34.995025    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f4bc697d-fpnl6"]
Sep 09 20:43:35.003336 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:43:35.003307    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e489fff_390d_4a73_8ba6_ceac1556bf8d.slice/crio-5259ef9e77b85b6e85cd6b945ca0c6abe7c38cc690618ed6bc4f34c768b1be15 WatchSource:0}: Error finding container 5259ef9e77b85b6e85cd6b945ca0c6abe7c38cc690618ed6bc4f34c768b1be15: Status 404 returned error can't find the container with id 5259ef9e77b85b6e85cd6b945ca0c6abe7c38cc690618ed6bc4f34c768b1be15
Sep 09 20:43:35.315921 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:35.315870    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f4bc697d-fpnl6" event={"ID":"2e489fff-390d-4a73-8ba6-ceac1556bf8d","Type":"ContainerStarted","Data":"beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95"}
Sep 09 20:43:35.316256 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:35.315951    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f4bc697d-fpnl6" event={"ID":"2e489fff-390d-4a73-8ba6-ceac1556bf8d","Type":"ContainerStarted","Data":"5259ef9e77b85b6e85cd6b945ca0c6abe7c38cc690618ed6bc4f34c768b1be15"}
Sep 09 20:43:35.334071 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:35.334018    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8f4bc697d-fpnl6" podStartSLOduration=1.333999816 podStartE2EDuration="1.333999816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:43:35.331809578 +0000 UTC m=+174.388346732" watchObservedRunningTime="2026-09-09 20:43:35.333999816 +0000 UTC m=+174.390536959"
Sep 09 20:43:44.727048 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:44.727005    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:44.727048 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:44.727073    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:44.731828 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:44.731803    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:45.362812 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.362779    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:43:45.400560 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.400525    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d78f47c9d-c496v"]
Sep 09 20:43:45.470276 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.470247    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56659c864-tpdsv"]
Sep 09 20:43:45.473452 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.473432    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.491638 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.491610    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56659c864-tpdsv"]
Sep 09 20:43:45.559734 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.559701    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-oauth-serving-cert\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.559934 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.559764    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-serving-cert\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.559934 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.559825    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-trusted-ca-bundle\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.559934 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.559839    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmgwg\" (UniqueName: \"kubernetes.io/projected/b4345c26-0733-4af8-8d7b-3228c7fc4250-kube-api-access-tmgwg\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.559934 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.559866    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-oauth-config\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.560151 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.559971    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-config\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.560151 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.560018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-service-ca\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.661125 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.661026    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-serving-cert\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.661125 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.661089    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-trusted-ca-bundle\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.661125 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.661105    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmgwg\" (UniqueName: \"kubernetes.io/projected/b4345c26-0733-4af8-8d7b-3228c7fc4250-kube-api-access-tmgwg\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.661403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.661130    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-oauth-config\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.661403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.661144    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-config\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.661403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.661168    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-service-ca\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.661403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.661196    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-oauth-serving-cert\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.662115 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.662087    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-service-ca\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.662246 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.662087    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-oauth-serving-cert\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.662246 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.662098    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-config\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.662380 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.662355    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-trusted-ca-bundle\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.663743 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.663719    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-serving-cert\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.663833 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.663760    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-oauth-config\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.669494 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.669476    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmgwg\" (UniqueName: \"kubernetes.io/projected/b4345c26-0733-4af8-8d7b-3228c7fc4250-kube-api-access-tmgwg\") pod \"console-56659c864-tpdsv\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") " pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:45.782146 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:45.782107    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:46.055975 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:46.055947    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56659c864-tpdsv"]
Sep 09 20:43:46.058282 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:43:46.058247    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4345c26_0733_4af8_8d7b_3228c7fc4250.slice/crio-161dee9c13952ab45f5affa73960db2949726b05466a1c67af2d9329cac6e51c WatchSource:0}: Error finding container 161dee9c13952ab45f5affa73960db2949726b05466a1c67af2d9329cac6e51c: Status 404 returned error can't find the container with id 161dee9c13952ab45f5affa73960db2949726b05466a1c67af2d9329cac6e51c
Sep 09 20:43:46.365267 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:46.365173    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56659c864-tpdsv" event={"ID":"b4345c26-0733-4af8-8d7b-3228c7fc4250","Type":"ContainerStarted","Data":"e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e"}
Sep 09 20:43:46.365267 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:46.365230    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56659c864-tpdsv" event={"ID":"b4345c26-0733-4af8-8d7b-3228c7fc4250","Type":"ContainerStarted","Data":"161dee9c13952ab45f5affa73960db2949726b05466a1c67af2d9329cac6e51c"}
Sep 09 20:43:46.382292 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:46.382248    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56659c864-tpdsv" podStartSLOduration=1.3822315760000001 podStartE2EDuration="1.382231576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:43:46.381723526 +0000 UTC m=+185.438260672" watchObservedRunningTime="2026-09-09 20:43:46.382231576 +0000 UTC m=+185.438768718"
Sep 09 20:43:55.783157 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:55.783113    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:55.783711 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:55.783185    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:55.788106 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:55.788084    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:56.411367 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:56.411342    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:43:56.456045 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:43:56.456009    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f4bc697d-fpnl6"]
Sep 09 20:44:10.422105 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.422057    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d78f47c9d-c496v" podUID="ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" containerName="console" containerID="cri-o://0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190" gracePeriod=15
Sep 09 20:44:10.667030 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.666999    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:44:10.672556 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.672506    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-serving-cert\") pod \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") "
Sep 09 20:44:10.672556 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.672546    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-service-ca\") pod \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") "
Sep 09 20:44:10.672733 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.672576    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggvzt\" (UniqueName: \"kubernetes.io/projected/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-kube-api-access-ggvzt\") pod \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") "
Sep 09 20:44:10.672733 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.672608    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-config\") pod \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") "
Sep 09 20:44:10.672733 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.672646    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-oauth-serving-cert\") pod \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") "
Sep 09 20:44:10.672733 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.672667    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-oauth-config\") pod \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") "
Sep 09 20:44:10.672733 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.672695    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-trusted-ca-bundle\") pod \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\" (UID: \"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89\") "
Sep 09 20:44:10.673047 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.673018    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" (UID: "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:10.673223 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.673152    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" (UID: "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:10.673223 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.673219    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" (UID: "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:10.673475 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.673328    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-config" (OuterVolumeSpecName: "console-config") pod "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" (UID: "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:10.674820 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.674799    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" (UID: "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:44:10.674820 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.674801    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-kube-api-access-ggvzt" (OuterVolumeSpecName: "kube-api-access-ggvzt") pod "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" (UID: "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89"). InnerVolumeSpecName "kube-api-access-ggvzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:44:10.675128 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.675103    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" (UID: "ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:44:10.773303 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.773269    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-oauth-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:10.773303 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.773295    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-trusted-ca-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:10.773303 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.773304    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:10.773537 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.773314    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:10.773537 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.773323    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggvzt\" (UniqueName: \"kubernetes.io/projected/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-kube-api-access-ggvzt\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:10.773537 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.773331    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-console-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:10.773537 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:10.773340    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89-oauth-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:11.471682 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:11.471654    2555 generic.go:356] "Generic (PLEG): container finished" podID="ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" containerID="0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190" exitCode=0
Sep 09 20:44:11.472043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:11.471702    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d78f47c9d-c496v"
Sep 09 20:44:11.472043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:11.471728    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d78f47c9d-c496v" event={"ID":"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89","Type":"ContainerDied","Data":"0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190"}
Sep 09 20:44:11.472043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:11.471773    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d78f47c9d-c496v" event={"ID":"ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89","Type":"ContainerDied","Data":"a9e3741ac6e50ce889e52fef3a71955924cec093e9717f520d682e978e861e66"}
Sep 09 20:44:11.472043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:11.471794    2555 scope.go:117] "RemoveContainer" containerID="0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190"
Sep 09 20:44:11.480037 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:11.479994    2555 scope.go:117] "RemoveContainer" containerID="0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190"
Sep 09 20:44:11.480295 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:44:11.480279    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190\": container with ID starting with 0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190 not found: ID does not exist" containerID="0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190"
Sep 09 20:44:11.480340 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:11.480303    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190"} err="failed to get container status \"0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190\": rpc error: code = NotFound desc = could not find container \"0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190\": container with ID starting with 0e41f7ad3693fae0f3a51e8e5febaf1f3b06eddcc0db70c716310fefef195190 not found: ID does not exist"
Sep 09 20:44:11.488581 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:11.488561    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d78f47c9d-c496v"]
Sep 09 20:44:11.494359 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:11.494341    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d78f47c9d-c496v"]
Sep 09 20:44:13.429209 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:13.429177    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" path="/var/lib/kubelet/pods/ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89/volumes"
Sep 09 20:44:21.476913 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.476845    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8f4bc697d-fpnl6" podUID="2e489fff-390d-4a73-8ba6-ceac1556bf8d" containerName="console" containerID="cri-o://beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95" gracePeriod=15
Sep 09 20:44:21.721257 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.721234    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:44:21.754182 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754111    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-trusted-ca-bundle\") pod \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") "
Sep 09 20:44:21.754182 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754147    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-serving-cert\") pod \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") "
Sep 09 20:44:21.754382 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754182    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-oauth-config\") pod \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") "
Sep 09 20:44:21.754382 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754312    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-service-ca\") pod \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") "
Sep 09 20:44:21.754382 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754376    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-config\") pod \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") "
Sep 09 20:44:21.754544 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754409    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8prv\" (UniqueName: \"kubernetes.io/projected/2e489fff-390d-4a73-8ba6-ceac1556bf8d-kube-api-access-k8prv\") pod \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") "
Sep 09 20:44:21.754544 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754451    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-oauth-serving-cert\") pod \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\" (UID: \"2e489fff-390d-4a73-8ba6-ceac1556bf8d\") "
Sep 09 20:44:21.754738 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754660    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2e489fff-390d-4a73-8ba6-ceac1556bf8d" (UID: "2e489fff-390d-4a73-8ba6-ceac1556bf8d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:21.754738 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754667    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-service-ca" (OuterVolumeSpecName: "service-ca") pod "2e489fff-390d-4a73-8ba6-ceac1556bf8d" (UID: "2e489fff-390d-4a73-8ba6-ceac1556bf8d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:21.754881 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.754736    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-trusted-ca-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:21.755083 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.755032    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-config" (OuterVolumeSpecName: "console-config") pod "2e489fff-390d-4a73-8ba6-ceac1556bf8d" (UID: "2e489fff-390d-4a73-8ba6-ceac1556bf8d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:21.755323 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.755293    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2e489fff-390d-4a73-8ba6-ceac1556bf8d" (UID: "2e489fff-390d-4a73-8ba6-ceac1556bf8d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:21.756503 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.756471    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2e489fff-390d-4a73-8ba6-ceac1556bf8d" (UID: "2e489fff-390d-4a73-8ba6-ceac1556bf8d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:44:21.756611 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.756562    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2e489fff-390d-4a73-8ba6-ceac1556bf8d" (UID: "2e489fff-390d-4a73-8ba6-ceac1556bf8d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:44:21.756611 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.756594    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e489fff-390d-4a73-8ba6-ceac1556bf8d-kube-api-access-k8prv" (OuterVolumeSpecName: "kube-api-access-k8prv") pod "2e489fff-390d-4a73-8ba6-ceac1556bf8d" (UID: "2e489fff-390d-4a73-8ba6-ceac1556bf8d"). InnerVolumeSpecName "kube-api-access-k8prv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:44:21.855851 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.855812    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:21.855851 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.855845    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8prv\" (UniqueName: \"kubernetes.io/projected/2e489fff-390d-4a73-8ba6-ceac1556bf8d-kube-api-access-k8prv\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:21.855851 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.855855    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-oauth-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:21.855851 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.855864    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:21.856128 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.855872    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e489fff-390d-4a73-8ba6-ceac1556bf8d-console-oauth-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:21.856128 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:21.855880    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e489fff-390d-4a73-8ba6-ceac1556bf8d-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:44:22.521977 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:22.521933    2555 generic.go:356] "Generic (PLEG): container finished" podID="2e489fff-390d-4a73-8ba6-ceac1556bf8d" containerID="beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95" exitCode=0
Sep 09 20:44:22.522356 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:22.522019    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f4bc697d-fpnl6"
Sep 09 20:44:22.522356 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:22.522062    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f4bc697d-fpnl6" event={"ID":"2e489fff-390d-4a73-8ba6-ceac1556bf8d","Type":"ContainerDied","Data":"beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95"}
Sep 09 20:44:22.522356 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:22.522110    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f4bc697d-fpnl6" event={"ID":"2e489fff-390d-4a73-8ba6-ceac1556bf8d","Type":"ContainerDied","Data":"5259ef9e77b85b6e85cd6b945ca0c6abe7c38cc690618ed6bc4f34c768b1be15"}
Sep 09 20:44:22.522356 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:22.522135    2555 scope.go:117] "RemoveContainer" containerID="beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95"
Sep 09 20:44:22.530995 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:22.530983    2555 scope.go:117] "RemoveContainer" containerID="beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95"
Sep 09 20:44:22.531264 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:44:22.531244    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95\": container with ID starting with beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95 not found: ID does not exist" containerID="beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95"
Sep 09 20:44:22.531332 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:22.531277    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95"} err="failed to get container status \"beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95\": rpc error: code = NotFound desc = could not find container \"beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95\": container with ID starting with beb16d8aa837abe31913842fddf3ddcfb948b22b3620de93ab64d0d1ffd22f95 not found: ID does not exist"
Sep 09 20:44:22.555305 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:22.555280    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f4bc697d-fpnl6"]
Sep 09 20:44:22.559602 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:22.559580    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8f4bc697d-fpnl6"]
Sep 09 20:44:23.429218 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:44:23.429186    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e489fff-390d-4a73-8ba6-ceac1556bf8d" path="/var/lib/kubelet/pods/2e489fff-390d-4a73-8ba6-ceac1556bf8d/volumes"
Sep 09 20:45:09.355296 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.355215    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"]
Sep 09 20:45:09.355769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.355528    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" containerName="console"
Sep 09 20:45:09.355769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.355539    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" containerName="console"
Sep 09 20:45:09.355769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.355559    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e489fff-390d-4a73-8ba6-ceac1556bf8d" containerName="console"
Sep 09 20:45:09.355769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.355565    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e489fff-390d-4a73-8ba6-ceac1556bf8d" containerName="console"
Sep 09 20:45:09.355769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.355627    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e489fff-390d-4a73-8ba6-ceac1556bf8d" containerName="console"
Sep 09 20:45:09.355769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.355636    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed84fbef-3bd6-4f1a-b5a5-2dc3d22c0e89" containerName="console"
Sep 09 20:45:09.357943 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.357891    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.360586 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.360560    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 20:45:09.361340 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.361325    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 20:45:09.361390 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.361326    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wdgsj\""
Sep 09 20:45:09.369189 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.369164    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"]
Sep 09 20:45:09.458755 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.458721    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bslx2\" (UniqueName: \"kubernetes.io/projected/16073ee0-1b47-4b8a-b266-5025a1884760-kube-api-access-bslx2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.458755 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.458760    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.459038 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.458787    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.560351 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.560311    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bslx2\" (UniqueName: \"kubernetes.io/projected/16073ee0-1b47-4b8a-b266-5025a1884760-kube-api-access-bslx2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.560496 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.560389    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.560496 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.560421    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.560762 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.560743    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.560814 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.560782    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.568845 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.568824    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bslx2\" (UniqueName: \"kubernetes.io/projected/16073ee0-1b47-4b8a-b266-5025a1884760-kube-api-access-bslx2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.667742 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.667653    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:09.942795 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:09.942718    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"]
Sep 09 20:45:09.945973 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:45:09.945943    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16073ee0_1b47_4b8a_b266_5025a1884760.slice/crio-219ab44af5acfaf52eb18239150b8fe57158180960af90642440fcf7664d4032 WatchSource:0}: Error finding container 219ab44af5acfaf52eb18239150b8fe57158180960af90642440fcf7664d4032: Status 404 returned error can't find the container with id 219ab44af5acfaf52eb18239150b8fe57158180960af90642440fcf7664d4032
Sep 09 20:45:10.725179 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:10.725139    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd" event={"ID":"16073ee0-1b47-4b8a-b266-5025a1884760","Type":"ContainerStarted","Data":"219ab44af5acfaf52eb18239150b8fe57158180960af90642440fcf7664d4032"}
Sep 09 20:45:17.755719 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:17.755676    2555 generic.go:356] "Generic (PLEG): container finished" podID="16073ee0-1b47-4b8a-b266-5025a1884760" containerID="d1d97eacac3331ce87f601b4a17514fecfdef4bdae91756262dc28d274e24239" exitCode=0
Sep 09 20:45:17.756295 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:17.755750    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd" event={"ID":"16073ee0-1b47-4b8a-b266-5025a1884760","Type":"ContainerDied","Data":"d1d97eacac3331ce87f601b4a17514fecfdef4bdae91756262dc28d274e24239"}
Sep 09 20:45:20.771628 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:20.771590    2555 generic.go:356] "Generic (PLEG): container finished" podID="16073ee0-1b47-4b8a-b266-5025a1884760" containerID="9b23ed7dd53624acbe25578b5591454aedc5023f419f8e7b32e263af0ba5650a" exitCode=0
Sep 09 20:45:20.772052 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:20.771671    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd" event={"ID":"16073ee0-1b47-4b8a-b266-5025a1884760","Type":"ContainerDied","Data":"9b23ed7dd53624acbe25578b5591454aedc5023f419f8e7b32e263af0ba5650a"}
Sep 09 20:45:28.812311 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:28.812269    2555 generic.go:356] "Generic (PLEG): container finished" podID="16073ee0-1b47-4b8a-b266-5025a1884760" containerID="83f43910f52a65bcd45d929af0b61448c74df775da7caed81528d529a8fc6f1d" exitCode=0
Sep 09 20:45:28.812688 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:28.812321    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd" event={"ID":"16073ee0-1b47-4b8a-b266-5025a1884760","Type":"ContainerDied","Data":"83f43910f52a65bcd45d929af0b61448c74df775da7caed81528d529a8fc6f1d"}
Sep 09 20:45:29.960878 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:29.960846    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:30.048547 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.048510    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-util\") pod \"16073ee0-1b47-4b8a-b266-5025a1884760\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") "
Sep 09 20:45:30.048748 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.048616    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bslx2\" (UniqueName: \"kubernetes.io/projected/16073ee0-1b47-4b8a-b266-5025a1884760-kube-api-access-bslx2\") pod \"16073ee0-1b47-4b8a-b266-5025a1884760\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") "
Sep 09 20:45:30.048748 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.048641    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-bundle\") pod \"16073ee0-1b47-4b8a-b266-5025a1884760\" (UID: \"16073ee0-1b47-4b8a-b266-5025a1884760\") "
Sep 09 20:45:30.049398 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.049361    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-bundle" (OuterVolumeSpecName: "bundle") pod "16073ee0-1b47-4b8a-b266-5025a1884760" (UID: "16073ee0-1b47-4b8a-b266-5025a1884760"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:45:30.051074 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.051049    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16073ee0-1b47-4b8a-b266-5025a1884760-kube-api-access-bslx2" (OuterVolumeSpecName: "kube-api-access-bslx2") pod "16073ee0-1b47-4b8a-b266-5025a1884760" (UID: "16073ee0-1b47-4b8a-b266-5025a1884760"). InnerVolumeSpecName "kube-api-access-bslx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:45:30.052881 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.052856    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-util" (OuterVolumeSpecName: "util") pod "16073ee0-1b47-4b8a-b266-5025a1884760" (UID: "16073ee0-1b47-4b8a-b266-5025a1884760"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:45:30.149486 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.149393    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-util\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:45:30.149486 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.149427    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bslx2\" (UniqueName: \"kubernetes.io/projected/16073ee0-1b47-4b8a-b266-5025a1884760-kube-api-access-bslx2\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:45:30.149486 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.149436    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16073ee0-1b47-4b8a-b266-5025a1884760-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:45:30.827895 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.827857    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd" event={"ID":"16073ee0-1b47-4b8a-b266-5025a1884760","Type":"ContainerDied","Data":"219ab44af5acfaf52eb18239150b8fe57158180960af90642440fcf7664d4032"}
Sep 09 20:45:30.827895 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.827891    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gggqd"
Sep 09 20:45:30.828184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:30.827955    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="219ab44af5acfaf52eb18239150b8fe57158180960af90642440fcf7664d4032"
Sep 09 20:45:38.135027 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.134989    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"]
Sep 09 20:45:38.135403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.135297    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16073ee0-1b47-4b8a-b266-5025a1884760" containerName="pull"
Sep 09 20:45:38.135403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.135309    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="16073ee0-1b47-4b8a-b266-5025a1884760" containerName="pull"
Sep 09 20:45:38.135403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.135331    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16073ee0-1b47-4b8a-b266-5025a1884760" containerName="util"
Sep 09 20:45:38.135403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.135337    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="16073ee0-1b47-4b8a-b266-5025a1884760" containerName="util"
Sep 09 20:45:38.135403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.135347    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16073ee0-1b47-4b8a-b266-5025a1884760" containerName="extract"
Sep 09 20:45:38.135403 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.135352    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="16073ee0-1b47-4b8a-b266-5025a1884760" containerName="extract"
Sep 09 20:45:38.135587 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.135406    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="16073ee0-1b47-4b8a-b266-5025a1884760" containerName="extract"
Sep 09 20:45:38.137503 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.137479    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"
Sep 09 20:45:38.140468 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.140443    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 09 20:45:38.140606 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.140493    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:45:38.140771 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.140754    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5c462\""
Sep 09 20:45:38.155578 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.155551    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"]
Sep 09 20:45:38.216371 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.216332    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sffkn\" (UniqueName: \"kubernetes.io/projected/c5e5cc84-4d8d-4c64-8f26-f3b78830e77e-kube-api-access-sffkn\") pod \"cert-manager-operator-controller-manager-55c444bf86-7tnv5\" (UID: \"c5e5cc84-4d8d-4c64-8f26-f3b78830e77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"
Sep 09 20:45:38.216560 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.216386    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e5cc84-4d8d-4c64-8f26-f3b78830e77e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7tnv5\" (UID: \"c5e5cc84-4d8d-4c64-8f26-f3b78830e77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"
Sep 09 20:45:38.317131 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.317097    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sffkn\" (UniqueName: \"kubernetes.io/projected/c5e5cc84-4d8d-4c64-8f26-f3b78830e77e-kube-api-access-sffkn\") pod \"cert-manager-operator-controller-manager-55c444bf86-7tnv5\" (UID: \"c5e5cc84-4d8d-4c64-8f26-f3b78830e77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"
Sep 09 20:45:38.317298 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.317143    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e5cc84-4d8d-4c64-8f26-f3b78830e77e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7tnv5\" (UID: \"c5e5cc84-4d8d-4c64-8f26-f3b78830e77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"
Sep 09 20:45:38.317507 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.317474    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e5cc84-4d8d-4c64-8f26-f3b78830e77e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7tnv5\" (UID: \"c5e5cc84-4d8d-4c64-8f26-f3b78830e77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"
Sep 09 20:45:38.328768 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.328733    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sffkn\" (UniqueName: \"kubernetes.io/projected/c5e5cc84-4d8d-4c64-8f26-f3b78830e77e-kube-api-access-sffkn\") pod \"cert-manager-operator-controller-manager-55c444bf86-7tnv5\" (UID: \"c5e5cc84-4d8d-4c64-8f26-f3b78830e77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"
Sep 09 20:45:38.447462 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.447358    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"
Sep 09 20:45:38.748557 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.748534    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5"]
Sep 09 20:45:38.751743 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:45:38.751709    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e5cc84_4d8d_4c64_8f26_f3b78830e77e.slice/crio-87db6d15d3c714e10c8210a2281e10447a56b11bc3d1625701ecbf8c17e9fb6c WatchSource:0}: Error finding container 87db6d15d3c714e10c8210a2281e10447a56b11bc3d1625701ecbf8c17e9fb6c: Status 404 returned error can't find the container with id 87db6d15d3c714e10c8210a2281e10447a56b11bc3d1625701ecbf8c17e9fb6c
Sep 09 20:45:38.861534 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:38.861501    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5" event={"ID":"c5e5cc84-4d8d-4c64-8f26-f3b78830e77e","Type":"ContainerStarted","Data":"87db6d15d3c714e10c8210a2281e10447a56b11bc3d1625701ecbf8c17e9fb6c"}
Sep 09 20:45:40.872259 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:40.872221    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5" event={"ID":"c5e5cc84-4d8d-4c64-8f26-f3b78830e77e","Type":"ContainerStarted","Data":"8d0bab62945fdd5dd2cff9c5a640fbabe6035e5d8f5347255c1550a017edf096"}
Sep 09 20:45:40.918138 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:40.918084    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7tnv5" podStartSLOduration=1.450487563 podStartE2EDuration="2.918064795s" totalImagesPullingTime="1.467577232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:45:40.916302795 +0000 UTC m=+299.972839938" watchObservedRunningTime="2026-09-09 20:45:40.918064795 +0000 UTC m=+299.974601936"
Sep 09 20:45:41.331753 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:41.331725    2555 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 20:45:41.998647 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:41.998610    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"]
Sep 09 20:45:42.001073 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.001056    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.004518 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.004495    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 20:45:42.004649 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.004500    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 20:45:42.005544 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.005528    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wdgsj\""
Sep 09 20:45:42.014695 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.014666    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"]
Sep 09 20:45:42.153249 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.153210    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.153443 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.153259    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfmrl\" (UniqueName: \"kubernetes.io/projected/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-kube-api-access-nfmrl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.153443 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.153370    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.254456 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.254353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.254456 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.254412    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.254456 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.254441    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfmrl\" (UniqueName: \"kubernetes.io/projected/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-kube-api-access-nfmrl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.254770 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.254751    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.254836 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.254818    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.271977 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.271946    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfmrl\" (UniqueName: \"kubernetes.io/projected/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-kube-api-access-nfmrl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.310911 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.310862    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:42.488951 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.488911    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lqjp5"]
Sep 09 20:45:42.491370 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.491354    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:42.495837 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.495807    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 20:45:42.496064 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.496044    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 20:45:42.507645 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.507579    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lqjp5"]
Sep 09 20:45:42.584548 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.584516    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"]
Sep 09 20:45:42.587937 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:45:42.587881    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdcc71d_a2f7_4164_808a_33d0c04b15f2.slice/crio-c6b93fb581e90eb564be65f1c162afb284ab06704e6fa48a7502e9c44fc95506 WatchSource:0}: Error finding container c6b93fb581e90eb564be65f1c162afb284ab06704e6fa48a7502e9c44fc95506: Status 404 returned error can't find the container with id c6b93fb581e90eb564be65f1c162afb284ab06704e6fa48a7502e9c44fc95506
Sep 09 20:45:42.658443 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.658391    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jv58\" (UniqueName: \"kubernetes.io/projected/59bacfc6-ce47-4644-a392-792790b902ed-kube-api-access-6jv58\") pod \"cert-manager-webhook-6486ffd997-lqjp5\" (UID: \"59bacfc6-ce47-4644-a392-792790b902ed\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:42.658597 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.658472    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59bacfc6-ce47-4644-a392-792790b902ed-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lqjp5\" (UID: \"59bacfc6-ce47-4644-a392-792790b902ed\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:42.759683 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.759596    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59bacfc6-ce47-4644-a392-792790b902ed-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lqjp5\" (UID: \"59bacfc6-ce47-4644-a392-792790b902ed\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:42.759834 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.759692    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jv58\" (UniqueName: \"kubernetes.io/projected/59bacfc6-ce47-4644-a392-792790b902ed-kube-api-access-6jv58\") pod \"cert-manager-webhook-6486ffd997-lqjp5\" (UID: \"59bacfc6-ce47-4644-a392-792790b902ed\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:42.776354 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.776321    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jv58\" (UniqueName: \"kubernetes.io/projected/59bacfc6-ce47-4644-a392-792790b902ed-kube-api-access-6jv58\") pod \"cert-manager-webhook-6486ffd997-lqjp5\" (UID: \"59bacfc6-ce47-4644-a392-792790b902ed\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:42.776354 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.776341    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59bacfc6-ce47-4644-a392-792790b902ed-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lqjp5\" (UID: \"59bacfc6-ce47-4644-a392-792790b902ed\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:42.814890 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.814847    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:42.883879 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.883849    2555 generic.go:356] "Generic (PLEG): container finished" podID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerID="6ce7ae5df2f04133532de271e9e54d4ae1ab8525b90e174b850d41837c31b769" exitCode=0
Sep 09 20:45:42.884070 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.883944    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws" event={"ID":"0cdcc71d-a2f7-4164-808a-33d0c04b15f2","Type":"ContainerDied","Data":"6ce7ae5df2f04133532de271e9e54d4ae1ab8525b90e174b850d41837c31b769"}
Sep 09 20:45:42.884070 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.883992    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws" event={"ID":"0cdcc71d-a2f7-4164-808a-33d0c04b15f2","Type":"ContainerStarted","Data":"c6b93fb581e90eb564be65f1c162afb284ab06704e6fa48a7502e9c44fc95506"}
Sep 09 20:45:42.885050 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:42.885033    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:45:43.090430 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:43.090392    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lqjp5"]
Sep 09 20:45:43.093348 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:45:43.093321    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59bacfc6_ce47_4644_a392_792790b902ed.slice/crio-2a9c6a572c3cabcc513ab9f1bc30d06750e1cc9b3915512e9d638ef0b6d2a65b WatchSource:0}: Error finding container 2a9c6a572c3cabcc513ab9f1bc30d06750e1cc9b3915512e9d638ef0b6d2a65b: Status 404 returned error can't find the container with id 2a9c6a572c3cabcc513ab9f1bc30d06750e1cc9b3915512e9d638ef0b6d2a65b
Sep 09 20:45:43.892164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:43.892116    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5" event={"ID":"59bacfc6-ce47-4644-a392-792790b902ed","Type":"ContainerStarted","Data":"2a9c6a572c3cabcc513ab9f1bc30d06750e1cc9b3915512e9d638ef0b6d2a65b"}
Sep 09 20:45:44.749606 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:44.749565    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"]
Sep 09 20:45:44.753071 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:44.753030    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"
Sep 09 20:45:44.756833 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:44.756794    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nrbpc\""
Sep 09 20:45:44.770320 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:44.770288    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"]
Sep 09 20:45:44.879362 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:44.879313    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/734f50f1-65ad-4d31-94e8-9367c822c5a3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6qrwd\" (UID: \"734f50f1-65ad-4d31-94e8-9367c822c5a3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"
Sep 09 20:45:44.879546 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:44.879514    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97cr\" (UniqueName: \"kubernetes.io/projected/734f50f1-65ad-4d31-94e8-9367c822c5a3-kube-api-access-f97cr\") pod \"cert-manager-cainjector-559cdd8c87-6qrwd\" (UID: \"734f50f1-65ad-4d31-94e8-9367c822c5a3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"
Sep 09 20:45:44.980802 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:44.980758    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/734f50f1-65ad-4d31-94e8-9367c822c5a3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6qrwd\" (UID: \"734f50f1-65ad-4d31-94e8-9367c822c5a3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"
Sep 09 20:45:44.981000 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:44.980847    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97cr\" (UniqueName: \"kubernetes.io/projected/734f50f1-65ad-4d31-94e8-9367c822c5a3-kube-api-access-f97cr\") pod \"cert-manager-cainjector-559cdd8c87-6qrwd\" (UID: \"734f50f1-65ad-4d31-94e8-9367c822c5a3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"
Sep 09 20:45:45.005981 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:45.005879    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/734f50f1-65ad-4d31-94e8-9367c822c5a3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6qrwd\" (UID: \"734f50f1-65ad-4d31-94e8-9367c822c5a3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"
Sep 09 20:45:45.006122 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:45.005988    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97cr\" (UniqueName: \"kubernetes.io/projected/734f50f1-65ad-4d31-94e8-9367c822c5a3-kube-api-access-f97cr\") pod \"cert-manager-cainjector-559cdd8c87-6qrwd\" (UID: \"734f50f1-65ad-4d31-94e8-9367c822c5a3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"
Sep 09 20:45:45.064927 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:45.064871    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"
Sep 09 20:45:46.253150 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:46.253060    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd"]
Sep 09 20:45:46.261505 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:45:46.261478    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod734f50f1_65ad_4d31_94e8_9367c822c5a3.slice/crio-32992cab45d3ff6713977e84439691ea116c8de68ce919cebcc81d7bd72599e4 WatchSource:0}: Error finding container 32992cab45d3ff6713977e84439691ea116c8de68ce919cebcc81d7bd72599e4: Status 404 returned error can't find the container with id 32992cab45d3ff6713977e84439691ea116c8de68ce919cebcc81d7bd72599e4
Sep 09 20:45:46.909544 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:46.909505    2555 generic.go:356] "Generic (PLEG): container finished" podID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerID="b328c5e4929a8b5bb78d83227eed24cc6eeaa9f6aee9cebd14b81f0409fa0661" exitCode=0
Sep 09 20:45:46.909776 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:46.909587    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws" event={"ID":"0cdcc71d-a2f7-4164-808a-33d0c04b15f2","Type":"ContainerDied","Data":"b328c5e4929a8b5bb78d83227eed24cc6eeaa9f6aee9cebd14b81f0409fa0661"}
Sep 09 20:45:46.911412 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:46.911389    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5" event={"ID":"59bacfc6-ce47-4644-a392-792790b902ed","Type":"ContainerStarted","Data":"fa9d4583c53e9bc1d85d8a72c44a10c72f8a31cbf182ff9faaed7ec90ca254c0"}
Sep 09 20:45:46.911469 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:46.911460    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:46.912967 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:46.912946    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd" event={"ID":"734f50f1-65ad-4d31-94e8-9367c822c5a3","Type":"ContainerStarted","Data":"ac253aaf408fa6cded7b161b11adc87ecec42ea1c35b49544fa7915e332871d9"}
Sep 09 20:45:46.913045 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:46.912972    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd" event={"ID":"734f50f1-65ad-4d31-94e8-9367c822c5a3","Type":"ContainerStarted","Data":"32992cab45d3ff6713977e84439691ea116c8de68ce919cebcc81d7bd72599e4"}
Sep 09 20:45:46.976925 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:46.976847    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5" podStartSLOduration=2.095042761 podStartE2EDuration="4.976822699s" totalImagesPullingTime="2.881779938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:45:46.975760509 +0000 UTC m=+306.032297652" watchObservedRunningTime="2026-09-09 20:45:46.976822699 +0000 UTC m=+306.033359840"
Sep 09 20:45:47.005174 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:47.005096    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6qrwd" podStartSLOduration=3.005072753 podStartE2EDuration="3.005072753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:45:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:45:47.004152936 +0000 UTC m=+306.060690080" watchObservedRunningTime="2026-09-09 20:45:47.005072753 +0000 UTC m=+306.061609896"
Sep 09 20:45:47.920255 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:47.920215    2555 generic.go:356] "Generic (PLEG): container finished" podID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerID="f3b3a4c0b61f8298d891869e7684326fb7e1e1feee385c21ca489cab2bbbc4bd" exitCode=0
Sep 09 20:45:47.920777 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:47.920293    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws" event={"ID":"0cdcc71d-a2f7-4164-808a-33d0c04b15f2","Type":"ContainerDied","Data":"f3b3a4c0b61f8298d891869e7684326fb7e1e1feee385c21ca489cab2bbbc4bd"}
Sep 09 20:45:49.055003 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.054975    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:49.219528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.219429    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfmrl\" (UniqueName: \"kubernetes.io/projected/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-kube-api-access-nfmrl\") pod \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") "
Sep 09 20:45:49.219528 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.219472    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-bundle\") pod \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") "
Sep 09 20:45:49.219766 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.219535    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-util\") pod \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\" (UID: \"0cdcc71d-a2f7-4164-808a-33d0c04b15f2\") "
Sep 09 20:45:49.220011 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.219977    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-bundle" (OuterVolumeSpecName: "bundle") pod "0cdcc71d-a2f7-4164-808a-33d0c04b15f2" (UID: "0cdcc71d-a2f7-4164-808a-33d0c04b15f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:45:49.221787 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.221756    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-kube-api-access-nfmrl" (OuterVolumeSpecName: "kube-api-access-nfmrl") pod "0cdcc71d-a2f7-4164-808a-33d0c04b15f2" (UID: "0cdcc71d-a2f7-4164-808a-33d0c04b15f2"). InnerVolumeSpecName "kube-api-access-nfmrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:45:49.224481 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.224459    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-util" (OuterVolumeSpecName: "util") pod "0cdcc71d-a2f7-4164-808a-33d0c04b15f2" (UID: "0cdcc71d-a2f7-4164-808a-33d0c04b15f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:45:49.320259 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.320222    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-util\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:45:49.320259 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.320252    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfmrl\" (UniqueName: \"kubernetes.io/projected/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-kube-api-access-nfmrl\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:45:49.320259 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.320262    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdcc71d-a2f7-4164-808a-33d0c04b15f2-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:45:49.933546 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.933512    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws" event={"ID":"0cdcc71d-a2f7-4164-808a-33d0c04b15f2","Type":"ContainerDied","Data":"c6b93fb581e90eb564be65f1c162afb284ab06704e6fa48a7502e9c44fc95506"}
Sep 09 20:45:49.933546 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.933543    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgn7ws"
Sep 09 20:45:49.933546 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:49.933560    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6b93fb581e90eb564be65f1c162afb284ab06704e6fa48a7502e9c44fc95506"
Sep 09 20:45:52.923178 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:52.923145    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lqjp5"
Sep 09 20:45:57.517849 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.517814    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"]
Sep 09 20:45:57.518318 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.518182    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerName="pull"
Sep 09 20:45:57.518318 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.518194    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerName="pull"
Sep 09 20:45:57.518318 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.518206    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerName="extract"
Sep 09 20:45:57.518318 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.518212    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerName="extract"
Sep 09 20:45:57.518318 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.518223    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerName="util"
Sep 09 20:45:57.518318 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.518228    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerName="util"
Sep 09 20:45:57.518318 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.518285    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cdcc71d-a2f7-4164-808a-33d0c04b15f2" containerName="extract"
Sep 09 20:45:57.559011 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.558979    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"]
Sep 09 20:45:57.559163 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.559084    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"
Sep 09 20:45:57.571667 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.571641    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 20:45:57.571808 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.571648    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mxhg4\""
Sep 09 20:45:57.571808 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.571649    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:45:57.691801 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.691763    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc990a10-f95f-44d1-8d14-4d002da98c98-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xw4j9\" (UID: \"bc990a10-f95f-44d1-8d14-4d002da98c98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"
Sep 09 20:45:57.691801 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.691806    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjmbv\" (UniqueName: \"kubernetes.io/projected/bc990a10-f95f-44d1-8d14-4d002da98c98-kube-api-access-tjmbv\") pod \"openshift-lws-operator-fd8ccff4c-xw4j9\" (UID: \"bc990a10-f95f-44d1-8d14-4d002da98c98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"
Sep 09 20:45:57.792416 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.792379    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc990a10-f95f-44d1-8d14-4d002da98c98-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xw4j9\" (UID: \"bc990a10-f95f-44d1-8d14-4d002da98c98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"
Sep 09 20:45:57.792584 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.792422    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjmbv\" (UniqueName: \"kubernetes.io/projected/bc990a10-f95f-44d1-8d14-4d002da98c98-kube-api-access-tjmbv\") pod \"openshift-lws-operator-fd8ccff4c-xw4j9\" (UID: \"bc990a10-f95f-44d1-8d14-4d002da98c98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"
Sep 09 20:45:57.792805 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.792784    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc990a10-f95f-44d1-8d14-4d002da98c98-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xw4j9\" (UID: \"bc990a10-f95f-44d1-8d14-4d002da98c98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"
Sep 09 20:45:57.805588 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.805557    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjmbv\" (UniqueName: \"kubernetes.io/projected/bc990a10-f95f-44d1-8d14-4d002da98c98-kube-api-access-tjmbv\") pod \"openshift-lws-operator-fd8ccff4c-xw4j9\" (UID: \"bc990a10-f95f-44d1-8d14-4d002da98c98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"
Sep 09 20:45:57.868982 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:57.868941    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"
Sep 09 20:45:58.194598 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:58.194514    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9"]
Sep 09 20:45:58.197683 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:45:58.197648    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc990a10_f95f_44d1_8d14_4d002da98c98.slice/crio-2a09621c09f6a100dffca1882dcf199dfed114a2e04b4543c2399dd212ea403f WatchSource:0}: Error finding container 2a09621c09f6a100dffca1882dcf199dfed114a2e04b4543c2399dd212ea403f: Status 404 returned error can't find the container with id 2a09621c09f6a100dffca1882dcf199dfed114a2e04b4543c2399dd212ea403f
Sep 09 20:45:58.980081 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:58.980031    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9" event={"ID":"bc990a10-f95f-44d1-8d14-4d002da98c98","Type":"ContainerStarted","Data":"2a09621c09f6a100dffca1882dcf199dfed114a2e04b4543c2399dd212ea403f"}
Sep 09 20:45:59.987398 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:45:59.987359    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9" event={"ID":"bc990a10-f95f-44d1-8d14-4d002da98c98","Type":"ContainerStarted","Data":"a4cd6108615896259d725c5b3d5fc9b018be941aaa7f16e373d3cf5ea82cae19"}
Sep 09 20:46:00.019459 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:00.019388    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xw4j9" podStartSLOduration=1.2987506149999999 podStartE2EDuration="3.019363141s" totalImagesPullingTime="1.720612526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:46:00.017723704 +0000 UTC m=+319.074260848" watchObservedRunningTime="2026-09-09 20:46:00.019363141 +0000 UTC m=+319.075900284"
Sep 09 20:46:02.395088 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.395052    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"]
Sep 09 20:46:02.397770 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.397751    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.401150 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.401127    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 20:46:02.402173 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.402148    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wdgsj\""
Sep 09 20:46:02.402173 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.402149    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 20:46:02.414754 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.414721    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"]
Sep 09 20:46:02.438796 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.438753    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.439059 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.438809    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9b2p\" (UniqueName: \"kubernetes.io/projected/abb2f203-5732-403a-acb9-3faf170d5256-kube-api-access-f9b2p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.439059 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.438836    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.539832 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.539792    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9b2p\" (UniqueName: \"kubernetes.io/projected/abb2f203-5732-403a-acb9-3faf170d5256-kube-api-access-f9b2p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.539832 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.539838    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.540103 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.539887    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.540259 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.540242    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.540293 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.540280    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.550449 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.550415    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9b2p\" (UniqueName: \"kubernetes.io/projected/abb2f203-5732-403a-acb9-3faf170d5256-kube-api-access-f9b2p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.707658 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.707567    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:02.998325 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:02.998265    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"]
Sep 09 20:46:03.001015 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:46:03.000987    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb2f203_5732_403a_acb9_3faf170d5256.slice/crio-fc25ffa92087dbfc999758df728479890678191e612077038a358e0f626f465e WatchSource:0}: Error finding container fc25ffa92087dbfc999758df728479890678191e612077038a358e0f626f465e: Status 404 returned error can't find the container with id fc25ffa92087dbfc999758df728479890678191e612077038a358e0f626f465e
Sep 09 20:46:04.009548 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:04.009459    2555 generic.go:356] "Generic (PLEG): container finished" podID="abb2f203-5732-403a-acb9-3faf170d5256" containerID="56b4dfcdfed5198b79a9d7fa35bc8acd406b8dac25f29c0bde103585894a8b6e" exitCode=0
Sep 09 20:46:04.009548 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:04.009537    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk" event={"ID":"abb2f203-5732-403a-acb9-3faf170d5256","Type":"ContainerDied","Data":"56b4dfcdfed5198b79a9d7fa35bc8acd406b8dac25f29c0bde103585894a8b6e"}
Sep 09 20:46:04.009980 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:04.009589    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk" event={"ID":"abb2f203-5732-403a-acb9-3faf170d5256","Type":"ContainerStarted","Data":"fc25ffa92087dbfc999758df728479890678191e612077038a358e0f626f465e"}
Sep 09 20:46:06.024449 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:06.024412    2555 generic.go:356] "Generic (PLEG): container finished" podID="abb2f203-5732-403a-acb9-3faf170d5256" containerID="afb31804255c6678b0ad7f3a26e73e6b078eba9e250f6c447dec373a88c9c523" exitCode=0
Sep 09 20:46:06.024863 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:06.024468    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk" event={"ID":"abb2f203-5732-403a-acb9-3faf170d5256","Type":"ContainerDied","Data":"afb31804255c6678b0ad7f3a26e73e6b078eba9e250f6c447dec373a88c9c523"}
Sep 09 20:46:07.030965 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:07.030926    2555 generic.go:356] "Generic (PLEG): container finished" podID="abb2f203-5732-403a-acb9-3faf170d5256" containerID="425be66c0d3bacc9731a68dd8ec8a2fc7eaee59bf5b72c6b1aee06a70f471e66" exitCode=0
Sep 09 20:46:07.031327 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:07.030981    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk" event={"ID":"abb2f203-5732-403a-acb9-3faf170d5256","Type":"ContainerDied","Data":"425be66c0d3bacc9731a68dd8ec8a2fc7eaee59bf5b72c6b1aee06a70f471e66"}
Sep 09 20:46:08.168656 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.168627    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:08.192980 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.192938    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9b2p\" (UniqueName: \"kubernetes.io/projected/abb2f203-5732-403a-acb9-3faf170d5256-kube-api-access-f9b2p\") pod \"abb2f203-5732-403a-acb9-3faf170d5256\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") "
Sep 09 20:46:08.193166 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.193021    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-bundle\") pod \"abb2f203-5732-403a-acb9-3faf170d5256\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") "
Sep 09 20:46:08.193166 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.193081    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-util\") pod \"abb2f203-5732-403a-acb9-3faf170d5256\" (UID: \"abb2f203-5732-403a-acb9-3faf170d5256\") "
Sep 09 20:46:08.193717 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.193692    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-bundle" (OuterVolumeSpecName: "bundle") pod "abb2f203-5732-403a-acb9-3faf170d5256" (UID: "abb2f203-5732-403a-acb9-3faf170d5256"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:46:08.195297 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.195274    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb2f203-5732-403a-acb9-3faf170d5256-kube-api-access-f9b2p" (OuterVolumeSpecName: "kube-api-access-f9b2p") pod "abb2f203-5732-403a-acb9-3faf170d5256" (UID: "abb2f203-5732-403a-acb9-3faf170d5256"). InnerVolumeSpecName "kube-api-access-f9b2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:46:08.199937 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.199569    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-util" (OuterVolumeSpecName: "util") pod "abb2f203-5732-403a-acb9-3faf170d5256" (UID: "abb2f203-5732-403a-acb9-3faf170d5256"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:46:08.294297 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.294252    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:46:08.294297 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.294294    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb2f203-5732-403a-acb9-3faf170d5256-util\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:46:08.294532 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:08.294332    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9b2p\" (UniqueName: \"kubernetes.io/projected/abb2f203-5732-403a-acb9-3faf170d5256-kube-api-access-f9b2p\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:46:09.042833 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:09.042796    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk" event={"ID":"abb2f203-5732-403a-acb9-3faf170d5256","Type":"ContainerDied","Data":"fc25ffa92087dbfc999758df728479890678191e612077038a358e0f626f465e"}
Sep 09 20:46:09.042833 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:09.042820    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5z6sk"
Sep 09 20:46:09.043066 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:09.042850    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc25ffa92087dbfc999758df728479890678191e612077038a358e0f626f465e"
Sep 09 20:46:16.069481 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.069443    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"]
Sep 09 20:46:16.069887 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.069773    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb2f203-5732-403a-acb9-3faf170d5256" containerName="util"
Sep 09 20:46:16.069887 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.069784    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb2f203-5732-403a-acb9-3faf170d5256" containerName="util"
Sep 09 20:46:16.069887 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.069799    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb2f203-5732-403a-acb9-3faf170d5256" containerName="pull"
Sep 09 20:46:16.069887 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.069804    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb2f203-5732-403a-acb9-3faf170d5256" containerName="pull"
Sep 09 20:46:16.069887 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.069815    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb2f203-5732-403a-acb9-3faf170d5256" containerName="extract"
Sep 09 20:46:16.069887 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.069821    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb2f203-5732-403a-acb9-3faf170d5256" containerName="extract"
Sep 09 20:46:16.069887 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.069882    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb2f203-5732-403a-acb9-3faf170d5256" containerName="extract"
Sep 09 20:46:16.073055 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.073030    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.078745 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.078722    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 20:46:16.078934 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.078795    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wdgsj\""
Sep 09 20:46:16.079936 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.079885    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 20:46:16.096538 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.096507    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"]
Sep 09 20:46:16.169127 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.169066    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.169127 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.169127    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5lq7\" (UniqueName: \"kubernetes.io/projected/1d708541-9733-4141-bac2-ff0f17a4ac9f-kube-api-access-m5lq7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.169412 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.169209    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.270502 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.270461    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.270502 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.270505    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5lq7\" (UniqueName: \"kubernetes.io/projected/1d708541-9733-4141-bac2-ff0f17a4ac9f-kube-api-access-m5lq7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.270690 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.270533    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.270947 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.270896    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.271007 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.270945    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.282957 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.282928    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5lq7\" (UniqueName: \"kubernetes.io/projected/1d708541-9733-4141-bac2-ff0f17a4ac9f-kube-api-access-m5lq7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.385984 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.385861    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:16.716935 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:46:16.716886    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d708541_9733_4141_bac2_ff0f17a4ac9f.slice/crio-356c17477879008edb0e804daf4d81258539d3c28863df2307ce0aa0d12c8fd7 WatchSource:0}: Error finding container 356c17477879008edb0e804daf4d81258539d3c28863df2307ce0aa0d12c8fd7: Status 404 returned error can't find the container with id 356c17477879008edb0e804daf4d81258539d3c28863df2307ce0aa0d12c8fd7
Sep 09 20:46:16.722444 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:16.722418    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"]
Sep 09 20:46:17.090419 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:17.090379    2555 generic.go:356] "Generic (PLEG): container finished" podID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerID="7aa09dc4f56d177aeab46ff78f555bffa18b1a2d10c532439062bf5d9d16ba7f" exitCode=0
Sep 09 20:46:17.090840 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:17.090478    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8" event={"ID":"1d708541-9733-4141-bac2-ff0f17a4ac9f","Type":"ContainerDied","Data":"7aa09dc4f56d177aeab46ff78f555bffa18b1a2d10c532439062bf5d9d16ba7f"}
Sep 09 20:46:17.090840 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:17.090532    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8" event={"ID":"1d708541-9733-4141-bac2-ff0f17a4ac9f","Type":"ContainerStarted","Data":"356c17477879008edb0e804daf4d81258539d3c28863df2307ce0aa0d12c8fd7"}
Sep 09 20:46:18.097496 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.097399    2555 generic.go:356] "Generic (PLEG): container finished" podID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerID="c42189c91c34ab29cd0a7b42e1774f105d9ff4006193a16b28a669f5a0d6546f" exitCode=0
Sep 09 20:46:18.097496 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.097440    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8" event={"ID":"1d708541-9733-4141-bac2-ff0f17a4ac9f","Type":"ContainerDied","Data":"c42189c91c34ab29cd0a7b42e1774f105d9ff4006193a16b28a669f5a0d6546f"}
Sep 09 20:46:18.809975 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.809940    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"]
Sep 09 20:46:18.812570 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.812544    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.815258 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.815235    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 20:46:18.815393 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.815374    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4jzzz\""
Sep 09 20:46:18.815461 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.815441    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 20:46:18.815558 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.815545    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 20:46:18.817008 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.816984    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 20:46:18.834889 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.834842    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"]
Sep 09 20:46:18.893932 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.893865    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66478945-9a6b-4e36-90be-ae134d500971-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.894233 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.894204    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66478945-9a6b-4e36-90be-ae134d500971-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.894417 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.894255    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmdmp\" (UniqueName: \"kubernetes.io/projected/66478945-9a6b-4e36-90be-ae134d500971-kube-api-access-xmdmp\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.894493 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.894417    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66478945-9a6b-4e36-90be-ae134d500971-manifests\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.894493 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.894462    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66478945-9a6b-4e36-90be-ae134d500971-tmp\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.995716 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.995676    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66478945-9a6b-4e36-90be-ae134d500971-manifests\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.995716 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.995714    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66478945-9a6b-4e36-90be-ae134d500971-tmp\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.996008 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.995778    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66478945-9a6b-4e36-90be-ae134d500971-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.996008 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.995794    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66478945-9a6b-4e36-90be-ae134d500971-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.996008 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.995814    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdmp\" (UniqueName: \"kubernetes.io/projected/66478945-9a6b-4e36-90be-ae134d500971-kube-api-access-xmdmp\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.996157 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.996111    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66478945-9a6b-4e36-90be-ae134d500971-manifests\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.998408 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.998376    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66478945-9a6b-4e36-90be-ae134d500971-tmp\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.998517 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.998498    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66478945-9a6b-4e36-90be-ae134d500971-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:18.998606 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:18.998589    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66478945-9a6b-4e36-90be-ae134d500971-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:19.005353 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:19.005330    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmdmp\" (UniqueName: \"kubernetes.io/projected/66478945-9a6b-4e36-90be-ae134d500971-kube-api-access-xmdmp\") pod \"opendatahub-operator-controller-manager-6d46659dfc-sfgvg\" (UID: \"66478945-9a6b-4e36-90be-ae134d500971\") " pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:19.106473 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:19.106277    2555 generic.go:356] "Generic (PLEG): container finished" podID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerID="9e5a60b195b9b8a010e535faa4a3a2d848da48391da7c3edd949b7a17b0772f8" exitCode=0
Sep 09 20:46:19.106473 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:19.106319    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8" event={"ID":"1d708541-9733-4141-bac2-ff0f17a4ac9f","Type":"ContainerDied","Data":"9e5a60b195b9b8a010e535faa4a3a2d848da48391da7c3edd949b7a17b0772f8"}
Sep 09 20:46:19.123672 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:19.123642    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:19.460401 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:19.460314    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"]
Sep 09 20:46:19.482075 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:46:19.482024    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66478945_9a6b_4e36_90be_ae134d500971.slice/crio-cc407b39bc74ab8b7834027b8394cee34165fe229d041dce66594c236529fc60 WatchSource:0}: Error finding container cc407b39bc74ab8b7834027b8394cee34165fe229d041dce66594c236529fc60: Status 404 returned error can't find the container with id cc407b39bc74ab8b7834027b8394cee34165fe229d041dce66594c236529fc60
Sep 09 20:46:20.113360 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.113323    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg" event={"ID":"66478945-9a6b-4e36-90be-ae134d500971","Type":"ContainerStarted","Data":"cc407b39bc74ab8b7834027b8394cee34165fe229d041dce66594c236529fc60"}
Sep 09 20:46:20.251061 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.250881    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:20.307779 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.307726    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-util\") pod \"1d708541-9733-4141-bac2-ff0f17a4ac9f\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") "
Sep 09 20:46:20.308047 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.307843    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-bundle\") pod \"1d708541-9733-4141-bac2-ff0f17a4ac9f\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") "
Sep 09 20:46:20.308047 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.307934    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5lq7\" (UniqueName: \"kubernetes.io/projected/1d708541-9733-4141-bac2-ff0f17a4ac9f-kube-api-access-m5lq7\") pod \"1d708541-9733-4141-bac2-ff0f17a4ac9f\" (UID: \"1d708541-9733-4141-bac2-ff0f17a4ac9f\") "
Sep 09 20:46:20.308978 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.308930    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-bundle" (OuterVolumeSpecName: "bundle") pod "1d708541-9733-4141-bac2-ff0f17a4ac9f" (UID: "1d708541-9733-4141-bac2-ff0f17a4ac9f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:46:20.318154 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.318107    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d708541-9733-4141-bac2-ff0f17a4ac9f-kube-api-access-m5lq7" (OuterVolumeSpecName: "kube-api-access-m5lq7") pod "1d708541-9733-4141-bac2-ff0f17a4ac9f" (UID: "1d708541-9733-4141-bac2-ff0f17a4ac9f"). InnerVolumeSpecName "kube-api-access-m5lq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:46:20.319430 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.319398    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-util" (OuterVolumeSpecName: "util") pod "1d708541-9733-4141-bac2-ff0f17a4ac9f" (UID: "1d708541-9733-4141-bac2-ff0f17a4ac9f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:46:20.409059 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.408955    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5lq7\" (UniqueName: \"kubernetes.io/projected/1d708541-9733-4141-bac2-ff0f17a4ac9f-kube-api-access-m5lq7\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:46:20.409059 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.408998    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-util\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:46:20.409059 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:20.409014    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d708541-9733-4141-bac2-ff0f17a4ac9f-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:46:21.122339 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:21.122305    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8"
Sep 09 20:46:21.122839 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:21.122304    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pjsm8" event={"ID":"1d708541-9733-4141-bac2-ff0f17a4ac9f","Type":"ContainerDied","Data":"356c17477879008edb0e804daf4d81258539d3c28863df2307ce0aa0d12c8fd7"}
Sep 09 20:46:21.122839 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:21.122442    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="356c17477879008edb0e804daf4d81258539d3c28863df2307ce0aa0d12c8fd7"
Sep 09 20:46:23.133892 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:23.133856    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg" event={"ID":"66478945-9a6b-4e36-90be-ae134d500971","Type":"ContainerStarted","Data":"286d02aafd41c32e823840b44c2cb4c3caa9dd4c6e0b5cbb11e2535e30d5313b"}
Sep 09 20:46:24.143017 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:24.142896    2555 generic.go:356] "Generic (PLEG): container finished" podID="66478945-9a6b-4e36-90be-ae134d500971" containerID="286d02aafd41c32e823840b44c2cb4c3caa9dd4c6e0b5cbb11e2535e30d5313b" exitCode=0
Sep 09 20:46:24.143395 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:24.143013    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg" event={"ID":"66478945-9a6b-4e36-90be-ae134d500971","Type":"ContainerDied","Data":"286d02aafd41c32e823840b44c2cb4c3caa9dd4c6e0b5cbb11e2535e30d5313b"}
Sep 09 20:46:25.150463 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:25.150427    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg" event={"ID":"66478945-9a6b-4e36-90be-ae134d500971","Type":"ContainerStarted","Data":"875a3cf76ed3b41dc302a6d30ec1c09c1d970e6e318591941a43104884fc36ce"}
Sep 09 20:46:25.150860 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:25.150502    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:25.202098 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:25.202028    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg" podStartSLOduration=2.39758748 podStartE2EDuration="7.202002575s" totalImagesPullingTime="3.713965553s" totalInitContainerRuntime="1.090449542s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:46:25.200974209 +0000 UTC m=+344.257511350" watchObservedRunningTime="2026-09-09 20:46:25.202002575 +0000 UTC m=+344.258539718"
Sep 09 20:46:36.158057 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.157978    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d46659dfc-sfgvg"
Sep 09 20:46:36.985042 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.985004    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"]
Sep 09 20:46:36.985438 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.985420    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerName="util"
Sep 09 20:46:36.985536 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.985443    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerName="util"
Sep 09 20:46:36.985536 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.985469    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerName="extract"
Sep 09 20:46:36.985536 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.985478    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerName="extract"
Sep 09 20:46:36.985536 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.985505    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerName="pull"
Sep 09 20:46:36.985536 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.985515    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerName="pull"
Sep 09 20:46:36.985810 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.985613    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d708541-9733-4141-bac2-ff0f17a4ac9f" containerName="extract"
Sep 09 20:46:36.988110 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.988086    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:36.991938 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.991890    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 20:46:36.992118 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.992097    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mj7jb\""
Sep 09 20:46:36.992118 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.992108    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 20:46:36.992244 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:36.992097    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 20:46:37.014135 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.014104    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"]
Sep 09 20:46:37.160339 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.160292    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ttbh\" (UniqueName: \"kubernetes.io/projected/72a0fd72-65d6-4f35-ad30-65decb07f292-kube-api-access-5ttbh\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.160731 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.160345    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/72a0fd72-65d6-4f35-ad30-65decb07f292-metrics-cert\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.160731 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.160506    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72a0fd72-65d6-4f35-ad30-65decb07f292-cert\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.160731 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.160543    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/72a0fd72-65d6-4f35-ad30-65decb07f292-manager-config\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.261392 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.261304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ttbh\" (UniqueName: \"kubernetes.io/projected/72a0fd72-65d6-4f35-ad30-65decb07f292-kube-api-access-5ttbh\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.261392 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.261354    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/72a0fd72-65d6-4f35-ad30-65decb07f292-metrics-cert\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.261591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.261445    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72a0fd72-65d6-4f35-ad30-65decb07f292-cert\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.261591 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.261480    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/72a0fd72-65d6-4f35-ad30-65decb07f292-manager-config\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.262240 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.262210    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/72a0fd72-65d6-4f35-ad30-65decb07f292-manager-config\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.264114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.264089    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72a0fd72-65d6-4f35-ad30-65decb07f292-cert\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.264215 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.264148    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/72a0fd72-65d6-4f35-ad30-65decb07f292-metrics-cert\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.275978 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.275950    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ttbh\" (UniqueName: \"kubernetes.io/projected/72a0fd72-65d6-4f35-ad30-65decb07f292-kube-api-access-5ttbh\") pod \"lws-controller-manager-58fbd4c7f6-cnjwz\" (UID: \"72a0fd72-65d6-4f35-ad30-65decb07f292\") " pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.298093 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.298049    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:37.577306 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:37.577272    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"]
Sep 09 20:46:37.580944 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:46:37.580896    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a0fd72_65d6_4f35_ad30_65decb07f292.slice/crio-9fcb953703cd6c79afa1f892381342a2fa58f5442aede57350fb221334f3b994 WatchSource:0}: Error finding container 9fcb953703cd6c79afa1f892381342a2fa58f5442aede57350fb221334f3b994: Status 404 returned error can't find the container with id 9fcb953703cd6c79afa1f892381342a2fa58f5442aede57350fb221334f3b994
Sep 09 20:46:38.215854 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:38.215815    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz" event={"ID":"72a0fd72-65d6-4f35-ad30-65decb07f292","Type":"ContainerStarted","Data":"9fcb953703cd6c79afa1f892381342a2fa58f5442aede57350fb221334f3b994"}
Sep 09 20:46:40.229195 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:40.229156    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz" event={"ID":"72a0fd72-65d6-4f35-ad30-65decb07f292","Type":"ContainerStarted","Data":"eaf0b951be93385a3b1c939fdd459b58eee65cfc2e966ac9ba3b539a21e5480d"}
Sep 09 20:46:40.229708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:40.229298    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:40.279826 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:40.279762    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz" podStartSLOduration=2.425201536 podStartE2EDuration="4.279739011s" totalImagesPullingTime="1.854537475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:46:40.278971833 +0000 UTC m=+359.335508978" watchObservedRunningTime="2026-09-09 20:46:40.279739011 +0000 UTC m=+359.336276154"
Sep 09 20:46:45.481789 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.481755    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"]
Sep 09 20:46:45.485378 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.485355    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.489330 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.489283    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 20:46:45.489524 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.489505    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 20:46:45.489645 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.489611    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gxkjq\""
Sep 09 20:46:45.490019 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.490003    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 20:46:45.490278 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.490260    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 20:46:45.515293 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.515250    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"]
Sep 09 20:46:45.539146 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.539106    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlrzs\" (UniqueName: \"kubernetes.io/projected/3061d9da-2b59-4084-b6c7-d2207b862cd9-kube-api-access-vlrzs\") pod \"kube-auth-proxy-6c8d5d5c67-c62cx\" (UID: \"3061d9da-2b59-4084-b6c7-d2207b862cd9\") " pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.539307 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.539202    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3061d9da-2b59-4084-b6c7-d2207b862cd9-tmp\") pod \"kube-auth-proxy-6c8d5d5c67-c62cx\" (UID: \"3061d9da-2b59-4084-b6c7-d2207b862cd9\") " pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.539307 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.539297    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3061d9da-2b59-4084-b6c7-d2207b862cd9-tls-certs\") pod \"kube-auth-proxy-6c8d5d5c67-c62cx\" (UID: \"3061d9da-2b59-4084-b6c7-d2207b862cd9\") " pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.640479 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.640435    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlrzs\" (UniqueName: \"kubernetes.io/projected/3061d9da-2b59-4084-b6c7-d2207b862cd9-kube-api-access-vlrzs\") pod \"kube-auth-proxy-6c8d5d5c67-c62cx\" (UID: \"3061d9da-2b59-4084-b6c7-d2207b862cd9\") " pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.640656 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.640522    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3061d9da-2b59-4084-b6c7-d2207b862cd9-tmp\") pod \"kube-auth-proxy-6c8d5d5c67-c62cx\" (UID: \"3061d9da-2b59-4084-b6c7-d2207b862cd9\") " pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.640656 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.640592    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3061d9da-2b59-4084-b6c7-d2207b862cd9-tls-certs\") pod \"kube-auth-proxy-6c8d5d5c67-c62cx\" (UID: \"3061d9da-2b59-4084-b6c7-d2207b862cd9\") " pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.643098 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.643072    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3061d9da-2b59-4084-b6c7-d2207b862cd9-tmp\") pod \"kube-auth-proxy-6c8d5d5c67-c62cx\" (UID: \"3061d9da-2b59-4084-b6c7-d2207b862cd9\") " pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.643339 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.643321    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3061d9da-2b59-4084-b6c7-d2207b862cd9-tls-certs\") pod \"kube-auth-proxy-6c8d5d5c67-c62cx\" (UID: \"3061d9da-2b59-4084-b6c7-d2207b862cd9\") " pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.653552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.653519    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlrzs\" (UniqueName: \"kubernetes.io/projected/3061d9da-2b59-4084-b6c7-d2207b862cd9-kube-api-access-vlrzs\") pod \"kube-auth-proxy-6c8d5d5c67-c62cx\" (UID: \"3061d9da-2b59-4084-b6c7-d2207b862cd9\") " pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:45.797229 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:45.797195    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"
Sep 09 20:46:46.098719 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:46.098659    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx"]
Sep 09 20:46:46.101284 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:46:46.101249    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3061d9da_2b59_4084_b6c7_d2207b862cd9.slice/crio-79b57ceb4d1c0c86011e0fc7e74a23ecce94165ed58b07266ed239c02ffc2f99 WatchSource:0}: Error finding container 79b57ceb4d1c0c86011e0fc7e74a23ecce94165ed58b07266ed239c02ffc2f99: Status 404 returned error can't find the container with id 79b57ceb4d1c0c86011e0fc7e74a23ecce94165ed58b07266ed239c02ffc2f99
Sep 09 20:46:46.261100 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:46.261064    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx" event={"ID":"3061d9da-2b59-4084-b6c7-d2207b862cd9","Type":"ContainerStarted","Data":"79b57ceb4d1c0c86011e0fc7e74a23ecce94165ed58b07266ed239c02ffc2f99"}
Sep 09 20:46:49.280163 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:49.280067    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx" event={"ID":"3061d9da-2b59-4084-b6c7-d2207b862cd9","Type":"ContainerStarted","Data":"de2400e23f93705d8b22d9b440439b46fba7cb1802db9f1505be49e43ba1b2e2"}
Sep 09 20:46:51.238461 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:51.238426    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58fbd4c7f6-cnjwz"
Sep 09 20:46:51.307859 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:51.307791    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx" podStartSLOduration=3.494491947 podStartE2EDuration="6.307765801s" totalImagesPullingTime="2.813273854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:46:49.314964252 +0000 UTC m=+368.371501395" watchObservedRunningTime="2026-09-09 20:46:51.307765801 +0000 UTC m=+370.364302944"
Sep 09 20:46:59.092188 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.092144    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6545c485c8-jbf69"]
Sep 09 20:46:59.100048 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.100019    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.149968 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.149867    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-oauth-serving-cert\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.150166 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.150002    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvqxv\" (UniqueName: \"kubernetes.io/projected/54d1dca7-3dd7-4017-9939-78b84992ab97-kube-api-access-mvqxv\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.150166 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.150091    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54d1dca7-3dd7-4017-9939-78b84992ab97-console-oauth-config\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.150166 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.150121    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-service-ca\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.150166 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.150147    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-trusted-ca-bundle\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.150370 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.150211    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-console-config\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.150370 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.150293    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54d1dca7-3dd7-4017-9939-78b84992ab97-console-serving-cert\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.165440 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.165405    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6545c485c8-jbf69"]
Sep 09 20:46:59.251779 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.251743    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvqxv\" (UniqueName: \"kubernetes.io/projected/54d1dca7-3dd7-4017-9939-78b84992ab97-kube-api-access-mvqxv\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.252034 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.251807    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54d1dca7-3dd7-4017-9939-78b84992ab97-console-oauth-config\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.252034 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.251827    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-service-ca\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.252034 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.251843    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-trusted-ca-bundle\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.252034 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.251875    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-console-config\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.252034 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.251950    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54d1dca7-3dd7-4017-9939-78b84992ab97-console-serving-cert\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.252034 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.251980    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-oauth-serving-cert\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.252814 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.252786    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-oauth-serving-cert\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.252955 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.252845    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-service-ca\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.252955 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.252800    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-console-config\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.253093 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.253067    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d1dca7-3dd7-4017-9939-78b84992ab97-trusted-ca-bundle\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.254544 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.254524    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54d1dca7-3dd7-4017-9939-78b84992ab97-console-oauth-config\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.254651 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.254629    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54d1dca7-3dd7-4017-9939-78b84992ab97-console-serving-cert\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.395144 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.395041    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvqxv\" (UniqueName: \"kubernetes.io/projected/54d1dca7-3dd7-4017-9939-78b84992ab97-kube-api-access-mvqxv\") pod \"console-6545c485c8-jbf69\" (UID: \"54d1dca7-3dd7-4017-9939-78b84992ab97\") " pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.409506 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.409469    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:46:59.768090 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:46:59.768049    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d1dca7_3dd7_4017_9939_78b84992ab97.slice/crio-8fefa246ae22259a48993ae8807275d6d4b712be942e4309be80f39e32d428dd WatchSource:0}: Error finding container 8fefa246ae22259a48993ae8807275d6d4b712be942e4309be80f39e32d428dd: Status 404 returned error can't find the container with id 8fefa246ae22259a48993ae8807275d6d4b712be942e4309be80f39e32d428dd
Sep 09 20:46:59.783186 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:46:59.783160    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6545c485c8-jbf69"]
Sep 09 20:47:00.338449 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:00.338402    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6545c485c8-jbf69" event={"ID":"54d1dca7-3dd7-4017-9939-78b84992ab97","Type":"ContainerStarted","Data":"c4be75aebb9611aca27cc61363b0dda6fabc5c5c31dca68a154427ed0dc56848"}
Sep 09 20:47:00.338880 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:00.338492    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6545c485c8-jbf69" event={"ID":"54d1dca7-3dd7-4017-9939-78b84992ab97","Type":"ContainerStarted","Data":"8fefa246ae22259a48993ae8807275d6d4b712be942e4309be80f39e32d428dd"}
Sep 09 20:47:00.385945 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:00.385870    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6545c485c8-jbf69" podStartSLOduration=2.385853599 podStartE2EDuration="2.385853599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:00.385527929 +0000 UTC m=+379.442065071" watchObservedRunningTime="2026-09-09 20:47:00.385853599 +0000 UTC m=+379.442390742"
Sep 09 20:47:09.410299 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:09.410253    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:47:09.410889 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:09.410327    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:47:09.415419 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:09.415393    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:47:10.398234 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:10.398200    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6545c485c8-jbf69"
Sep 09 20:47:10.582216 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:10.582175    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56659c864-tpdsv"]
Sep 09 20:47:35.602361 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.602292    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56659c864-tpdsv" podUID="b4345c26-0733-4af8-8d7b-3228c7fc4250" containerName="console" containerID="cri-o://e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e" gracePeriod=15
Sep 09 20:47:35.844288 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.844257    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:47:35.986386 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986288    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-trusted-ca-bundle\") pod \"b4345c26-0733-4af8-8d7b-3228c7fc4250\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") "
Sep 09 20:47:35.986386 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986348    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-service-ca\") pod \"b4345c26-0733-4af8-8d7b-3228c7fc4250\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") "
Sep 09 20:47:35.986633 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986422    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-oauth-serving-cert\") pod \"b4345c26-0733-4af8-8d7b-3228c7fc4250\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") "
Sep 09 20:47:35.986633 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986449    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-oauth-config\") pod \"b4345c26-0733-4af8-8d7b-3228c7fc4250\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") "
Sep 09 20:47:35.986633 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986492    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-serving-cert\") pod \"b4345c26-0733-4af8-8d7b-3228c7fc4250\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") "
Sep 09 20:47:35.986633 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986531    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmgwg\" (UniqueName: \"kubernetes.io/projected/b4345c26-0733-4af8-8d7b-3228c7fc4250-kube-api-access-tmgwg\") pod \"b4345c26-0733-4af8-8d7b-3228c7fc4250\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") "
Sep 09 20:47:35.986633 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986582    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-config\") pod \"b4345c26-0733-4af8-8d7b-3228c7fc4250\" (UID: \"b4345c26-0733-4af8-8d7b-3228c7fc4250\") "
Sep 09 20:47:35.986964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986863    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b4345c26-0733-4af8-8d7b-3228c7fc4250" (UID: "b4345c26-0733-4af8-8d7b-3228c7fc4250"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:47:35.986964 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986884    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4345c26-0733-4af8-8d7b-3228c7fc4250" (UID: "b4345c26-0733-4af8-8d7b-3228c7fc4250"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:47:35.987043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.986974    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4345c26-0733-4af8-8d7b-3228c7fc4250" (UID: "b4345c26-0733-4af8-8d7b-3228c7fc4250"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:47:35.987269 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.987241    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-config" (OuterVolumeSpecName: "console-config") pod "b4345c26-0733-4af8-8d7b-3228c7fc4250" (UID: "b4345c26-0733-4af8-8d7b-3228c7fc4250"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:47:35.989003 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.988962    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4345c26-0733-4af8-8d7b-3228c7fc4250" (UID: "b4345c26-0733-4af8-8d7b-3228c7fc4250"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:47:35.989091 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.989028    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4345c26-0733-4af8-8d7b-3228c7fc4250" (UID: "b4345c26-0733-4af8-8d7b-3228c7fc4250"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:47:35.989091 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:35.989036    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4345c26-0733-4af8-8d7b-3228c7fc4250-kube-api-access-tmgwg" (OuterVolumeSpecName: "kube-api-access-tmgwg") pod "b4345c26-0733-4af8-8d7b-3228c7fc4250" (UID: "b4345c26-0733-4af8-8d7b-3228c7fc4250"). InnerVolumeSpecName "kube-api-access-tmgwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:47:36.087543 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.087498    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:47:36.087543 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.087535    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-trusted-ca-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:47:36.087543 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.087545    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:47:36.087543 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.087554    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4345c26-0733-4af8-8d7b-3228c7fc4250-oauth-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:47:36.087821 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.087562    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-oauth-config\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:47:36.087821 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.087573    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4345c26-0733-4af8-8d7b-3228c7fc4250-console-serving-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:47:36.087821 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.087581    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmgwg\" (UniqueName: \"kubernetes.io/projected/b4345c26-0733-4af8-8d7b-3228c7fc4250-kube-api-access-tmgwg\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:47:36.537002 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.536967    2555 generic.go:356] "Generic (PLEG): container finished" podID="b4345c26-0733-4af8-8d7b-3228c7fc4250" containerID="e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e" exitCode=0
Sep 09 20:47:36.537206 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.537019    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56659c864-tpdsv"
Sep 09 20:47:36.537206 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.537053    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56659c864-tpdsv" event={"ID":"b4345c26-0733-4af8-8d7b-3228c7fc4250","Type":"ContainerDied","Data":"e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e"}
Sep 09 20:47:36.537206 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.537112    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56659c864-tpdsv" event={"ID":"b4345c26-0733-4af8-8d7b-3228c7fc4250","Type":"ContainerDied","Data":"161dee9c13952ab45f5affa73960db2949726b05466a1c67af2d9329cac6e51c"}
Sep 09 20:47:36.537206 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.537139    2555 scope.go:117] "RemoveContainer" containerID="e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e"
Sep 09 20:47:36.547817 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.547796    2555 scope.go:117] "RemoveContainer" containerID="e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e"
Sep 09 20:47:36.548218 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:47:36.548196    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e\": container with ID starting with e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e not found: ID does not exist" containerID="e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e"
Sep 09 20:47:36.548284 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.548231    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e"} err="failed to get container status \"e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e\": rpc error: code = NotFound desc = could not find container \"e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e\": container with ID starting with e436e66699d1da43bbd67f97d6241349cb8cc9a3bafa38ee3872903f6336df4e not found: ID does not exist"
Sep 09 20:47:36.563176 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.563149    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56659c864-tpdsv"]
Sep 09 20:47:36.571544 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:36.571516    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56659c864-tpdsv"]
Sep 09 20:47:37.431285 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:47:37.431250    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4345c26-0733-4af8-8d7b-3228c7fc4250" path="/var/lib/kubelet/pods/b4345c26-0733-4af8-8d7b-3228c7fc4250/volumes"
Sep 09 20:48:00.985771 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:00.985733    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"]
Sep 09 20:48:00.986269 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:00.986141    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4345c26-0733-4af8-8d7b-3228c7fc4250" containerName="console"
Sep 09 20:48:00.986269 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:00.986153    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4345c26-0733-4af8-8d7b-3228c7fc4250" containerName="console"
Sep 09 20:48:00.986269 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:00.986224    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4345c26-0733-4af8-8d7b-3228c7fc4250" containerName="console"
Sep 09 20:48:00.989627 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:00.989605    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:00.992276 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:00.992254    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wdgsj\""
Sep 09 20:48:00.993997 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:00.993980    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 20:48:00.994100 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:00.994058    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 20:48:01.012857 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.012816    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"]
Sep 09 20:48:01.088843 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.088808    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.089061 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.088875    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86828\" (UniqueName: \"kubernetes.io/projected/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-kube-api-access-86828\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.089061 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.088941    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.105378 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.105345    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"]
Sep 09 20:48:01.108127 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.108110    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.134276 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.134236    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"]
Sep 09 20:48:01.189440 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.189398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.189637 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.189450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86828\" (UniqueName: \"kubernetes.io/projected/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-kube-api-access-86828\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.189637 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.189473    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.189637 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.189507    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.189637 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.189530    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.189637 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.189568    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77vns\" (UniqueName: \"kubernetes.io/projected/0aa51220-6ade-4275-b514-7a5294f5de44-kube-api-access-77vns\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.189955 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.189794    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.189955 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.189941    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.205120 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.205089    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86828\" (UniqueName: \"kubernetes.io/projected/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-kube-api-access-86828\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.261033 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.260938    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"]
Sep 09 20:48:01.263919 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.263883    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.286631 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.286601    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"]
Sep 09 20:48:01.290684 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.290646    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77vns\" (UniqueName: \"kubernetes.io/projected/0aa51220-6ade-4275-b514-7a5294f5de44-kube-api-access-77vns\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.290847 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.290704    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.290847 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.290724    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.291007 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.290837    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.291007 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.290887    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gst5w\" (UniqueName: \"kubernetes.io/projected/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-kube-api-access-gst5w\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.291007 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.290948    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.291245 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.291223    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.291314 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.291288    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.299461 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.299437    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:01.302748 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.302712    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77vns\" (UniqueName: \"kubernetes.io/projected/0aa51220-6ade-4275-b514-7a5294f5de44-kube-api-access-77vns\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.391654 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.391602    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gst5w\" (UniqueName: \"kubernetes.io/projected/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-kube-api-access-gst5w\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.391847 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.391722    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.391847 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.391757    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.392216 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.392194    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.392216 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.392208    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.402038 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.402007    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gst5w\" (UniqueName: \"kubernetes.io/projected/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-kube-api-access-gst5w\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.416882 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.416849    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:01.437729 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.437697    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"]
Sep 09 20:48:01.440956 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.440928    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.459354 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.459312    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"]
Sep 09 20:48:01.492353 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.492320    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.492550 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.492377    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2czb\" (UniqueName: \"kubernetes.io/projected/f0cd4075-19ee-4350-af80-4f709782c215-kube-api-access-z2czb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.492550 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.492448    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.573824 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.573785    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:01.593376 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.593340    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.593547 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.593395    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"]
Sep 09 20:48:01.593547 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.593402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2czb\" (UniqueName: \"kubernetes.io/projected/f0cd4075-19ee-4350-af80-4f709782c215-kube-api-access-z2czb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.593547 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.593476    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.593784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.593700    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.593837 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.593805    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.596539 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:48:01.596513    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428d5d0c_f9fb_4f3b_9bc5_d983d6223a46.slice/crio-47570d917459c9e265d215a58fe45e5e5f466ffa5cd6bac0723ecf8298608eb5 WatchSource:0}: Error finding container 47570d917459c9e265d215a58fe45e5e5f466ffa5cd6bac0723ecf8298608eb5: Status 404 returned error can't find the container with id 47570d917459c9e265d215a58fe45e5e5f466ffa5cd6bac0723ecf8298608eb5
Sep 09 20:48:01.609493 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.609462    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2czb\" (UniqueName: \"kubernetes.io/projected/f0cd4075-19ee-4350-af80-4f709782c215-kube-api-access-z2czb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.665981 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.665858    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm" event={"ID":"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46","Type":"ContainerStarted","Data":"47570d917459c9e265d215a58fe45e5e5f466ffa5cd6bac0723ecf8298608eb5"}
Sep 09 20:48:01.721464 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.721368    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"]
Sep 09 20:48:01.750638 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.750608    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:01.751842 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:48:01.751813    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa51220_6ade_4275_b514_7a5294f5de44.slice/crio-c2577da32e606155f0c5d50794837c24afcc6beb920384ae2197f0d4254ce3de WatchSource:0}: Error finding container c2577da32e606155f0c5d50794837c24afcc6beb920384ae2197f0d4254ce3de: Status 404 returned error can't find the container with id c2577da32e606155f0c5d50794837c24afcc6beb920384ae2197f0d4254ce3de
Sep 09 20:48:01.867600 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:01.867424    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"]
Sep 09 20:48:01.872970 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:48:01.872945    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37ff6cc_6c68_401f_9c3b_cf48eb1287df.slice/crio-6489f1eb9cd3779c36d4c5b659ccda5280b76a7f33ac066c43e64324805007a2 WatchSource:0}: Error finding container 6489f1eb9cd3779c36d4c5b659ccda5280b76a7f33ac066c43e64324805007a2: Status 404 returned error can't find the container with id 6489f1eb9cd3779c36d4c5b659ccda5280b76a7f33ac066c43e64324805007a2
Sep 09 20:48:01.908666 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:48:01.908634    2555 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa51220_6ade_4275_b514_7a5294f5de44.slice/crio-conmon-6ed44458ecb34817004c4c4cfbc8c5f9ea5ae6c1bb51bd207d9a6efb84d6ed41.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa51220_6ade_4275_b514_7a5294f5de44.slice/crio-6ed44458ecb34817004c4c4cfbc8c5f9ea5ae6c1bb51bd207d9a6efb84d6ed41.scope\": RecentStats: unable to find data in memory cache]"
Sep 09 20:48:02.040421 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.040366    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"]
Sep 09 20:48:02.066957 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:48:02.066892    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0cd4075_19ee_4350_af80_4f709782c215.slice/crio-7740e80188c0377e704ad8e66417cfbe96f8a105b45653042cfaf45295218b02 WatchSource:0}: Error finding container 7740e80188c0377e704ad8e66417cfbe96f8a105b45653042cfaf45295218b02: Status 404 returned error can't find the container with id 7740e80188c0377e704ad8e66417cfbe96f8a105b45653042cfaf45295218b02
Sep 09 20:48:02.673794 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.673753    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0cd4075-19ee-4350-af80-4f709782c215" containerID="a2e2254f70038a06c0d6c1121d571c1fbd648342c53f85d5d63452db11749c24" exitCode=0
Sep 09 20:48:02.674025 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.673839    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk" event={"ID":"f0cd4075-19ee-4350-af80-4f709782c215","Type":"ContainerDied","Data":"a2e2254f70038a06c0d6c1121d571c1fbd648342c53f85d5d63452db11749c24"}
Sep 09 20:48:02.674025 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.673951    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk" event={"ID":"f0cd4075-19ee-4350-af80-4f709782c215","Type":"ContainerStarted","Data":"7740e80188c0377e704ad8e66417cfbe96f8a105b45653042cfaf45295218b02"}
Sep 09 20:48:02.675682 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.675659    2555 generic.go:356] "Generic (PLEG): container finished" podID="0aa51220-6ade-4275-b514-7a5294f5de44" containerID="6ed44458ecb34817004c4c4cfbc8c5f9ea5ae6c1bb51bd207d9a6efb84d6ed41" exitCode=0
Sep 09 20:48:02.675783 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.675759    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts" event={"ID":"0aa51220-6ade-4275-b514-7a5294f5de44","Type":"ContainerDied","Data":"6ed44458ecb34817004c4c4cfbc8c5f9ea5ae6c1bb51bd207d9a6efb84d6ed41"}
Sep 09 20:48:02.675843 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.675824    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts" event={"ID":"0aa51220-6ade-4275-b514-7a5294f5de44","Type":"ContainerStarted","Data":"c2577da32e606155f0c5d50794837c24afcc6beb920384ae2197f0d4254ce3de"}
Sep 09 20:48:02.677660 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.677623    2555 generic.go:356] "Generic (PLEG): container finished" podID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerID="2d0ea4841d5d4d4f024bce46f621f92f3f8e11dfb2886303f2b810d283b972b0" exitCode=0
Sep 09 20:48:02.677785 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.677707    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm" event={"ID":"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46","Type":"ContainerDied","Data":"2d0ea4841d5d4d4f024bce46f621f92f3f8e11dfb2886303f2b810d283b972b0"}
Sep 09 20:48:02.679835 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.679808    2555 generic.go:356] "Generic (PLEG): container finished" podID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerID="bfecfc47b2957e41420cfb6f41f70e732f04b6f1ff37c1bc323361669f6b4b0b" exitCode=0
Sep 09 20:48:02.679938 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.679894    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh" event={"ID":"a37ff6cc-6c68-401f-9c3b-cf48eb1287df","Type":"ContainerDied","Data":"bfecfc47b2957e41420cfb6f41f70e732f04b6f1ff37c1bc323361669f6b4b0b"}
Sep 09 20:48:02.679993 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:02.679967    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh" event={"ID":"a37ff6cc-6c68-401f-9c3b-cf48eb1287df","Type":"ContainerStarted","Data":"6489f1eb9cd3779c36d4c5b659ccda5280b76a7f33ac066c43e64324805007a2"}
Sep 09 20:48:03.689393 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:03.689163    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm" event={"ID":"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46","Type":"ContainerStarted","Data":"7f6a2fd1486262c9616054d213a7657b53b4cbe7d53e912d2dfce6cd64af83ee"}
Sep 09 20:48:03.691647 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:03.691614    2555 generic.go:356] "Generic (PLEG): container finished" podID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerID="cee7fa0f8b2d17bccf2a33ae749bcf59d1a103871bdc6bfd5d37d58835d924f5" exitCode=0
Sep 09 20:48:03.691790 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:03.691759    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh" event={"ID":"a37ff6cc-6c68-401f-9c3b-cf48eb1287df","Type":"ContainerDied","Data":"cee7fa0f8b2d17bccf2a33ae749bcf59d1a103871bdc6bfd5d37d58835d924f5"}
Sep 09 20:48:03.694103 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:03.694082    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk" event={"ID":"f0cd4075-19ee-4350-af80-4f709782c215","Type":"ContainerStarted","Data":"ccb39f824585c382245534caa923712f6f428f02156b174805d0314396dbf123"}
Sep 09 20:48:04.701489 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:04.701388    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0cd4075-19ee-4350-af80-4f709782c215" containerID="ccb39f824585c382245534caa923712f6f428f02156b174805d0314396dbf123" exitCode=0
Sep 09 20:48:04.701489 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:04.701416    2555 generic.go:356] "Generic (PLEG): container finished" podID="f0cd4075-19ee-4350-af80-4f709782c215" containerID="7c969ef937b703782496e694f27af311dadd84b179b1ce9958804cb958ab0788" exitCode=0
Sep 09 20:48:04.701489 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:04.701463    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk" event={"ID":"f0cd4075-19ee-4350-af80-4f709782c215","Type":"ContainerDied","Data":"ccb39f824585c382245534caa923712f6f428f02156b174805d0314396dbf123"}
Sep 09 20:48:04.702003 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:04.701529    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk" event={"ID":"f0cd4075-19ee-4350-af80-4f709782c215","Type":"ContainerDied","Data":"7c969ef937b703782496e694f27af311dadd84b179b1ce9958804cb958ab0788"}
Sep 09 20:48:04.703448 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:04.703421    2555 generic.go:356] "Generic (PLEG): container finished" podID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerID="7f6a2fd1486262c9616054d213a7657b53b4cbe7d53e912d2dfce6cd64af83ee" exitCode=0
Sep 09 20:48:04.703587 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:04.703497    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm" event={"ID":"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46","Type":"ContainerDied","Data":"7f6a2fd1486262c9616054d213a7657b53b4cbe7d53e912d2dfce6cd64af83ee"}
Sep 09 20:48:04.705883 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:04.705858    2555 generic.go:356] "Generic (PLEG): container finished" podID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerID="50531d3f29db40fc940a4b0b11f934522deac0b0214b0a3b52027a8e6286bd76" exitCode=0
Sep 09 20:48:04.706024 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:04.705953    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh" event={"ID":"a37ff6cc-6c68-401f-9c3b-cf48eb1287df","Type":"ContainerDied","Data":"50531d3f29db40fc940a4b0b11f934522deac0b0214b0a3b52027a8e6286bd76"}
Sep 09 20:48:05.713614 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.713578    2555 generic.go:356] "Generic (PLEG): container finished" podID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerID="863a32c45227b7ca5abfa6581b0f1b6b34ff1b8942e371eec32e99a159a17db9" exitCode=0
Sep 09 20:48:05.714081 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.713672    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm" event={"ID":"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46","Type":"ContainerDied","Data":"863a32c45227b7ca5abfa6581b0f1b6b34ff1b8942e371eec32e99a159a17db9"}
Sep 09 20:48:05.715601 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.715573    2555 generic.go:356] "Generic (PLEG): container finished" podID="0aa51220-6ade-4275-b514-7a5294f5de44" containerID="239093f3d663397f5bbc13a6360925154241164429a314b9d702641c35a38889" exitCode=0
Sep 09 20:48:05.715724 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.715656    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts" event={"ID":"0aa51220-6ade-4275-b514-7a5294f5de44","Type":"ContainerDied","Data":"239093f3d663397f5bbc13a6360925154241164429a314b9d702641c35a38889"}
Sep 09 20:48:05.864418 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.864019    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:05.880774 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.880748    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:05.932722 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.932685    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-bundle\") pod \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") "
Sep 09 20:48:05.932722 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.932736    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-util\") pod \"f0cd4075-19ee-4350-af80-4f709782c215\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") "
Sep 09 20:48:05.933020 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.932763    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-bundle\") pod \"f0cd4075-19ee-4350-af80-4f709782c215\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") "
Sep 09 20:48:05.933020 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.932845    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-util\") pod \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") "
Sep 09 20:48:05.933020 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.932939    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2czb\" (UniqueName: \"kubernetes.io/projected/f0cd4075-19ee-4350-af80-4f709782c215-kube-api-access-z2czb\") pod \"f0cd4075-19ee-4350-af80-4f709782c215\" (UID: \"f0cd4075-19ee-4350-af80-4f709782c215\") "
Sep 09 20:48:05.933020 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.932976    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gst5w\" (UniqueName: \"kubernetes.io/projected/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-kube-api-access-gst5w\") pod \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\" (UID: \"a37ff6cc-6c68-401f-9c3b-cf48eb1287df\") "
Sep 09 20:48:05.933629 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.933597    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-bundle" (OuterVolumeSpecName: "bundle") pod "f0cd4075-19ee-4350-af80-4f709782c215" (UID: "f0cd4075-19ee-4350-af80-4f709782c215"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:48:05.933782 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.933745    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-bundle" (OuterVolumeSpecName: "bundle") pod "a37ff6cc-6c68-401f-9c3b-cf48eb1287df" (UID: "a37ff6cc-6c68-401f-9c3b-cf48eb1287df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:48:05.935754 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.935731    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0cd4075-19ee-4350-af80-4f709782c215-kube-api-access-z2czb" (OuterVolumeSpecName: "kube-api-access-z2czb") pod "f0cd4075-19ee-4350-af80-4f709782c215" (UID: "f0cd4075-19ee-4350-af80-4f709782c215"). InnerVolumeSpecName "kube-api-access-z2czb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:48:05.935938 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.935890    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-kube-api-access-gst5w" (OuterVolumeSpecName: "kube-api-access-gst5w") pod "a37ff6cc-6c68-401f-9c3b-cf48eb1287df" (UID: "a37ff6cc-6c68-401f-9c3b-cf48eb1287df"). InnerVolumeSpecName "kube-api-access-gst5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:48:05.938868 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.938841    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-util" (OuterVolumeSpecName: "util") pod "f0cd4075-19ee-4350-af80-4f709782c215" (UID: "f0cd4075-19ee-4350-af80-4f709782c215"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:48:05.939197 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:05.939175    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-util" (OuterVolumeSpecName: "util") pod "a37ff6cc-6c68-401f-9c3b-cf48eb1287df" (UID: "a37ff6cc-6c68-401f-9c3b-cf48eb1287df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:48:06.033720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.033684    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2czb\" (UniqueName: \"kubernetes.io/projected/f0cd4075-19ee-4350-af80-4f709782c215-kube-api-access-z2czb\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:06.033720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.033712    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gst5w\" (UniqueName: \"kubernetes.io/projected/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-kube-api-access-gst5w\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:06.033720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.033722    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:06.033720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.033730    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-util\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:06.034032 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.033738    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cd4075-19ee-4350-af80-4f709782c215-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:06.034032 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.033745    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a37ff6cc-6c68-401f-9c3b-cf48eb1287df-util\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:06.723056 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.723016    2555 generic.go:356] "Generic (PLEG): container finished" podID="0aa51220-6ade-4275-b514-7a5294f5de44" containerID="4c26c185af037cbdfd94ffaeb57c2c54d3ed8b199bbcef0f6e3c909230cc2907" exitCode=0
Sep 09 20:48:06.723493 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.723109    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts" event={"ID":"0aa51220-6ade-4275-b514-7a5294f5de44","Type":"ContainerDied","Data":"4c26c185af037cbdfd94ffaeb57c2c54d3ed8b199bbcef0f6e3c909230cc2907"}
Sep 09 20:48:06.725192 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.725170    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh"
Sep 09 20:48:06.725335 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.725200    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8j4zh" event={"ID":"a37ff6cc-6c68-401f-9c3b-cf48eb1287df","Type":"ContainerDied","Data":"6489f1eb9cd3779c36d4c5b659ccda5280b76a7f33ac066c43e64324805007a2"}
Sep 09 20:48:06.725335 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.725245    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6489f1eb9cd3779c36d4c5b659ccda5280b76a7f33ac066c43e64324805007a2"
Sep 09 20:48:06.727168 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.727137    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk" event={"ID":"f0cd4075-19ee-4350-af80-4f709782c215","Type":"ContainerDied","Data":"7740e80188c0377e704ad8e66417cfbe96f8a105b45653042cfaf45295218b02"}
Sep 09 20:48:06.727298 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.727183    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7740e80188c0377e704ad8e66417cfbe96f8a105b45653042cfaf45295218b02"
Sep 09 20:48:06.727360 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.727304    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mmqvk"
Sep 09 20:48:06.859692 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.859667    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:06.941014 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.940977    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-util\") pod \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") "
Sep 09 20:48:06.941187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.941110    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-bundle\") pod \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") "
Sep 09 20:48:06.941187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.941169    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86828\" (UniqueName: \"kubernetes.io/projected/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-kube-api-access-86828\") pod \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\" (UID: \"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46\") "
Sep 09 20:48:06.941565 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.941541    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-bundle" (OuterVolumeSpecName: "bundle") pod "428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" (UID: "428d5d0c-f9fb-4f3b-9bc5-d983d6223a46"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:48:06.943810 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.943744    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-kube-api-access-86828" (OuterVolumeSpecName: "kube-api-access-86828") pod "428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" (UID: "428d5d0c-f9fb-4f3b-9bc5-d983d6223a46"). InnerVolumeSpecName "kube-api-access-86828". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:48:06.946255 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:06.946231    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-util" (OuterVolumeSpecName: "util") pod "428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" (UID: "428d5d0c-f9fb-4f3b-9bc5-d983d6223a46"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:48:07.042345 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.042309    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:07.042345 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.042342    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86828\" (UniqueName: \"kubernetes.io/projected/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-kube-api-access-86828\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:07.042345 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.042352    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/428d5d0c-f9fb-4f3b-9bc5-d983d6223a46-util\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:07.734648 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.734563    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm"
Sep 09 20:48:07.734648 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.734587    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ksslm" event={"ID":"428d5d0c-f9fb-4f3b-9bc5-d983d6223a46","Type":"ContainerDied","Data":"47570d917459c9e265d215a58fe45e5e5f466ffa5cd6bac0723ecf8298608eb5"}
Sep 09 20:48:07.734648 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.734637    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47570d917459c9e265d215a58fe45e5e5f466ffa5cd6bac0723ecf8298608eb5"
Sep 09 20:48:07.867471 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.867446    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:07.950709 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.950666    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-bundle\") pod \"0aa51220-6ade-4275-b514-7a5294f5de44\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") "
Sep 09 20:48:07.950709 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.950715    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77vns\" (UniqueName: \"kubernetes.io/projected/0aa51220-6ade-4275-b514-7a5294f5de44-kube-api-access-77vns\") pod \"0aa51220-6ade-4275-b514-7a5294f5de44\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") "
Sep 09 20:48:07.950942 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.950783    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-util\") pod \"0aa51220-6ade-4275-b514-7a5294f5de44\" (UID: \"0aa51220-6ade-4275-b514-7a5294f5de44\") "
Sep 09 20:48:07.951426 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.951400    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-bundle" (OuterVolumeSpecName: "bundle") pod "0aa51220-6ade-4275-b514-7a5294f5de44" (UID: "0aa51220-6ade-4275-b514-7a5294f5de44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:48:07.953239 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.953201    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aa51220-6ade-4275-b514-7a5294f5de44-kube-api-access-77vns" (OuterVolumeSpecName: "kube-api-access-77vns") pod "0aa51220-6ade-4275-b514-7a5294f5de44" (UID: "0aa51220-6ade-4275-b514-7a5294f5de44"). InnerVolumeSpecName "kube-api-access-77vns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:48:07.955669 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:07.955647    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-util" (OuterVolumeSpecName: "util") pod "0aa51220-6ade-4275-b514-7a5294f5de44" (UID: "0aa51220-6ade-4275-b514-7a5294f5de44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:48:08.051707 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:08.051679    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-bundle\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:08.051707 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:08.051708    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77vns\" (UniqueName: \"kubernetes.io/projected/0aa51220-6ade-4275-b514-7a5294f5de44-kube-api-access-77vns\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:08.051895 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:08.051717    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0aa51220-6ade-4275-b514-7a5294f5de44-util\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:48:08.742395 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:08.742363    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts" event={"ID":"0aa51220-6ade-4275-b514-7a5294f5de44","Type":"ContainerDied","Data":"c2577da32e606155f0c5d50794837c24afcc6beb920384ae2197f0d4254ce3de"}
Sep 09 20:48:08.742769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:08.742402    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amwpts"
Sep 09 20:48:08.742769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:08.742409    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2577da32e606155f0c5d50794837c24afcc6beb920384ae2197f0d4254ce3de"
Sep 09 20:48:43.670739 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.670695    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"]
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671107    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0cd4075-19ee-4350-af80-4f709782c215" containerName="extract"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671124    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0cd4075-19ee-4350-af80-4f709782c215" containerName="extract"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671134    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa51220-6ade-4275-b514-7a5294f5de44" containerName="pull"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671140    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa51220-6ade-4275-b514-7a5294f5de44" containerName="pull"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671150    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0cd4075-19ee-4350-af80-4f709782c215" containerName="pull"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671156    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0cd4075-19ee-4350-af80-4f709782c215" containerName="pull"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671165    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerName="extract"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671171    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerName="extract"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671180    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerName="util"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671185    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerName="util"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671197    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa51220-6ade-4275-b514-7a5294f5de44" containerName="extract"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671206    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa51220-6ade-4275-b514-7a5294f5de44" containerName="extract"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671215    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0cd4075-19ee-4350-af80-4f709782c215" containerName="util"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671219    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0cd4075-19ee-4350-af80-4f709782c215" containerName="util"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671225    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerName="pull"
Sep 09 20:48:43.671221 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671229    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerName="pull"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671235    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerName="pull"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671240    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerName="pull"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671245    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerName="extract"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671249    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerName="extract"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671257    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerName="util"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671261    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerName="util"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671267    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa51220-6ade-4275-b514-7a5294f5de44" containerName="util"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671273    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa51220-6ade-4275-b514-7a5294f5de44" containerName="util"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671344    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a37ff6cc-6c68-401f-9c3b-cf48eb1287df" containerName="extract"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671353    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="428d5d0c-f9fb-4f3b-9bc5-d983d6223a46" containerName="extract"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671365    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa51220-6ade-4275-b514-7a5294f5de44" containerName="extract"
Sep 09 20:48:43.671689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.671375    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0cd4075-19ee-4350-af80-4f709782c215" containerName="extract"
Sep 09 20:48:43.674223 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.674204    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:48:43.677137 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.677110    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 20:48:43.677398 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.677381    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4gg4f\""
Sep 09 20:48:43.681812 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.681789    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 20:48:43.686003 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.685980    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8dc81062-339d-4efd-9d78-bb38fa422930-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-69mrp\" (UID: \"8dc81062-339d-4efd-9d78-bb38fa422930\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:48:43.686126 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.686034    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45k9\" (UniqueName: \"kubernetes.io/projected/8dc81062-339d-4efd-9d78-bb38fa422930-kube-api-access-c45k9\") pod \"kuadrant-operator-controller-manager-5769f99d9f-69mrp\" (UID: \"8dc81062-339d-4efd-9d78-bb38fa422930\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:48:43.700368 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.700336    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"]
Sep 09 20:48:43.787170 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.787129    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45k9\" (UniqueName: \"kubernetes.io/projected/8dc81062-339d-4efd-9d78-bb38fa422930-kube-api-access-c45k9\") pod \"kuadrant-operator-controller-manager-5769f99d9f-69mrp\" (UID: \"8dc81062-339d-4efd-9d78-bb38fa422930\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:48:43.787332 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.787214    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8dc81062-339d-4efd-9d78-bb38fa422930-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-69mrp\" (UID: \"8dc81062-339d-4efd-9d78-bb38fa422930\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:48:43.787622 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.787603    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8dc81062-339d-4efd-9d78-bb38fa422930-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-69mrp\" (UID: \"8dc81062-339d-4efd-9d78-bb38fa422930\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:48:43.798636 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.798595    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45k9\" (UniqueName: \"kubernetes.io/projected/8dc81062-339d-4efd-9d78-bb38fa422930-kube-api-access-c45k9\") pod \"kuadrant-operator-controller-manager-5769f99d9f-69mrp\" (UID: \"8dc81062-339d-4efd-9d78-bb38fa422930\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:48:43.984297 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:43.984204    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:48:44.286521 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:48:44.286492    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc81062_339d_4efd_9d78_bb38fa422930.slice/crio-67471c77b0ac1b41beb6ed54bb3c93ccdaf9843a6b437c0f34f607dabd33a5aa WatchSource:0}: Error finding container 67471c77b0ac1b41beb6ed54bb3c93ccdaf9843a6b437c0f34f607dabd33a5aa: Status 404 returned error can't find the container with id 67471c77b0ac1b41beb6ed54bb3c93ccdaf9843a6b437c0f34f607dabd33a5aa
Sep 09 20:48:44.287494 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:44.287469    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"]
Sep 09 20:48:44.946000 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:44.945954    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" event={"ID":"8dc81062-339d-4efd-9d78-bb38fa422930","Type":"ContainerStarted","Data":"67471c77b0ac1b41beb6ed54bb3c93ccdaf9843a6b437c0f34f607dabd33a5aa"}
Sep 09 20:48:48.975405 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:48.975353    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" event={"ID":"8dc81062-339d-4efd-9d78-bb38fa422930","Type":"ContainerStarted","Data":"913ae2aa4dce5f595d6fbea6853c157f2b6e9a44c6f09349e65b07bba12301e2"}
Sep 09 20:48:48.975936 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:48.975459    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:48:49.015793 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:49.015728    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" podStartSLOduration=1.799748278 podStartE2EDuration="6.015710519s" totalImagesPullingTime="4.215962241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:49.01405066 +0000 UTC m=+488.070587799" watchObservedRunningTime="2026-09-09 20:48:49.015710519 +0000 UTC m=+488.072247661"
Sep 09 20:48:59.983476 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:48:59.983438    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 20:49:22.143513 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.143477    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-42bgh"]
Sep 09 20:49:22.191861 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.191821    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-42bgh"]
Sep 09 20:49:22.192058 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.191965    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh"
Sep 09 20:49:22.195462 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.195440    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mmrns\""
Sep 09 20:49:22.243658 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.243611    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8shln\" (UniqueName: \"kubernetes.io/projected/a96e43cf-4e5f-4f86-b2f7-11e879db4725-kube-api-access-8shln\") pod \"authorino-7bcfd8f9cd-42bgh\" (UID: \"a96e43cf-4e5f-4f86-b2f7-11e879db4725\") " pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh"
Sep 09 20:49:22.328798 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.328764    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-rpzgb"]
Sep 09 20:49:22.331600 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.331567    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rpzgb"
Sep 09 20:49:22.338218 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.338190    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rpzgb"]
Sep 09 20:49:22.344779 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.344754    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6xdq\" (UniqueName: \"kubernetes.io/projected/525bfcb1-68aa-4fec-bc41-822f8ebdc163-kube-api-access-g6xdq\") pod \"authorino-59c974bd48-rpzgb\" (UID: \"525bfcb1-68aa-4fec-bc41-822f8ebdc163\") " pod="kuadrant-system/authorino-59c974bd48-rpzgb"
Sep 09 20:49:22.344891 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.344820    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8shln\" (UniqueName: \"kubernetes.io/projected/a96e43cf-4e5f-4f86-b2f7-11e879db4725-kube-api-access-8shln\") pod \"authorino-7bcfd8f9cd-42bgh\" (UID: \"a96e43cf-4e5f-4f86-b2f7-11e879db4725\") " pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh"
Sep 09 20:49:22.359086 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.359063    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8shln\" (UniqueName: \"kubernetes.io/projected/a96e43cf-4e5f-4f86-b2f7-11e879db4725-kube-api-access-8shln\") pod \"authorino-7bcfd8f9cd-42bgh\" (UID: \"a96e43cf-4e5f-4f86-b2f7-11e879db4725\") " pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh"
Sep 09 20:49:22.445749 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.445655    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6xdq\" (UniqueName: \"kubernetes.io/projected/525bfcb1-68aa-4fec-bc41-822f8ebdc163-kube-api-access-g6xdq\") pod \"authorino-59c974bd48-rpzgb\" (UID: \"525bfcb1-68aa-4fec-bc41-822f8ebdc163\") " pod="kuadrant-system/authorino-59c974bd48-rpzgb"
Sep 09 20:49:22.454792 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.454761    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6xdq\" (UniqueName: \"kubernetes.io/projected/525bfcb1-68aa-4fec-bc41-822f8ebdc163-kube-api-access-g6xdq\") pod \"authorino-59c974bd48-rpzgb\" (UID: \"525bfcb1-68aa-4fec-bc41-822f8ebdc163\") " pod="kuadrant-system/authorino-59c974bd48-rpzgb"
Sep 09 20:49:22.501710 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.501653    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh"
Sep 09 20:49:22.642022 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.641982    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rpzgb"
Sep 09 20:49:22.776890 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.776869    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-42bgh"]
Sep 09 20:49:22.778782 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:49:22.778756    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda96e43cf_4e5f_4f86_b2f7_11e879db4725.slice/crio-e2152cc630f18ff34fe4be3a9560a5ed210bcd435a664ec394a919adb7a53255 WatchSource:0}: Error finding container e2152cc630f18ff34fe4be3a9560a5ed210bcd435a664ec394a919adb7a53255: Status 404 returned error can't find the container with id e2152cc630f18ff34fe4be3a9560a5ed210bcd435a664ec394a919adb7a53255
Sep 09 20:49:22.915175 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:22.915148    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rpzgb"]
Sep 09 20:49:22.916965 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:49:22.916935    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod525bfcb1_68aa_4fec_bc41_822f8ebdc163.slice/crio-9760999f3fa150822eb148f198af48a19528110fc45297e042963432bd16c8cc WatchSource:0}: Error finding container 9760999f3fa150822eb148f198af48a19528110fc45297e042963432bd16c8cc: Status 404 returned error can't find the container with id 9760999f3fa150822eb148f198af48a19528110fc45297e042963432bd16c8cc
Sep 09 20:49:23.168953 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:23.168913    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh" event={"ID":"a96e43cf-4e5f-4f86-b2f7-11e879db4725","Type":"ContainerStarted","Data":"e2152cc630f18ff34fe4be3a9560a5ed210bcd435a664ec394a919adb7a53255"}
Sep 09 20:49:23.170253 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:23.170222    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rpzgb" event={"ID":"525bfcb1-68aa-4fec-bc41-822f8ebdc163","Type":"ContainerStarted","Data":"9760999f3fa150822eb148f198af48a19528110fc45297e042963432bd16c8cc"}
Sep 09 20:49:25.184468 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:25.184413    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rpzgb" event={"ID":"525bfcb1-68aa-4fec-bc41-822f8ebdc163","Type":"ContainerStarted","Data":"24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6"}
Sep 09 20:49:25.186166 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:25.186137    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh" event={"ID":"a96e43cf-4e5f-4f86-b2f7-11e879db4725","Type":"ContainerStarted","Data":"feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384"}
Sep 09 20:49:25.200490 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:25.200423    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-rpzgb" podStartSLOduration=1.340593283 podStartE2EDuration="3.200404795s" totalImagesPullingTime="1.859811512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:49:25.198421441 +0000 UTC m=+524.254958583" watchObservedRunningTime="2026-09-09 20:49:25.200404795 +0000 UTC m=+524.256941937"
Sep 09 20:49:25.213920 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:25.213828    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh" podStartSLOduration=1.220123474 podStartE2EDuration="3.213807843s" totalImagesPullingTime="1.993684369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:49:25.213174034 +0000 UTC m=+524.269711178" watchObservedRunningTime="2026-09-09 20:49:25.213807843 +0000 UTC m=+524.270344986"
Sep 09 20:49:25.239152 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:25.239118    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-42bgh"]
Sep 09 20:49:27.196854 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:27.196813    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh" podUID="a96e43cf-4e5f-4f86-b2f7-11e879db4725" containerName="authorino" containerID="cri-o://feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384" gracePeriod=30
Sep 09 20:49:27.447959 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:27.447883    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh"
Sep 09 20:49:27.491193 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:27.491158    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8shln\" (UniqueName: \"kubernetes.io/projected/a96e43cf-4e5f-4f86-b2f7-11e879db4725-kube-api-access-8shln\") pod \"a96e43cf-4e5f-4f86-b2f7-11e879db4725\" (UID: \"a96e43cf-4e5f-4f86-b2f7-11e879db4725\") "
Sep 09 20:49:27.493507 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:27.493482    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96e43cf-4e5f-4f86-b2f7-11e879db4725-kube-api-access-8shln" (OuterVolumeSpecName: "kube-api-access-8shln") pod "a96e43cf-4e5f-4f86-b2f7-11e879db4725" (UID: "a96e43cf-4e5f-4f86-b2f7-11e879db4725"). InnerVolumeSpecName "kube-api-access-8shln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:49:27.592139 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:27.592099    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8shln\" (UniqueName: \"kubernetes.io/projected/a96e43cf-4e5f-4f86-b2f7-11e879db4725-kube-api-access-8shln\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:49:28.203668 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:28.203633    2555 generic.go:356] "Generic (PLEG): container finished" podID="a96e43cf-4e5f-4f86-b2f7-11e879db4725" containerID="feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384" exitCode=0
Sep 09 20:49:28.204067 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:28.203684    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh"
Sep 09 20:49:28.204067 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:28.203720    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh" event={"ID":"a96e43cf-4e5f-4f86-b2f7-11e879db4725","Type":"ContainerDied","Data":"feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384"}
Sep 09 20:49:28.204067 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:28.203774    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-42bgh" event={"ID":"a96e43cf-4e5f-4f86-b2f7-11e879db4725","Type":"ContainerDied","Data":"e2152cc630f18ff34fe4be3a9560a5ed210bcd435a664ec394a919adb7a53255"}
Sep 09 20:49:28.204067 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:28.203799    2555 scope.go:117] "RemoveContainer" containerID="feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384"
Sep 09 20:49:28.217025 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:28.216997    2555 scope.go:117] "RemoveContainer" containerID="feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384"
Sep 09 20:49:28.217508 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:49:28.217489    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384\": container with ID starting with feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384 not found: ID does not exist" containerID="feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384"
Sep 09 20:49:28.217588 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:28.217520    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384"} err="failed to get container status \"feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384\": rpc error: code = NotFound desc = could not find container \"feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384\": container with ID starting with feac990e878dec2cdd5f74525336ecf9fff61ae57706dadfb1a84c10c735e384 not found: ID does not exist"
Sep 09 20:49:28.225724 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:28.225695    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-42bgh"]
Sep 09 20:49:28.229649 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:28.229623    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-42bgh"]
Sep 09 20:49:29.431298 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:29.431260    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a96e43cf-4e5f-4f86-b2f7-11e879db4725" path="/var/lib/kubelet/pods/a96e43cf-4e5f-4f86-b2f7-11e879db4725/volumes"
Sep 09 20:49:50.945497 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:50.945463    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-4b2nd"]
Sep 09 20:49:50.945993 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:50.945892    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96e43cf-4e5f-4f86-b2f7-11e879db4725" containerName="authorino"
Sep 09 20:49:50.945993 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:50.945920    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96e43cf-4e5f-4f86-b2f7-11e879db4725" containerName="authorino"
Sep 09 20:49:50.946073 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:50.945998    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a96e43cf-4e5f-4f86-b2f7-11e879db4725" containerName="authorino"
Sep 09 20:49:50.950323 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:50.950296    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-4b2nd"
Sep 09 20:49:50.960010 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:50.959982    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-4b2nd"]
Sep 09 20:49:51.107189 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.107147    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjg8x\" (UniqueName: \"kubernetes.io/projected/220baf8a-538f-4889-a150-7b0c343453bd-kube-api-access-rjg8x\") pod \"authorino-557f876f69-4b2nd\" (UID: \"220baf8a-538f-4889-a150-7b0c343453bd\") " pod="kuadrant-system/authorino-557f876f69-4b2nd"
Sep 09 20:49:51.174951 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.174912    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-4b2nd"]
Sep 09 20:49:51.175260 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:49:51.175235    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rjg8x], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-4b2nd" podUID="220baf8a-538f-4889-a150-7b0c343453bd"
Sep 09 20:49:51.208518 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.208418    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjg8x\" (UniqueName: \"kubernetes.io/projected/220baf8a-538f-4889-a150-7b0c343453bd-kube-api-access-rjg8x\") pod \"authorino-557f876f69-4b2nd\" (UID: \"220baf8a-538f-4889-a150-7b0c343453bd\") " pod="kuadrant-system/authorino-557f876f69-4b2nd"
Sep 09 20:49:51.212487 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.212455    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-766c75dccc-5l7qz"]
Sep 09 20:49:51.215936 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.215890    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766c75dccc-5l7qz"
Sep 09 20:49:51.218385 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.218357    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjg8x\" (UniqueName: \"kubernetes.io/projected/220baf8a-538f-4889-a150-7b0c343453bd-kube-api-access-rjg8x\") pod \"authorino-557f876f69-4b2nd\" (UID: \"220baf8a-538f-4889-a150-7b0c343453bd\") " pod="kuadrant-system/authorino-557f876f69-4b2nd"
Sep 09 20:49:51.226287 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.226257    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-766c75dccc-5l7qz"]
Sep 09 20:49:51.247164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.247126    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-766c75dccc-5l7qz"]
Sep 09 20:49:51.247429 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:49:51.247408    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j9tw6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-766c75dccc-5l7qz" podUID="56e9739b-4624-49d1-af70-8f57f9354dad"
Sep 09 20:49:51.277576 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.277545    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86b99b4f87-nkq96"]
Sep 09 20:49:51.280874 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.280852    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:49:51.283508 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.283487    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 09 20:49:51.290085 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.290058    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b99b4f87-nkq96"]
Sep 09 20:49:51.309089 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.309059    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9tw6\" (UniqueName: \"kubernetes.io/projected/56e9739b-4624-49d1-af70-8f57f9354dad-kube-api-access-j9tw6\") pod \"authorino-766c75dccc-5l7qz\" (UID: \"56e9739b-4624-49d1-af70-8f57f9354dad\") " pod="kuadrant-system/authorino-766c75dccc-5l7qz"
Sep 09 20:49:51.330634 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.330599    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-4b2nd"
Sep 09 20:49:51.330812 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.330599    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766c75dccc-5l7qz"
Sep 09 20:49:51.337645 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.337622    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-4b2nd"
Sep 09 20:49:51.341050 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.341027    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766c75dccc-5l7qz"
Sep 09 20:49:51.409967 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.409925    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjg8x\" (UniqueName: \"kubernetes.io/projected/220baf8a-538f-4889-a150-7b0c343453bd-kube-api-access-rjg8x\") pod \"220baf8a-538f-4889-a150-7b0c343453bd\" (UID: \"220baf8a-538f-4889-a150-7b0c343453bd\") "
Sep 09 20:49:51.410169 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.410098    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9tw6\" (UniqueName: \"kubernetes.io/projected/56e9739b-4624-49d1-af70-8f57f9354dad-kube-api-access-j9tw6\") pod \"authorino-766c75dccc-5l7qz\" (UID: \"56e9739b-4624-49d1-af70-8f57f9354dad\") " pod="kuadrant-system/authorino-766c75dccc-5l7qz"
Sep 09 20:49:51.410169 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.410154    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrt4t\" (UniqueName: \"kubernetes.io/projected/6fb4364c-1f79-4832-946b-f6fd2fc47927-kube-api-access-qrt4t\") pod \"authorino-86b99b4f87-nkq96\" (UID: \"6fb4364c-1f79-4832-946b-f6fd2fc47927\") " pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:49:51.410293 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.410185    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb4364c-1f79-4832-946b-f6fd2fc47927-tls-cert\") pod \"authorino-86b99b4f87-nkq96\" (UID: \"6fb4364c-1f79-4832-946b-f6fd2fc47927\") " pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:49:51.412354 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.412327    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/220baf8a-538f-4889-a150-7b0c343453bd-kube-api-access-rjg8x" (OuterVolumeSpecName: "kube-api-access-rjg8x") pod "220baf8a-538f-4889-a150-7b0c343453bd" (UID: "220baf8a-538f-4889-a150-7b0c343453bd"). InnerVolumeSpecName "kube-api-access-rjg8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:49:51.418439 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.418415    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9tw6\" (UniqueName: \"kubernetes.io/projected/56e9739b-4624-49d1-af70-8f57f9354dad-kube-api-access-j9tw6\") pod \"authorino-766c75dccc-5l7qz\" (UID: \"56e9739b-4624-49d1-af70-8f57f9354dad\") " pod="kuadrant-system/authorino-766c75dccc-5l7qz"
Sep 09 20:49:51.510769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.510671    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9tw6\" (UniqueName: \"kubernetes.io/projected/56e9739b-4624-49d1-af70-8f57f9354dad-kube-api-access-j9tw6\") pod \"56e9739b-4624-49d1-af70-8f57f9354dad\" (UID: \"56e9739b-4624-49d1-af70-8f57f9354dad\") "
Sep 09 20:49:51.511012 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.510987    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrt4t\" (UniqueName: \"kubernetes.io/projected/6fb4364c-1f79-4832-946b-f6fd2fc47927-kube-api-access-qrt4t\") pod \"authorino-86b99b4f87-nkq96\" (UID: \"6fb4364c-1f79-4832-946b-f6fd2fc47927\") " pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:49:51.511108 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.511032    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb4364c-1f79-4832-946b-f6fd2fc47927-tls-cert\") pod \"authorino-86b99b4f87-nkq96\" (UID: \"6fb4364c-1f79-4832-946b-f6fd2fc47927\") " pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:49:51.511108 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.511069    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjg8x\" (UniqueName: \"kubernetes.io/projected/220baf8a-538f-4889-a150-7b0c343453bd-kube-api-access-rjg8x\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:49:51.514509 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.514471    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb4364c-1f79-4832-946b-f6fd2fc47927-tls-cert\") pod \"authorino-86b99b4f87-nkq96\" (UID: \"6fb4364c-1f79-4832-946b-f6fd2fc47927\") " pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:49:51.520298 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.520254    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrt4t\" (UniqueName: \"kubernetes.io/projected/6fb4364c-1f79-4832-946b-f6fd2fc47927-kube-api-access-qrt4t\") pod \"authorino-86b99b4f87-nkq96\" (UID: \"6fb4364c-1f79-4832-946b-f6fd2fc47927\") " pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:49:51.521003 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.520967    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e9739b-4624-49d1-af70-8f57f9354dad-kube-api-access-j9tw6" (OuterVolumeSpecName: "kube-api-access-j9tw6") pod "56e9739b-4624-49d1-af70-8f57f9354dad" (UID: "56e9739b-4624-49d1-af70-8f57f9354dad"). InnerVolumeSpecName "kube-api-access-j9tw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:49:51.591323 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.591281    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:49:51.611995 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.611965    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9tw6\" (UniqueName: \"kubernetes.io/projected/56e9739b-4624-49d1-af70-8f57f9354dad-kube-api-access-j9tw6\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:49:51.866509 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:51.866482    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b99b4f87-nkq96"]
Sep 09 20:49:51.868559 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:49:51.868516    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fb4364c_1f79_4832_946b_f6fd2fc47927.slice/crio-4f071d14dd8e1a37354d0b98db80d3a17316853a6a29e72b953452e358a1bbac WatchSource:0}: Error finding container 4f071d14dd8e1a37354d0b98db80d3a17316853a6a29e72b953452e358a1bbac: Status 404 returned error can't find the container with id 4f071d14dd8e1a37354d0b98db80d3a17316853a6a29e72b953452e358a1bbac
Sep 09 20:49:52.337273 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:52.337233    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b99b4f87-nkq96" event={"ID":"6fb4364c-1f79-4832-946b-f6fd2fc47927","Type":"ContainerStarted","Data":"4f071d14dd8e1a37354d0b98db80d3a17316853a6a29e72b953452e358a1bbac"}
Sep 09 20:49:52.337273 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:52.337266    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766c75dccc-5l7qz"
Sep 09 20:49:52.337837 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:52.337271    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-4b2nd"
Sep 09 20:49:52.368777 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:52.368742    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-766c75dccc-5l7qz"]
Sep 09 20:49:52.371066 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:52.371037    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-766c75dccc-5l7qz"]
Sep 09 20:49:52.395231 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:52.395201    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-4b2nd"]
Sep 09 20:49:52.400193 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:52.400141    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-4b2nd"]
Sep 09 20:49:53.344625 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.344590    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b99b4f87-nkq96" event={"ID":"6fb4364c-1f79-4832-946b-f6fd2fc47927","Type":"ContainerStarted","Data":"02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb"}
Sep 09 20:49:53.362539 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.362485    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86b99b4f87-nkq96" podStartSLOduration=1.851650889 podStartE2EDuration="2.362466457s" totalImagesPullingTime="510.815568ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:49:53.361126831 +0000 UTC m=+552.417663966" watchObservedRunningTime="2026-09-09 20:49:53.362466457 +0000 UTC m=+552.419003599"
Sep 09 20:49:53.396436 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.396397    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rpzgb"]
Sep 09 20:49:53.396660 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.396633    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-rpzgb" podUID="525bfcb1-68aa-4fec-bc41-822f8ebdc163" containerName="authorino" containerID="cri-o://24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6" gracePeriod=30
Sep 09 20:49:53.431835 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.431792    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="220baf8a-538f-4889-a150-7b0c343453bd" path="/var/lib/kubelet/pods/220baf8a-538f-4889-a150-7b0c343453bd/volumes"
Sep 09 20:49:53.432131 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.432113    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56e9739b-4624-49d1-af70-8f57f9354dad" path="/var/lib/kubelet/pods/56e9739b-4624-49d1-af70-8f57f9354dad/volumes"
Sep 09 20:49:53.653349 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.653322    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rpzgb"
Sep 09 20:49:53.729189 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.729151    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6xdq\" (UniqueName: \"kubernetes.io/projected/525bfcb1-68aa-4fec-bc41-822f8ebdc163-kube-api-access-g6xdq\") pod \"525bfcb1-68aa-4fec-bc41-822f8ebdc163\" (UID: \"525bfcb1-68aa-4fec-bc41-822f8ebdc163\") "
Sep 09 20:49:53.731431 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.731397    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/525bfcb1-68aa-4fec-bc41-822f8ebdc163-kube-api-access-g6xdq" (OuterVolumeSpecName: "kube-api-access-g6xdq") pod "525bfcb1-68aa-4fec-bc41-822f8ebdc163" (UID: "525bfcb1-68aa-4fec-bc41-822f8ebdc163"). InnerVolumeSpecName "kube-api-access-g6xdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:49:53.829815 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:53.829769    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6xdq\" (UniqueName: \"kubernetes.io/projected/525bfcb1-68aa-4fec-bc41-822f8ebdc163-kube-api-access-g6xdq\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:49:54.352215 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:54.352181    2555 generic.go:356] "Generic (PLEG): container finished" podID="525bfcb1-68aa-4fec-bc41-822f8ebdc163" containerID="24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6" exitCode=0
Sep 09 20:49:54.352635 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:54.352227    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rpzgb"
Sep 09 20:49:54.352635 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:54.352278    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rpzgb" event={"ID":"525bfcb1-68aa-4fec-bc41-822f8ebdc163","Type":"ContainerDied","Data":"24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6"}
Sep 09 20:49:54.352635 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:54.352318    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rpzgb" event={"ID":"525bfcb1-68aa-4fec-bc41-822f8ebdc163","Type":"ContainerDied","Data":"9760999f3fa150822eb148f198af48a19528110fc45297e042963432bd16c8cc"}
Sep 09 20:49:54.352635 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:54.352338    2555 scope.go:117] "RemoveContainer" containerID="24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6"
Sep 09 20:49:54.361661 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:54.361642    2555 scope.go:117] "RemoveContainer" containerID="24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6"
Sep 09 20:49:54.362018 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:49:54.361997    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6\": container with ID starting with 24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6 not found: ID does not exist" containerID="24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6"
Sep 09 20:49:54.362081 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:54.362030    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6"} err="failed to get container status \"24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6\": rpc error: code = NotFound desc = could not find container \"24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6\": container with ID starting with 24bc09effe8ddf5325f3b991b6e29dd09481de4f740375a6f402c5abc98de4e6 not found: ID does not exist"
Sep 09 20:49:54.376463 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:54.376429    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rpzgb"]
Sep 09 20:49:54.380558 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:54.380531    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rpzgb"]
Sep 09 20:49:55.430975 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:49:55.430942    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="525bfcb1-68aa-4fec-bc41-822f8ebdc163" path="/var/lib/kubelet/pods/525bfcb1-68aa-4fec-bc41-822f8ebdc163/volumes"
Sep 09 20:50:32.375456 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.375416    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"]
Sep 09 20:50:32.375915 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.375781    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="525bfcb1-68aa-4fec-bc41-822f8ebdc163" containerName="authorino"
Sep 09 20:50:32.375915 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.375792    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="525bfcb1-68aa-4fec-bc41-822f8ebdc163" containerName="authorino"
Sep 09 20:50:32.375915 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.375859    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="525bfcb1-68aa-4fec-bc41-822f8ebdc163" containerName="authorino"
Sep 09 20:50:32.379083 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.379062    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:50:32.381851 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.381832    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2ln58\""
Sep 09 20:50:32.381962 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.381836    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 20:50:32.394085 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.394057    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"]
Sep 09 20:50:32.468515 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.468478    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3983dcb-acac-4a61-bd54-8c6acf9e940d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-f6bkm\" (UID: \"a3983dcb-acac-4a61-bd54-8c6acf9e940d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:50:32.468679 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.468527    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbc4\" (UniqueName: \"kubernetes.io/projected/a3983dcb-acac-4a61-bd54-8c6acf9e940d-kube-api-access-mwbc4\") pod \"payload-processing-5b54b7fbb7-f6bkm\" (UID: \"a3983dcb-acac-4a61-bd54-8c6acf9e940d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:50:32.569918 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.569857    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3983dcb-acac-4a61-bd54-8c6acf9e940d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-f6bkm\" (UID: \"a3983dcb-acac-4a61-bd54-8c6acf9e940d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:50:32.570109 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.569966    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbc4\" (UniqueName: \"kubernetes.io/projected/a3983dcb-acac-4a61-bd54-8c6acf9e940d-kube-api-access-mwbc4\") pod \"payload-processing-5b54b7fbb7-f6bkm\" (UID: \"a3983dcb-acac-4a61-bd54-8c6acf9e940d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:50:32.570742 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.570714    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3983dcb-acac-4a61-bd54-8c6acf9e940d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-f6bkm\" (UID: \"a3983dcb-acac-4a61-bd54-8c6acf9e940d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:50:32.579057 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.579030    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbc4\" (UniqueName: \"kubernetes.io/projected/a3983dcb-acac-4a61-bd54-8c6acf9e940d-kube-api-access-mwbc4\") pod \"payload-processing-5b54b7fbb7-f6bkm\" (UID: \"a3983dcb-acac-4a61-bd54-8c6acf9e940d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:50:32.690002 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.689875    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:50:32.971322 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:32.971293    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"]
Sep 09 20:50:32.973360 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:50:32.973335    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3983dcb_acac_4a61_bd54_8c6acf9e940d.slice/crio-c0e1a092777cf108c9ab82a1fc5ee05da5e44e3b76597be7a1c576bfec540dfa WatchSource:0}: Error finding container c0e1a092777cf108c9ab82a1fc5ee05da5e44e3b76597be7a1c576bfec540dfa: Status 404 returned error can't find the container with id c0e1a092777cf108c9ab82a1fc5ee05da5e44e3b76597be7a1c576bfec540dfa
Sep 09 20:50:33.578180 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:33.578143    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm" event={"ID":"a3983dcb-acac-4a61-bd54-8c6acf9e940d","Type":"ContainerStarted","Data":"c0e1a092777cf108c9ab82a1fc5ee05da5e44e3b76597be7a1c576bfec540dfa"}
Sep 09 20:50:35.592592 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:35.592553    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm" event={"ID":"a3983dcb-acac-4a61-bd54-8c6acf9e940d","Type":"ContainerStarted","Data":"74f3d8c63bfbfb0c9b71e4f5e49f30f5513d5c3933e69109b893a268ac7b1f6c"}
Sep 09 20:50:35.593053 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:35.592659    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:50:35.617306 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:35.617246    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm" podStartSLOduration=1.785486241 podStartE2EDuration="3.61722201s" totalImagesPullingTime="1.831735769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:50:35.614389958 +0000 UTC m=+594.670927099" watchObservedRunningTime="2026-09-09 20:50:35.61722201 +0000 UTC m=+594.673759153"
Sep 09 20:50:46.601114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:50:46.601075    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-f6bkm"
Sep 09 20:51:25.866886 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.866847    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"]
Sep 09 20:51:25.871590 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.871563    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:25.875848 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.875815    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 20:51:25.875848 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.875832    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 20:51:25.875848 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.875815    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-szvm2\""
Sep 09 20:51:25.876178 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.875953    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 20:51:25.883276 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.883253    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"]
Sep 09 20:51:25.934951 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.934887    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:25.935184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.934964    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgs7c\" (UniqueName: \"kubernetes.io/projected/2523a081-edff-47f3-b44f-bf548350c37e-kube-api-access-dgs7c\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:25.935184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.935011    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:25.935184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.935102    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:25.935184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.935131    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2523a081-edff-47f3-b44f-bf548350c37e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:25.935184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:25.935156    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.036242 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.036198    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.036439 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.036268    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.036439 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.036291    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2523a081-edff-47f3-b44f-bf548350c37e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.036439 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.036322    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.036439 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.036393    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.036439 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.036416    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgs7c\" (UniqueName: \"kubernetes.io/projected/2523a081-edff-47f3-b44f-bf548350c37e-kube-api-access-dgs7c\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.036711 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.036667    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.036829 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.036807    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.036974 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.036951    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.038850 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.038824    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2523a081-edff-47f3-b44f-bf548350c37e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.039228 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.039204    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2523a081-edff-47f3-b44f-bf548350c37e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.044276 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.044251    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgs7c\" (UniqueName: \"kubernetes.io/projected/2523a081-edff-47f3-b44f-bf548350c37e-kube-api-access-dgs7c\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9\" (UID: \"2523a081-edff-47f3-b44f-bf548350c37e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.185163 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.185057    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:26.466400 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.466369    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"]
Sep 09 20:51:26.468653 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:51:26.468624    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2523a081_edff_47f3_b44f_bf548350c37e.slice/crio-62752ea414e372a6003c3e2eac35699609ffa3c5c057849786284a3d2973e621 WatchSource:0}: Error finding container 62752ea414e372a6003c3e2eac35699609ffa3c5c057849786284a3d2973e621: Status 404 returned error can't find the container with id 62752ea414e372a6003c3e2eac35699609ffa3c5c057849786284a3d2973e621
Sep 09 20:51:26.470049 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.470030    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:51:26.887322 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:26.887249    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9" event={"ID":"2523a081-edff-47f3-b44f-bf548350c37e","Type":"ContainerStarted","Data":"62752ea414e372a6003c3e2eac35699609ffa3c5c057849786284a3d2973e621"}
Sep 09 20:51:27.894685 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:27.894645    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9" event={"ID":"2523a081-edff-47f3-b44f-bf548350c37e","Type":"ContainerStarted","Data":"a5e69b4c5735b30ba3e422b12000c952f4652fa403b783a3386fbd3a5098cb40"}
Sep 09 20:51:36.185482 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:36.185434    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:36.185890 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:36.185509    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:36.197922 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:36.197879    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:51:36.219518 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:36.219470    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9" podStartSLOduration=9.949195341 podStartE2EDuration="11.219454176s" totalImagesPullingTime="1.270258835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:27.912372163 +0000 UTC m=+646.968909306" watchObservedRunningTime="2026-09-09 20:51:36.219454176 +0000 UTC m=+655.275991317"
Sep 09 20:51:36.956501 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:51:36.956464    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9"
Sep 09 20:53:29.072012 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.071965    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b49fd485d-wkpbk"]
Sep 09 20:53:29.075843 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.075816    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b49fd485d-wkpbk"
Sep 09 20:53:29.087525 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.087497    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b49fd485d-wkpbk"]
Sep 09 20:53:29.207659 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.207610    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxnfp\" (UniqueName: \"kubernetes.io/projected/2d2382a8-607e-4b9d-bae2-3a18a220fe7e-kube-api-access-jxnfp\") pod \"authorino-b49fd485d-wkpbk\" (UID: \"2d2382a8-607e-4b9d-bae2-3a18a220fe7e\") " pod="kuadrant-system/authorino-b49fd485d-wkpbk"
Sep 09 20:53:29.207847 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.207679    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d2382a8-607e-4b9d-bae2-3a18a220fe7e-tls-cert\") pod \"authorino-b49fd485d-wkpbk\" (UID: \"2d2382a8-607e-4b9d-bae2-3a18a220fe7e\") " pod="kuadrant-system/authorino-b49fd485d-wkpbk"
Sep 09 20:53:29.309217 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.309174    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxnfp\" (UniqueName: \"kubernetes.io/projected/2d2382a8-607e-4b9d-bae2-3a18a220fe7e-kube-api-access-jxnfp\") pod \"authorino-b49fd485d-wkpbk\" (UID: \"2d2382a8-607e-4b9d-bae2-3a18a220fe7e\") " pod="kuadrant-system/authorino-b49fd485d-wkpbk"
Sep 09 20:53:29.309432 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.309224    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d2382a8-607e-4b9d-bae2-3a18a220fe7e-tls-cert\") pod \"authorino-b49fd485d-wkpbk\" (UID: \"2d2382a8-607e-4b9d-bae2-3a18a220fe7e\") " pod="kuadrant-system/authorino-b49fd485d-wkpbk"
Sep 09 20:53:29.311815 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.311787    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d2382a8-607e-4b9d-bae2-3a18a220fe7e-tls-cert\") pod \"authorino-b49fd485d-wkpbk\" (UID: \"2d2382a8-607e-4b9d-bae2-3a18a220fe7e\") " pod="kuadrant-system/authorino-b49fd485d-wkpbk"
Sep 09 20:53:29.320534 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.320505    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxnfp\" (UniqueName: \"kubernetes.io/projected/2d2382a8-607e-4b9d-bae2-3a18a220fe7e-kube-api-access-jxnfp\") pod \"authorino-b49fd485d-wkpbk\" (UID: \"2d2382a8-607e-4b9d-bae2-3a18a220fe7e\") " pod="kuadrant-system/authorino-b49fd485d-wkpbk"
Sep 09 20:53:29.385640 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.385501    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b49fd485d-wkpbk"
Sep 09 20:53:29.665043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:29.665015    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b49fd485d-wkpbk"]
Sep 09 20:53:29.666745 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:53:29.666706    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d2382a8_607e_4b9d_bae2_3a18a220fe7e.slice/crio-2e48d42e103420574afe1ed8329080ffac5af328a506999f40cd88d66bea91b4 WatchSource:0}: Error finding container 2e48d42e103420574afe1ed8329080ffac5af328a506999f40cd88d66bea91b4: Status 404 returned error can't find the container with id 2e48d42e103420574afe1ed8329080ffac5af328a506999f40cd88d66bea91b4
Sep 09 20:53:30.592810 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:30.592771    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b49fd485d-wkpbk" event={"ID":"2d2382a8-607e-4b9d-bae2-3a18a220fe7e","Type":"ContainerStarted","Data":"2e48d42e103420574afe1ed8329080ffac5af328a506999f40cd88d66bea91b4"}
Sep 09 20:53:31.600229 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:31.600184    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b49fd485d-wkpbk" event={"ID":"2d2382a8-607e-4b9d-bae2-3a18a220fe7e","Type":"ContainerStarted","Data":"d349df2f57b84165ff083607f660a7935c62b03a108f6317591d43452018216d"}
Sep 09 20:53:31.638362 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:31.638303    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b49fd485d-wkpbk" podStartSLOduration=1.545952669 podStartE2EDuration="2.638284732s" totalImagesPullingTime="1.092332063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:31.635785292 +0000 UTC m=+770.692322449" watchObservedRunningTime="2026-09-09 20:53:31.638284732 +0000 UTC m=+770.694821956"
Sep 09 20:53:31.697788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:31.697034    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b99b4f87-nkq96"]
Sep 09 20:53:31.697788 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:31.697281    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-86b99b4f87-nkq96" podUID="6fb4364c-1f79-4832-946b-f6fd2fc47927" containerName="authorino" containerID="cri-o://02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb" gracePeriod=30
Sep 09 20:53:31.982369 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:31.982338    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:53:32.134649 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.134560    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrt4t\" (UniqueName: \"kubernetes.io/projected/6fb4364c-1f79-4832-946b-f6fd2fc47927-kube-api-access-qrt4t\") pod \"6fb4364c-1f79-4832-946b-f6fd2fc47927\" (UID: \"6fb4364c-1f79-4832-946b-f6fd2fc47927\") "
Sep 09 20:53:32.134827 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.134705    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb4364c-1f79-4832-946b-f6fd2fc47927-tls-cert\") pod \"6fb4364c-1f79-4832-946b-f6fd2fc47927\" (UID: \"6fb4364c-1f79-4832-946b-f6fd2fc47927\") "
Sep 09 20:53:32.137028 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.136988    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb4364c-1f79-4832-946b-f6fd2fc47927-kube-api-access-qrt4t" (OuterVolumeSpecName: "kube-api-access-qrt4t") pod "6fb4364c-1f79-4832-946b-f6fd2fc47927" (UID: "6fb4364c-1f79-4832-946b-f6fd2fc47927"). InnerVolumeSpecName "kube-api-access-qrt4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:53:32.146960 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.146886    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fb4364c-1f79-4832-946b-f6fd2fc47927-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6fb4364c-1f79-4832-946b-f6fd2fc47927" (UID: "6fb4364c-1f79-4832-946b-f6fd2fc47927"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:53:32.236297 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.236258    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrt4t\" (UniqueName: \"kubernetes.io/projected/6fb4364c-1f79-4832-946b-f6fd2fc47927-kube-api-access-qrt4t\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:53:32.236297 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.236291    2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb4364c-1f79-4832-946b-f6fd2fc47927-tls-cert\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:53:32.607317 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.607276    2555 generic.go:356] "Generic (PLEG): container finished" podID="6fb4364c-1f79-4832-946b-f6fd2fc47927" containerID="02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb" exitCode=0
Sep 09 20:53:32.607317 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.607326    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b99b4f87-nkq96"
Sep 09 20:53:32.607833 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.607366    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b99b4f87-nkq96" event={"ID":"6fb4364c-1f79-4832-946b-f6fd2fc47927","Type":"ContainerDied","Data":"02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb"}
Sep 09 20:53:32.607833 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.607417    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b99b4f87-nkq96" event={"ID":"6fb4364c-1f79-4832-946b-f6fd2fc47927","Type":"ContainerDied","Data":"4f071d14dd8e1a37354d0b98db80d3a17316853a6a29e72b953452e358a1bbac"}
Sep 09 20:53:32.607833 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.607437    2555 scope.go:117] "RemoveContainer" containerID="02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb"
Sep 09 20:53:32.623051 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.622932    2555 scope.go:117] "RemoveContainer" containerID="02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb"
Sep 09 20:53:32.623702 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:32.623669    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb\": container with ID starting with 02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb not found: ID does not exist" containerID="02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb"
Sep 09 20:53:32.623822 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.623711    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb"} err="failed to get container status \"02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb\": rpc error: code = NotFound desc = could not find container \"02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb\": container with ID starting with 02e2cf5de54dcec3fa5a8eeab7a00710f04dc124bc88703c240e2a3af734ddeb not found: ID does not exist"
Sep 09 20:53:32.644178 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.644143    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b99b4f87-nkq96"]
Sep 09 20:53:32.665852 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:32.665815    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86b99b4f87-nkq96"]
Sep 09 20:53:33.432447 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:33.432401    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fb4364c-1f79-4832-946b-f6fd2fc47927" path="/var/lib/kubelet/pods/6fb4364c-1f79-4832-946b-f6fd2fc47927/volumes"
Sep 09 20:53:52.292565 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.292527    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7549-fd5df3"]
Sep 09 20:53:52.293130 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.292938    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb4364c-1f79-4832-946b-f6fd2fc47927" containerName="authorino"
Sep 09 20:53:52.293130 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.292951    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb4364c-1f79-4832-946b-f6fd2fc47927" containerName="authorino"
Sep 09 20:53:52.293130 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.293020    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb4364c-1f79-4832-946b-f6fd2fc47927" containerName="authorino"
Sep 09 20:53:52.297450 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.297427    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:53:52.300980 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.300955    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n65wg\""
Sep 09 20:53:52.303813 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.303784    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7549-fd5df3"]
Sep 09 20:53:52.318955 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.318918    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb2hj\" (UniqueName: \"kubernetes.io/projected/253c2a38-286c-4eaf-89aa-b60c7b049849-kube-api-access-cb2hj\") pod \"test-curl-7549-fd5df3\" (UID: \"253c2a38-286c-4eaf-89aa-b60c7b049849\") " pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:53:52.420336 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.420301    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb2hj\" (UniqueName: \"kubernetes.io/projected/253c2a38-286c-4eaf-89aa-b60c7b049849-kube-api-access-cb2hj\") pod \"test-curl-7549-fd5df3\" (UID: \"253c2a38-286c-4eaf-89aa-b60c7b049849\") " pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:53:52.429400 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.429365    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb2hj\" (UniqueName: \"kubernetes.io/projected/253c2a38-286c-4eaf-89aa-b60c7b049849-kube-api-access-cb2hj\") pod \"test-curl-7549-fd5df3\" (UID: \"253c2a38-286c-4eaf-89aa-b60c7b049849\") " pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:53:52.609351 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.609256    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:53:52.891304 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:52.891274    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7549-fd5df3"]
Sep 09 20:53:52.893418 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:53:52.893384    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod253c2a38_286c_4eaf_89aa_b60c7b049849.slice/crio-08db7531785b2665c8e1d20a02c3de7fa9644f2b2dd47820c7f74fe668dfaa1e WatchSource:0}: Error finding container 08db7531785b2665c8e1d20a02c3de7fa9644f2b2dd47820c7f74fe668dfaa1e: Status 404 returned error can't find the container with id 08db7531785b2665c8e1d20a02c3de7fa9644f2b2dd47820c7f74fe668dfaa1e
Sep 09 20:53:53.737270 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:53.737230    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7549-fd5df3" event={"ID":"253c2a38-286c-4eaf-89aa-b60c7b049849","Type":"ContainerStarted","Data":"08db7531785b2665c8e1d20a02c3de7fa9644f2b2dd47820c7f74fe668dfaa1e"}
Sep 09 20:53:54.747769 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.747739    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"]
Sep 09 20:53:54.752532 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.752512    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.755853 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.755819    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 20:53:54.756140 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.756116    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-5eef90-serving-cert\""
Sep 09 20:53:54.756800 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.756774    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 20:53:54.757071 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.757053    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 20:53:54.757341 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.757322    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2mhvs\""
Sep 09 20:53:54.838792 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.838739    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pndtn\" (UniqueName: \"kubernetes.io/projected/bd1bf360-746e-4a7a-b507-70339d00ae1d-kube-api-access-pndtn\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.839094 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.838853    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.839094 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.838890    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-metrics-certs\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.839094 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.838937    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bf360-746e-4a7a-b507-70339d00ae1d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.843120 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.843089    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"]
Sep 09 20:53:54.940344 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.940302    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pndtn\" (UniqueName: \"kubernetes.io/projected/bd1bf360-746e-4a7a-b507-70339d00ae1d-kube-api-access-pndtn\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.940534 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.940363    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.940534 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.940398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-metrics-certs\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.940534 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.940428    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bf360-746e-4a7a-b507-70339d00ae1d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.940691 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:54.940529    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-serving-cert: secret "maas-api-e2e-inf-a-5eef90-serving-cert" not found
Sep 09 20:53:54.940691 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:54.940627    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls podName:bd1bf360-746e-4a7a-b507-70339d00ae1d nodeName:}" failed. No retries permitted until 2026-09-09 20:53:55.440607977 +0000 UTC m=+794.497145102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls") pod "maas-api-e2e-inf-a-5eef90-7df559fff-fwckp" (UID: "bd1bf360-746e-4a7a-b507-70339d00ae1d") : secret "maas-api-e2e-inf-a-5eef90-serving-cert" not found
Sep 09 20:53:54.941202 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.941177    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bf360-746e-4a7a-b507-70339d00ae1d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.943058 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.943027    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-metrics-certs\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:54.957293 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:54.957263    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pndtn\" (UniqueName: \"kubernetes.io/projected/bd1bf360-746e-4a7a-b507-70339d00ae1d-kube-api-access-pndtn\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:55.446023 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:55.445847    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:55.446267 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:55.446035    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-serving-cert: secret "maas-api-e2e-inf-a-5eef90-serving-cert" not found
Sep 09 20:53:55.446267 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:55.446122    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls podName:bd1bf360-746e-4a7a-b507-70339d00ae1d nodeName:}" failed. No retries permitted until 2026-09-09 20:53:56.446101284 +0000 UTC m=+795.502638417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls") pod "maas-api-e2e-inf-a-5eef90-7df559fff-fwckp" (UID: "bd1bf360-746e-4a7a-b507-70339d00ae1d") : secret "maas-api-e2e-inf-a-5eef90-serving-cert" not found
Sep 09 20:53:56.456604 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:56.456565    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:56.459577 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:56.459543    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls\") pod \"maas-api-e2e-inf-a-5eef90-7df559fff-fwckp\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:56.574245 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:56.574205    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:53:56.759055 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:56.758962    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7549-fd5df3" event={"ID":"253c2a38-286c-4eaf-89aa-b60c7b049849","Type":"ContainerStarted","Data":"0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28"}
Sep 09 20:53:56.826253 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:56.826198    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7549-fd5df3" podStartSLOduration=1.093749145 podStartE2EDuration="4.826180196s" totalImagesPullingTime="3.732431051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:56.825741104 +0000 UTC m=+795.882278247" watchObservedRunningTime="2026-09-09 20:53:56.826180196 +0000 UTC m=+795.882717339"
Sep 09 20:53:56.965389 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:56.965361    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"]
Sep 09 20:53:56.966953 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:53:56.966925    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1bf360_746e_4a7a_b507_70339d00ae1d.slice/crio-1abd165a74fd86c0970b1aa263e4a51f21b19c081a98feba5f9a96e645378552 WatchSource:0}: Error finding container 1abd165a74fd86c0970b1aa263e4a51f21b19c081a98feba5f9a96e645378552: Status 404 returned error can't find the container with id 1abd165a74fd86c0970b1aa263e4a51f21b19c081a98feba5f9a96e645378552
Sep 09 20:53:57.766477 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.766374    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp" event={"ID":"bd1bf360-746e-4a7a-b507-70339d00ae1d","Type":"ContainerStarted","Data":"1abd165a74fd86c0970b1aa263e4a51f21b19c081a98feba5f9a96e645378552"}
Sep 09 20:53:57.768552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.768525    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7549-fd5df3"]
Sep 09 20:53:57.786261 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.786229    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7549-fd5df3"]
Sep 09 20:53:57.915884 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.915840    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7549-1ee72a"]
Sep 09 20:53:57.916449 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.916419    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253c2a38-286c-4eaf-89aa-b60c7b049849" containerName="test-curl-7549-fd5df3"
Sep 09 20:53:57.916449 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.916444    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="253c2a38-286c-4eaf-89aa-b60c7b049849" containerName="test-curl-7549-fd5df3"
Sep 09 20:53:57.916660 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.916557    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="253c2a38-286c-4eaf-89aa-b60c7b049849" containerName="test-curl-7549-fd5df3"
Sep 09 20:53:57.919720 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.919697    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:53:57.939523 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.939485    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7549-1ee72a"]
Sep 09 20:53:57.971684 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:57.971531    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f48xr\" (UniqueName: \"kubernetes.io/projected/26ca4997-b1d7-4750-9239-2ab591510acd-kube-api-access-f48xr\") pod \"test-curl-7549-1ee72a\" (UID: \"26ca4997-b1d7-4750-9239-2ab591510acd\") " pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:53:58.072736 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.072675    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f48xr\" (UniqueName: \"kubernetes.io/projected/26ca4997-b1d7-4750-9239-2ab591510acd-kube-api-access-f48xr\") pod \"test-curl-7549-1ee72a\" (UID: \"26ca4997-b1d7-4750-9239-2ab591510acd\") " pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:53:58.086306 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.086274    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f48xr\" (UniqueName: \"kubernetes.io/projected/26ca4997-b1d7-4750-9239-2ab591510acd-kube-api-access-f48xr\") pod \"test-curl-7549-1ee72a\" (UID: \"26ca4997-b1d7-4750-9239-2ab591510acd\") " pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:53:58.233437 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.233392    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:53:58.562599 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:53:58.562559    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26ca4997_b1d7_4750_9239_2ab591510acd.slice/crio-3bba756bb7aec93136c4c0ee22eee82f4aff3c9aacd8ff5fb526afa7f29071ff WatchSource:0}: Error finding container 3bba756bb7aec93136c4c0ee22eee82f4aff3c9aacd8ff5fb526afa7f29071ff: Status 404 returned error can't find the container with id 3bba756bb7aec93136c4c0ee22eee82f4aff3c9aacd8ff5fb526afa7f29071ff
Sep 09 20:53:58.571305 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.571275    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7549-1ee72a"]
Sep 09 20:53:58.775324 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.775282    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7549-1ee72a" event={"ID":"26ca4997-b1d7-4750-9239-2ab591510acd","Type":"ContainerStarted","Data":"72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c"}
Sep 09 20:53:58.775812 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.775343    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7549-1ee72a" event={"ID":"26ca4997-b1d7-4750-9239-2ab591510acd","Type":"ContainerStarted","Data":"3bba756bb7aec93136c4c0ee22eee82f4aff3c9aacd8ff5fb526afa7f29071ff"}
Sep 09 20:53:58.775812 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.775562    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7549-fd5df3" podUID="253c2a38-286c-4eaf-89aa-b60c7b049849" containerName="test-curl-7549-fd5df3" containerID="cri-o://0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28" gracePeriod=2
Sep 09 20:53:58.819299 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.819196    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7549-1ee72a" podStartSLOduration=1.819179468 podStartE2EDuration="1.819179468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:58.817688522 +0000 UTC m=+797.874225664" watchObservedRunningTime="2026-09-09 20:53:58.819179468 +0000 UTC m=+797.875716618"
Sep 09 20:53:58.828410 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:58.828366    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7549-fd5df3\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="253c2a38-286c-4eaf-89aa-b60c7b049849" pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:53:58.939437 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.939392    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"]
Sep 09 20:53:58.948409 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.948375    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:53:58.951234 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:58.951196    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7549-fd5df3\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="253c2a38-286c-4eaf-89aa-b60c7b049849" pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:53:58.951234 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.951220    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-47e41c\""
Sep 09 20:53:58.973119 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.973087    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"]
Sep 09 20:53:58.981629 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.981595    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f197d3e9-0669-43cc-8ade-cb275ee4d699-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k\" (UID: \"f197d3e9-0669-43cc-8ade-cb275ee4d699\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:53:58.981829 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:58.981673    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-578j6\" (UniqueName: \"kubernetes.io/projected/f197d3e9-0669-43cc-8ade-cb275ee4d699-kube-api-access-578j6\") pod \"payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k\" (UID: \"f197d3e9-0669-43cc-8ade-cb275ee4d699\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:53:59.082766 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.082670    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f197d3e9-0669-43cc-8ade-cb275ee4d699-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k\" (UID: \"f197d3e9-0669-43cc-8ade-cb275ee4d699\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:53:59.082975 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.082764    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-578j6\" (UniqueName: \"kubernetes.io/projected/f197d3e9-0669-43cc-8ade-cb275ee4d699-kube-api-access-578j6\") pod \"payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k\" (UID: \"f197d3e9-0669-43cc-8ade-cb275ee4d699\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:53:59.083564 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.083535    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f197d3e9-0669-43cc-8ade-cb275ee4d699-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k\" (UID: \"f197d3e9-0669-43cc-8ade-cb275ee4d699\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:53:59.095276 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.095240    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-578j6\" (UniqueName: \"kubernetes.io/projected/f197d3e9-0669-43cc-8ade-cb275ee4d699-kube-api-access-578j6\") pod \"payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k\" (UID: \"f197d3e9-0669-43cc-8ade-cb275ee4d699\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:53:59.260999 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.260961    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:53:59.352553 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.352469    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"]
Sep 09 20:53:59.360782 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.360750    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.363430 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.363398    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-d36b91-serving-cert\""
Sep 09 20:53:59.378325 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.378290    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"]
Sep 09 20:53:59.388509 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.388365    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4h8\" (UniqueName: \"kubernetes.io/projected/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-kube-api-access-rf4h8\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.388509 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.388435    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-metrics-certs\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.388742 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.388567    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.388742 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.388635    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.418784 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:59.418747    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7549-fd5df3\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="253c2a38-286c-4eaf-89aa-b60c7b049849" pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:53:59.490237 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.490196    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4h8\" (UniqueName: \"kubernetes.io/projected/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-kube-api-access-rf4h8\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.490439 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.490277    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-metrics-certs\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.490439 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.490372    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.490439 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.490431    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.490618 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:59.490502    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-serving-cert: secret "maas-api-e2e-worker-w0-d36b91-serving-cert" not found
Sep 09 20:53:59.490618 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:59.490577    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls podName:ee7caeeb-ae57-4e7b-aebc-96cd7789377f nodeName:}" failed. No retries permitted until 2026-09-09 20:53:59.990554373 +0000 UTC m=+799.047091510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls") pod "maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62" (UID: "ee7caeeb-ae57-4e7b-aebc-96cd7789377f") : secret "maas-api-e2e-worker-w0-d36b91-serving-cert" not found
Sep 09 20:53:59.491302 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.491271    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.493217 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.493192    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-metrics-certs\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.523956 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.523923    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4h8\" (UniqueName: \"kubernetes.io/projected/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-kube-api-access-rf4h8\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.665144 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.665056    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7549-1ee72a"]
Sep 09 20:53:59.678050 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.678004    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7549-1ee72a"]
Sep 09 20:53:59.782320 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:59.782290    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7549-1ee72a" container="test-curl-7549-1ee72a"
Sep 09 20:53:59.997551 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:53:59.997524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:53:59.997706 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:59.997689    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-serving-cert: secret "maas-api-e2e-worker-w0-d36b91-serving-cert" not found
Sep 09 20:53:59.997763 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:53:59.997754    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls podName:ee7caeeb-ae57-4e7b-aebc-96cd7789377f nodeName:}" failed. No retries permitted until 2026-09-09 20:54:00.997736924 +0000 UTC m=+800.054274059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls") pod "maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62" (UID: "ee7caeeb-ae57-4e7b-aebc-96cd7789377f") : secret "maas-api-e2e-worker-w0-d36b91-serving-cert" not found
Sep 09 20:54:00.146163 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.146132    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"]
Sep 09 20:54:00.149064 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:54:00.149027    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf197d3e9_0669_43cc_8ade_cb275ee4d699.slice/crio-e1eb3e57f5e2c54bf6d71bdb371808b607704c9eb6196723f6a4c1cc44139905 WatchSource:0}: Error finding container e1eb3e57f5e2c54bf6d71bdb371808b607704c9eb6196723f6a4c1cc44139905: Status 404 returned error can't find the container with id e1eb3e57f5e2c54bf6d71bdb371808b607704c9eb6196723f6a4c1cc44139905
Sep 09 20:54:00.478087 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.478001    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"]
Sep 09 20:54:00.478443 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.478429    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ca4997-b1d7-4750-9239-2ab591510acd" containerName="test-curl-7549-1ee72a"
Sep 09 20:54:00.478487 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.478446    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ca4997-b1d7-4750-9239-2ab591510acd" containerName="test-curl-7549-1ee72a"
Sep 09 20:54:00.478531 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.478522    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ca4997-b1d7-4750-9239-2ab591510acd" containerName="test-curl-7549-1ee72a"
Sep 09 20:54:00.481804 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.481780    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:00.486024 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.485998    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-d36b91\""
Sep 09 20:54:00.486177 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.486090    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-d36b91-dockercfg-jtk9p\""
Sep 09 20:54:00.511593 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.511562    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"]
Sep 09 20:54:00.604428 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.604387    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nxnj\" (UniqueName: \"kubernetes.io/projected/787b4554-f547-47e3-8bbf-28a6c71013f6-kube-api-access-5nxnj\") pod \"payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx\" (UID: \"787b4554-f547-47e3-8bbf-28a6c71013f6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:00.604645 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.604589    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787b4554-f547-47e3-8bbf-28a6c71013f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx\" (UID: \"787b4554-f547-47e3-8bbf-28a6c71013f6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:00.705634 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.705581    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787b4554-f547-47e3-8bbf-28a6c71013f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx\" (UID: \"787b4554-f547-47e3-8bbf-28a6c71013f6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:00.705827 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.705641    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nxnj\" (UniqueName: \"kubernetes.io/projected/787b4554-f547-47e3-8bbf-28a6c71013f6-kube-api-access-5nxnj\") pod \"payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx\" (UID: \"787b4554-f547-47e3-8bbf-28a6c71013f6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:00.706802 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.706770    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787b4554-f547-47e3-8bbf-28a6c71013f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx\" (UID: \"787b4554-f547-47e3-8bbf-28a6c71013f6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:00.739238 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.739151    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nxnj\" (UniqueName: \"kubernetes.io/projected/787b4554-f547-47e3-8bbf-28a6c71013f6-kube-api-access-5nxnj\") pod \"payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx\" (UID: \"787b4554-f547-47e3-8bbf-28a6c71013f6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:00.790970 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.790933    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k" event={"ID":"f197d3e9-0669-43cc-8ade-cb275ee4d699","Type":"ContainerStarted","Data":"1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b"}
Sep 09 20:54:00.791350 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.790999    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k" event={"ID":"f197d3e9-0669-43cc-8ade-cb275ee4d699","Type":"ContainerStarted","Data":"e1eb3e57f5e2c54bf6d71bdb371808b607704c9eb6196723f6a4c1cc44139905"}
Sep 09 20:54:00.791350 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.791046    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:54:00.792889 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.792867    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:00.793023 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.792870    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp" event={"ID":"bd1bf360-746e-4a7a-b507-70339d00ae1d","Type":"ContainerStarted","Data":"be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99"}
Sep 09 20:54:00.793103 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.793088    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:54:00.793184 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.793162    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7549-1ee72a" podUID="26ca4997-b1d7-4750-9239-2ab591510acd" containerName="test-curl-7549-1ee72a" containerID="cri-o://72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c" gracePeriod=2
Sep 09 20:54:00.910240 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.910161    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k" podStartSLOduration=2.91013593 podStartE2EDuration="2.91013593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:00.907063637 +0000 UTC m=+799.963600780" watchObservedRunningTime="2026-09-09 20:54:00.91013593 +0000 UTC m=+799.966673073"
Sep 09 20:54:00.945954 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.945862    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp" podStartSLOduration=3.980056427 podStartE2EDuration="6.945839155s" totalImagesPullingTime="2.965782728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:00.94410118 +0000 UTC m=+800.000638316" watchObservedRunningTime="2026-09-09 20:54:00.945839155 +0000 UTC m=+800.002376300"
Sep 09 20:54:00.956081 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:00.956049    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7549-1ee72a\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="26ca4997-b1d7-4750-9239-2ab591510acd" pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:54:00.992500 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:00.992425    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:54:00.996002 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:00.995963    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7549-1ee72a\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="26ca4997-b1d7-4750-9239-2ab591510acd" pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:54:01.008232 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.008201    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:54:01.010976 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.010948    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:54:01.109732 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.109695    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb2hj\" (UniqueName: \"kubernetes.io/projected/253c2a38-286c-4eaf-89aa-b60c7b049849-kube-api-access-cb2hj\") pod \"253c2a38-286c-4eaf-89aa-b60c7b049849\" (UID: \"253c2a38-286c-4eaf-89aa-b60c7b049849\") "
Sep 09 20:54:01.112083 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.112060    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"]
Sep 09 20:54:01.112766 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.112738    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253c2a38-286c-4eaf-89aa-b60c7b049849-kube-api-access-cb2hj" (OuterVolumeSpecName: "kube-api-access-cb2hj") pod "253c2a38-286c-4eaf-89aa-b60c7b049849" (UID: "253c2a38-286c-4eaf-89aa-b60c7b049849"). InnerVolumeSpecName "kube-api-access-cb2hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:54:01.114536 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:54:01.114507    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787b4554_f547_47e3_8bbf_28a6c71013f6.slice/crio-c82ddac415c855fc6b9e7c87d955349859b0ef0136a7c26e27d64ba216a933a9 WatchSource:0}: Error finding container c82ddac415c855fc6b9e7c87d955349859b0ef0136a7c26e27d64ba216a933a9: Status 404 returned error can't find the container with id c82ddac415c855fc6b9e7c87d955349859b0ef0136a7c26e27d64ba216a933a9
Sep 09 20:54:01.174783 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.174749    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:54:01.210863 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.210827    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb2hj\" (UniqueName: \"kubernetes.io/projected/253c2a38-286c-4eaf-89aa-b60c7b049849-kube-api-access-cb2hj\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:54:01.430828 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:01.430791    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7549-1ee72a\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="26ca4997-b1d7-4750-9239-2ab591510acd" pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:54:01.433056 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.433030    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253c2a38-286c-4eaf-89aa-b60c7b049849" path="/var/lib/kubelet/pods/253c2a38-286c-4eaf-89aa-b60c7b049849/volumes"
Sep 09 20:54:01.470723 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.470690    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"]
Sep 09 20:54:01.470934 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:54:01.470896    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7caeeb_ae57_4e7b_aebc_96cd7789377f.slice/crio-39791db7003b1656c634deab535852cfeb42500c153ec10bbb58afa0c884ac56 WatchSource:0}: Error finding container 39791db7003b1656c634deab535852cfeb42500c153ec10bbb58afa0c884ac56: Status 404 returned error can't find the container with id 39791db7003b1656c634deab535852cfeb42500c153ec10bbb58afa0c884ac56
Sep 09 20:54:01.802532 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.802487    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62" event={"ID":"ee7caeeb-ae57-4e7b-aebc-96cd7789377f","Type":"ContainerStarted","Data":"39791db7003b1656c634deab535852cfeb42500c153ec10bbb58afa0c884ac56"}
Sep 09 20:54:01.804094 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.804064    2555 generic.go:356] "Generic (PLEG): container finished" podID="253c2a38-286c-4eaf-89aa-b60c7b049849" containerID="0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28" exitCode=137
Sep 09 20:54:01.804224 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.804137    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7549-fd5df3"
Sep 09 20:54:01.804224 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.804177    2555 scope.go:117] "RemoveContainer" containerID="0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28"
Sep 09 20:54:01.807680 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.807585    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx" event={"ID":"787b4554-f547-47e3-8bbf-28a6c71013f6","Type":"ContainerStarted","Data":"f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac"}
Sep 09 20:54:01.807680 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.807637    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx" event={"ID":"787b4554-f547-47e3-8bbf-28a6c71013f6","Type":"ContainerStarted","Data":"c82ddac415c855fc6b9e7c87d955349859b0ef0136a7c26e27d64ba216a933a9"}
Sep 09 20:54:01.808014 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.807953    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:01.816587 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.816565    2555 scope.go:117] "RemoveContainer" containerID="0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28"
Sep 09 20:54:01.816917 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:01.816879    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28\": container with ID starting with 0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28 not found: ID does not exist" containerID="0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28"
Sep 09 20:54:01.817047 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.816939    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28"} err="failed to get container status \"0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28\": rpc error: code = NotFound desc = could not find container \"0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28\": container with ID starting with 0872a8d4c55db1d6ff6e41ac51d8527879d9562bc76ff0d22786fb9890607f28 not found: ID does not exist"
Sep 09 20:54:01.832786 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:01.832619    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx" podStartSLOduration=1.832600081 podStartE2EDuration="1.832600081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:01.831742006 +0000 UTC m=+800.888279147" watchObservedRunningTime="2026-09-09 20:54:01.832600081 +0000 UTC m=+800.889137203"
Sep 09 20:54:02.816978 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:02.816943    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62" event={"ID":"ee7caeeb-ae57-4e7b-aebc-96cd7789377f","Type":"ContainerStarted","Data":"b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef"}
Sep 09 20:54:02.817406 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:02.817073    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:54:02.844710 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:02.844641    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62" podStartSLOduration=3.317516878 podStartE2EDuration="3.844613457s" totalImagesPullingTime="527.096579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:02.842838415 +0000 UTC m=+801.899375573" watchObservedRunningTime="2026-09-09 20:54:02.844613457 +0000 UTC m=+801.901150600"
Sep 09 20:54:02.992273 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:02.992244    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:54:03.029402 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:03.029366    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f48xr\" (UniqueName: \"kubernetes.io/projected/26ca4997-b1d7-4750-9239-2ab591510acd-kube-api-access-f48xr\") pod \"26ca4997-b1d7-4750-9239-2ab591510acd\" (UID: \"26ca4997-b1d7-4750-9239-2ab591510acd\") "
Sep 09 20:54:03.031692 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:03.031664    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ca4997-b1d7-4750-9239-2ab591510acd-kube-api-access-f48xr" (OuterVolumeSpecName: "kube-api-access-f48xr") pod "26ca4997-b1d7-4750-9239-2ab591510acd" (UID: "26ca4997-b1d7-4750-9239-2ab591510acd"). InnerVolumeSpecName "kube-api-access-f48xr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:54:03.130493 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:03.130396    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f48xr\" (UniqueName: \"kubernetes.io/projected/26ca4997-b1d7-4750-9239-2ab591510acd-kube-api-access-f48xr\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:54:03.432050 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:03.431966    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ca4997-b1d7-4750-9239-2ab591510acd" path="/var/lib/kubelet/pods/26ca4997-b1d7-4750-9239-2ab591510acd/volumes"
Sep 09 20:54:03.825520 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:03.825484    2555 generic.go:356] "Generic (PLEG): container finished" podID="26ca4997-b1d7-4750-9239-2ab591510acd" containerID="72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c" exitCode=137
Sep 09 20:54:03.826001 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:03.825547    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7549-1ee72a"
Sep 09 20:54:03.826001 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:03.825629    2555 scope.go:117] "RemoveContainer" containerID="72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c"
Sep 09 20:54:03.836454 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:03.836427    2555 scope.go:117] "RemoveContainer" containerID="72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c"
Sep 09 20:54:03.836866 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:03.836840    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c\": container with ID starting with 72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c not found: ID does not exist" containerID="72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c"
Sep 09 20:54:03.837011 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:03.836874    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c"} err="failed to get container status \"72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c\": rpc error: code = NotFound desc = could not find container \"72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c\": container with ID starting with 72aa328773e858078793e2229f1ea47748b43bfeaf52543802b1e6409bce168c not found: ID does not exist"
Sep 09 20:54:05.148498 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.148462    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"]
Sep 09 20:54:05.153461 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.153429    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.159336 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.159310    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-864e4e-serving-cert\""
Sep 09 20:54:05.177176 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.177145    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"]
Sep 09 20:54:05.252714 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.252674    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj9bq\" (UniqueName: \"kubernetes.io/projected/a20f4d9c-6efb-4c60-aef3-609f3cb46532-kube-api-access-bj9bq\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.252714 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.252721    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-maas-api-tls\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.252982 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.252837    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20f4d9c-6efb-4c60-aef3-609f3cb46532-openshift-service-ca\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.252982 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.252891    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-metrics-certs\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.354331 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.354292    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20f4d9c-6efb-4c60-aef3-609f3cb46532-openshift-service-ca\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.354331 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.354351    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-metrics-certs\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.354612 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.354392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj9bq\" (UniqueName: \"kubernetes.io/projected/a20f4d9c-6efb-4c60-aef3-609f3cb46532-kube-api-access-bj9bq\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.354612 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.354418    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-maas-api-tls\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.355051 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.355027    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20f4d9c-6efb-4c60-aef3-609f3cb46532-openshift-service-ca\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.357400 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.357377    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-metrics-certs\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.357490 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.357419    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-maas-api-tls\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.370066 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.370035    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj9bq\" (UniqueName: \"kubernetes.io/projected/a20f4d9c-6efb-4c60-aef3-609f3cb46532-kube-api-access-bj9bq\") pod \"maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.468138 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.468052    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:05.756867 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.756839    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"]
Sep 09 20:54:05.757817 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:54:05.757788    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20f4d9c_6efb_4c60_aef3_609f3cb46532.slice/crio-1a351f08b627f22e092d6c01049ae6572debd9c7e22c9b7e9c7eadec11b25936 WatchSource:0}: Error finding container 1a351f08b627f22e092d6c01049ae6572debd9c7e22c9b7e9c7eadec11b25936: Status 404 returned error can't find the container with id 1a351f08b627f22e092d6c01049ae6572debd9c7e22c9b7e9c7eadec11b25936
Sep 09 20:54:05.851145 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:05.851099    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc" event={"ID":"a20f4d9c-6efb-4c60-aef3-609f3cb46532","Type":"ContainerStarted","Data":"1a351f08b627f22e092d6c01049ae6572debd9c7e22c9b7e9c7eadec11b25936"}
Sep 09 20:54:06.383016 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.382984    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"]
Sep 09 20:54:06.387996 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.387975    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:06.392171 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.392147    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-864e4e\""
Sep 09 20:54:06.415783 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.415748    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"]
Sep 09 20:54:06.467120 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.467073    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8956a604-ef37-475f-a846-561de6a4308c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq\" (UID: \"8956a604-ef37-475f-a846-561de6a4308c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:06.467288 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.467201    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fztcg\" (UniqueName: \"kubernetes.io/projected/8956a604-ef37-475f-a846-561de6a4308c-kube-api-access-fztcg\") pod \"payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq\" (UID: \"8956a604-ef37-475f-a846-561de6a4308c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:06.568386 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.568300    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fztcg\" (UniqueName: \"kubernetes.io/projected/8956a604-ef37-475f-a846-561de6a4308c-kube-api-access-fztcg\") pod \"payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq\" (UID: \"8956a604-ef37-475f-a846-561de6a4308c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:06.568538 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.568400    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8956a604-ef37-475f-a846-561de6a4308c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq\" (UID: \"8956a604-ef37-475f-a846-561de6a4308c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:06.569078 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.569054    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8956a604-ef37-475f-a846-561de6a4308c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq\" (UID: \"8956a604-ef37-475f-a846-561de6a4308c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:06.579423 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.579393    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fztcg\" (UniqueName: \"kubernetes.io/projected/8956a604-ef37-475f-a846-561de6a4308c-kube-api-access-fztcg\") pod \"payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq\" (UID: \"8956a604-ef37-475f-a846-561de6a4308c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:06.699398 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.699353    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:06.814067 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.814041    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 20:54:06.859810 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.859703    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc" event={"ID":"a20f4d9c-6efb-4c60-aef3-609f3cb46532","Type":"ContainerStarted","Data":"589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc"}
Sep 09 20:54:06.859991 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.859895    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:06.893956 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.893837    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc" podStartSLOduration=1.335764272 podStartE2EDuration="1.893814402s" totalImagesPullingTime="558.05013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:06.890668211 +0000 UTC m=+805.947205355" watchObservedRunningTime="2026-09-09 20:54:06.893814402 +0000 UTC m=+805.950351549"
Sep 09 20:54:06.994269 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:06.994241    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"]
Sep 09 20:54:06.996638 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:54:06.996607    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8956a604_ef37_475f_a846_561de6a4308c.slice/crio-ad5fedc372b795442690b953976d20a1e9fd3c54e37165825dbf4a2526e68338 WatchSource:0}: Error finding container ad5fedc372b795442690b953976d20a1e9fd3c54e37165825dbf4a2526e68338: Status 404 returned error can't find the container with id ad5fedc372b795442690b953976d20a1e9fd3c54e37165825dbf4a2526e68338
Sep 09 20:54:07.868761 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:07.868723    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq" event={"ID":"8956a604-ef37-475f-a846-561de6a4308c","Type":"ContainerStarted","Data":"a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82"}
Sep 09 20:54:07.869193 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:07.868781    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq" event={"ID":"8956a604-ef37-475f-a846-561de6a4308c","Type":"ContainerStarted","Data":"ad5fedc372b795442690b953976d20a1e9fd3c54e37165825dbf4a2526e68338"}
Sep 09 20:54:07.889838 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:07.889784    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq" podStartSLOduration=1.889764754 podStartE2EDuration="1.889764754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:54:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:07.888348234 +0000 UTC m=+806.944885378" watchObservedRunningTime="2026-09-09 20:54:07.889764754 +0000 UTC m=+806.946301896"
Sep 09 20:54:08.475151 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.475114    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"]
Sep 09 20:54:08.479378 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.479349    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.483758 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.483732    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-04cfc947-serving-cert\""
Sep 09 20:54:08.498704 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.498396    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"]
Sep 09 20:54:08.588457 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.588417    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.588457 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.588462    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9xzb\" (UniqueName: \"kubernetes.io/projected/ab433cce-6ef5-443a-9530-5cee12b1bfb0-kube-api-access-b9xzb\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.588706 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.588571    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab433cce-6ef5-443a-9530-5cee12b1bfb0-openshift-service-ca\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.588706 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.588605    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-metrics-certs\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.689939 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.689841    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.689939 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.689944    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9xzb\" (UniqueName: \"kubernetes.io/projected/ab433cce-6ef5-443a-9530-5cee12b1bfb0-kube-api-access-b9xzb\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.690245 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.690031    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab433cce-6ef5-443a-9530-5cee12b1bfb0-openshift-service-ca\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.690245 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:08.690035    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-serving-cert: secret "maas-api-e2e-ait-04cfc947-serving-cert" not found
Sep 09 20:54:08.690245 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.690062    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-metrics-certs\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.690245 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:08.690128    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls podName:ab433cce-6ef5-443a-9530-5cee12b1bfb0 nodeName:}" failed. No retries permitted until 2026-09-09 20:54:09.190103311 +0000 UTC m=+808.246640448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls") pod "maas-api-e2e-ait-04cfc947-684df4696-jjqwx" (UID: "ab433cce-6ef5-443a-9530-5cee12b1bfb0") : secret "maas-api-e2e-ait-04cfc947-serving-cert" not found
Sep 09 20:54:08.690848 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.690823    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab433cce-6ef5-443a-9530-5cee12b1bfb0-openshift-service-ca\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.692984 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.692958    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-metrics-certs\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.705776 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.705733    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9xzb\" (UniqueName: \"kubernetes.io/projected/ab433cce-6ef5-443a-9530-5cee12b1bfb0-kube-api-access-b9xzb\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:08.832523 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.832491    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 20:54:08.875369 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:08.875333    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:09.196375 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:09.196280    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:09.196545 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:09.196433    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-serving-cert: secret "maas-api-e2e-ait-04cfc947-serving-cert" not found
Sep 09 20:54:09.196545 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:09.196508    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls podName:ab433cce-6ef5-443a-9530-5cee12b1bfb0 nodeName:}" failed. No retries permitted until 2026-09-09 20:54:10.196492666 +0000 UTC m=+809.253029787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls") pod "maas-api-e2e-ait-04cfc947-684df4696-jjqwx" (UID: "ab433cce-6ef5-443a-9530-5cee12b1bfb0") : secret "maas-api-e2e-ait-04cfc947-serving-cert" not found
Sep 09 20:54:10.208922 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:10.208867    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:10.211524 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:10.211493    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls\") pod \"maas-api-e2e-ait-04cfc947-684df4696-jjqwx\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:10.295176 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:10.295140    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:10.617435 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:10.617411    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"]
Sep 09 20:54:10.618936 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:54:10.618884    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab433cce_6ef5_443a_9530_5cee12b1bfb0.slice/crio-cf135648c053007bff507795fc65827c246d22775d7e4d7e9ebb739830aa477e WatchSource:0}: Error finding container cf135648c053007bff507795fc65827c246d22775d7e4d7e9ebb739830aa477e: Status 404 returned error can't find the container with id cf135648c053007bff507795fc65827c246d22775d7e4d7e9ebb739830aa477e
Sep 09 20:54:10.889287 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:10.889196    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx" event={"ID":"ab433cce-6ef5-443a-9530-5cee12b1bfb0","Type":"ContainerStarted","Data":"cf135648c053007bff507795fc65827c246d22775d7e4d7e9ebb739830aa477e"}
Sep 09 20:54:11.810011 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:11.809977    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 20:54:11.903497 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:11.903458    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx" event={"ID":"ab433cce-6ef5-443a-9530-5cee12b1bfb0","Type":"ContainerStarted","Data":"50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f"}
Sep 09 20:54:11.903689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:11.903590    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:11.973024 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:11.972958    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx" podStartSLOduration=3.516143624 podStartE2EDuration="3.972939549s" totalImagesPullingTime="456.795925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:11.971741336 +0000 UTC m=+811.028278477" watchObservedRunningTime="2026-09-09 20:54:11.972939549 +0000 UTC m=+811.029476739"
Sep 09 20:54:12.875303 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:12.875274    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:54:13.827576 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:13.827535    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 20:54:17.916951 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:17.916919    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:19.884364 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:19.884337    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:54:29.403086 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.403051    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"]
Sep 09 20:54:29.411415 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.411388    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.415628 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.415603    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-423e6a-serving-cert\""
Sep 09 20:54:29.423806 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.423774    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"]
Sep 09 20:54:29.493050 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.493014    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-maas-api-tls\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.493242 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.493063    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd71a15-d6f9-44b4-b472-e6ae7a494092-openshift-service-ca\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.493242 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.493088    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-metrics-certs\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.493242 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.493196    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st7xk\" (UniqueName: \"kubernetes.io/projected/2cd71a15-d6f9-44b4-b472-e6ae7a494092-kube-api-access-st7xk\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.594044 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.594009    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-metrics-certs\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.594044 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.594057    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st7xk\" (UniqueName: \"kubernetes.io/projected/2cd71a15-d6f9-44b4-b472-e6ae7a494092-kube-api-access-st7xk\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.594303 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.594166    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-maas-api-tls\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.594303 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.594194    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd71a15-d6f9-44b4-b472-e6ae7a494092-openshift-service-ca\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.594924 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.594876    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd71a15-d6f9-44b4-b472-e6ae7a494092-openshift-service-ca\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.596992 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.596961    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-metrics-certs\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.597140 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.597117    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-maas-api-tls\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.609240 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.609205    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st7xk\" (UniqueName: \"kubernetes.io/projected/2cd71a15-d6f9-44b4-b472-e6ae7a494092-kube-api-access-st7xk\") pod \"maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:29.724222 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:29.724123    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:30.026084 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.026058    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"]
Sep 09 20:54:30.028321 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:54:30.028292    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd71a15_d6f9_44b4_b472_e6ae7a494092.slice/crio-3a12e48ef4a3e93f63a57ba12680cffb4ab9ba1a0ba650afcdef2a959384a913 WatchSource:0}: Error finding container 3a12e48ef4a3e93f63a57ba12680cffb4ab9ba1a0ba650afcdef2a959384a913: Status 404 returned error can't find the container with id 3a12e48ef4a3e93f63a57ba12680cffb4ab9ba1a0ba650afcdef2a959384a913
Sep 09 20:54:30.539770 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.539736    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"]
Sep 09 20:54:30.544564 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.544533    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:30.548106 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.548081    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-423e6a-dockercfg-7vzxs\""
Sep 09 20:54:30.548397 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.548375    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-423e6a\""
Sep 09 20:54:30.570321 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.570284    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"]
Sep 09 20:54:30.602912 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.602875    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d\" (UID: \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:30.603119 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.602940    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-kube-api-access-hldwq\") pod \"payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d\" (UID: \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:30.703748 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.703718    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d\" (UID: \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:30.703748 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.703759    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-kube-api-access-hldwq\") pod \"payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d\" (UID: \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:30.704711 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.704686    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d\" (UID: \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:30.714362 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.714298    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-kube-api-access-hldwq\") pod \"payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d\" (UID: \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:30.856599 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:30.856556    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:31.026689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:31.026581    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls" event={"ID":"2cd71a15-d6f9-44b4-b472-e6ae7a494092","Type":"ContainerStarted","Data":"ca72b66a9b2f60b3a5cec852edc33d8b97e1900d8a20fce0a81831e4fbcc6f7b"}
Sep 09 20:54:31.026689 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:31.026645    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls" event={"ID":"2cd71a15-d6f9-44b4-b472-e6ae7a494092","Type":"ContainerStarted","Data":"3a12e48ef4a3e93f63a57ba12680cffb4ab9ba1a0ba650afcdef2a959384a913"}
Sep 09 20:54:31.026924 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:31.026719    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:31.048105 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:31.048054    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls" podStartSLOduration=1.615113344 podStartE2EDuration="2.047991162s" totalImagesPullingTime="432.877818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:31.045152781 +0000 UTC m=+830.101689924" watchObservedRunningTime="2026-09-09 20:54:31.047991162 +0000 UTC m=+830.104528304"
Sep 09 20:54:31.141224 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:31.141193    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"]
Sep 09 20:54:31.143092 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:54:31.143063    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5e5b2b_9fdc_4638_94f5_b50425cf2b2c.slice/crio-f4be0b60ef0420e039805c3853d1237670684befa27348a65bc629a361306fb9 WatchSource:0}: Error finding container f4be0b60ef0420e039805c3853d1237670684befa27348a65bc629a361306fb9: Status 404 returned error can't find the container with id f4be0b60ef0420e039805c3853d1237670684befa27348a65bc629a361306fb9
Sep 09 20:54:32.034293 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:32.034246    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d" event={"ID":"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c","Type":"ContainerStarted","Data":"d0275fca0f381dc31bec77210505747280b85c3553bc14b1715bd7a9387e41f1"}
Sep 09 20:54:32.034766 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:32.034338    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d" event={"ID":"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c","Type":"ContainerStarted","Data":"f4be0b60ef0420e039805c3853d1237670684befa27348a65bc629a361306fb9"}
Sep 09 20:54:32.062450 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:32.062392    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d" podStartSLOduration=2.06236978 podStartE2EDuration="2.06236978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:32.060879798 +0000 UTC m=+831.117416955" watchObservedRunningTime="2026-09-09 20:54:32.06236978 +0000 UTC m=+831.118906922"
Sep 09 20:54:33.040806 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:33.040769    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:37.040307 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:37.040277    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 20:54:44.050367 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:44.050333    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 20:54:49.407621 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.407577    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"]
Sep 09 20:54:49.408101 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.407823    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx" podUID="ab433cce-6ef5-443a-9530-5cee12b1bfb0" containerName="maas-api" containerID="cri-o://50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f" gracePeriod=30
Sep 09 20:54:49.678780 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.678748    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:49.802651 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.802613    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-metrics-certs\") pod \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") "
Sep 09 20:54:49.802651 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.802657    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls\") pod \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") "
Sep 09 20:54:49.802954 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.802686    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab433cce-6ef5-443a-9530-5cee12b1bfb0-openshift-service-ca\") pod \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") "
Sep 09 20:54:49.802954 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.802721    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9xzb\" (UniqueName: \"kubernetes.io/projected/ab433cce-6ef5-443a-9530-5cee12b1bfb0-kube-api-access-b9xzb\") pod \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\" (UID: \"ab433cce-6ef5-443a-9530-5cee12b1bfb0\") "
Sep 09 20:54:49.803164 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.803136    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab433cce-6ef5-443a-9530-5cee12b1bfb0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ab433cce-6ef5-443a-9530-5cee12b1bfb0" (UID: "ab433cce-6ef5-443a-9530-5cee12b1bfb0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:54:49.805185 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.805156    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ab433cce-6ef5-443a-9530-5cee12b1bfb0" (UID: "ab433cce-6ef5-443a-9530-5cee12b1bfb0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:54:49.805322 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.805220    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab433cce-6ef5-443a-9530-5cee12b1bfb0" (UID: "ab433cce-6ef5-443a-9530-5cee12b1bfb0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:54:49.805322 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.805249    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab433cce-6ef5-443a-9530-5cee12b1bfb0-kube-api-access-b9xzb" (OuterVolumeSpecName: "kube-api-access-b9xzb") pod "ab433cce-6ef5-443a-9530-5cee12b1bfb0" (UID: "ab433cce-6ef5-443a-9530-5cee12b1bfb0"). InnerVolumeSpecName "kube-api-access-b9xzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:54:49.904453 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.904410    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:54:49.904453 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.904443    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab433cce-6ef5-443a-9530-5cee12b1bfb0-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:54:49.904453 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.904456    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab433cce-6ef5-443a-9530-5cee12b1bfb0-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:54:49.904695 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:49.904467    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9xzb\" (UniqueName: \"kubernetes.io/projected/ab433cce-6ef5-443a-9530-5cee12b1bfb0-kube-api-access-b9xzb\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:54:50.151552 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:50.151514    2555 generic.go:356] "Generic (PLEG): container finished" podID="ab433cce-6ef5-443a-9530-5cee12b1bfb0" containerID="50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f" exitCode=0
Sep 09 20:54:50.151756 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:50.151571    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"
Sep 09 20:54:50.151756 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:50.151599    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx" event={"ID":"ab433cce-6ef5-443a-9530-5cee12b1bfb0","Type":"ContainerDied","Data":"50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f"}
Sep 09 20:54:50.151756 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:50.151663    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx" event={"ID":"ab433cce-6ef5-443a-9530-5cee12b1bfb0","Type":"ContainerDied","Data":"cf135648c053007bff507795fc65827c246d22775d7e4d7e9ebb739830aa477e"}
Sep 09 20:54:50.151756 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:50.151677    2555 scope.go:117] "RemoveContainer" containerID="50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f"
Sep 09 20:54:50.162608 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:50.162587    2555 scope.go:117] "RemoveContainer" containerID="50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f"
Sep 09 20:54:50.163002 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:54:50.162982    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f\": container with ID starting with 50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f not found: ID does not exist" containerID="50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f"
Sep 09 20:54:50.163065 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:50.163013    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f"} err="failed to get container status \"50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f\": rpc error: code = NotFound desc = could not find container \"50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f\": container with ID starting with 50fa808dacdb4c034301c592088714fb53f26ed3109fc92b4fcaf1c80a032a1f not found: ID does not exist"
Sep 09 20:54:50.178330 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:50.178296    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"]
Sep 09 20:54:50.180835 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:50.180814    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04cfc947-684df4696-jjqwx"]
Sep 09 20:54:51.432611 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:51.432570    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab433cce-6ef5-443a-9530-5cee12b1bfb0" path="/var/lib/kubelet/pods/ab433cce-6ef5-443a-9530-5cee12b1bfb0/volumes"
Sep 09 20:54:53.783405 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.783370    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"]
Sep 09 20:54:53.784049 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.784029    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab433cce-6ef5-443a-9530-5cee12b1bfb0" containerName="maas-api"
Sep 09 20:54:53.784049 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.784050    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab433cce-6ef5-443a-9530-5cee12b1bfb0" containerName="maas-api"
Sep 09 20:54:53.784207 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.784190    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab433cce-6ef5-443a-9530-5cee12b1bfb0" containerName="maas-api"
Sep 09 20:54:53.788712 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.788691    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:53.792306 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.792285    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-8cfb58ee-serving-cert\""
Sep 09 20:54:53.811043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.811012    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"]
Sep 09 20:54:53.951786 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.951749    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-maas-api-tls\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:53.952000 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.951810    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d612f75-d8c2-4499-9826-377b62535f92-openshift-service-ca\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:53.952000 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.951950    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-metrics-certs\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:53.952147 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:53.952027    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj886\" (UniqueName: \"kubernetes.io/projected/9d612f75-d8c2-4499-9826-377b62535f92-kube-api-access-gj886\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.053275 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.053241    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj886\" (UniqueName: \"kubernetes.io/projected/9d612f75-d8c2-4499-9826-377b62535f92-kube-api-access-gj886\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.053480 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.053316    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-maas-api-tls\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.053480 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.053352    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d612f75-d8c2-4499-9826-377b62535f92-openshift-service-ca\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.053480 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.053395    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-metrics-certs\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.054120 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.054091    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d612f75-d8c2-4499-9826-377b62535f92-openshift-service-ca\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.056034 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.056012    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-metrics-certs\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.056127 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.056070    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-maas-api-tls\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.067636 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.067606    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj886\" (UniqueName: \"kubernetes.io/projected/9d612f75-d8c2-4499-9826-377b62535f92-kube-api-access-gj886\") pod \"maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.100605 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.100572    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:54.392759 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:54.392725    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"]
Sep 09 20:54:54.394884 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:54:54.394847    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d612f75_d8c2_4499_9826_377b62535f92.slice/crio-d06b32959fbcb7ac116894313f61e02fd74b3bcf5ad641d205e5e9892eaf66b3 WatchSource:0}: Error finding container d06b32959fbcb7ac116894313f61e02fd74b3bcf5ad641d205e5e9892eaf66b3: Status 404 returned error can't find the container with id d06b32959fbcb7ac116894313f61e02fd74b3bcf5ad641d205e5e9892eaf66b3
Sep 09 20:54:55.189183 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:55.189145    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5" event={"ID":"9d612f75-d8c2-4499-9826-377b62535f92","Type":"ContainerStarted","Data":"d06b32959fbcb7ac116894313f61e02fd74b3bcf5ad641d205e5e9892eaf66b3"}
Sep 09 20:54:56.196821 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:56.196776    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5" event={"ID":"9d612f75-d8c2-4499-9826-377b62535f92","Type":"ContainerStarted","Data":"0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724"}
Sep 09 20:54:56.197345 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:56.196895    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:54:56.218463 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:54:56.218399    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5" podStartSLOduration=1.8488702369999999 podStartE2EDuration="3.218381877s" totalImagesPullingTime="1.36951164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:56.215502259 +0000 UTC m=+855.272039401" watchObservedRunningTime="2026-09-09 20:54:56.218381877 +0000 UTC m=+855.274919019"
Sep 09 20:55:02.210063 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:02.210025    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:55:24.547133 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.547073    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"]
Sep 09 20:55:24.548022 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.547986    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5" podUID="9d612f75-d8c2-4499-9826-377b62535f92" containerName="maas-api" containerID="cri-o://0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724" gracePeriod=30
Sep 09 20:55:24.807532 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.807450    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:55:24.974285 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.974240    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj886\" (UniqueName: \"kubernetes.io/projected/9d612f75-d8c2-4499-9826-377b62535f92-kube-api-access-gj886\") pod \"9d612f75-d8c2-4499-9826-377b62535f92\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") "
Sep 09 20:55:24.974482 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.974343    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d612f75-d8c2-4499-9826-377b62535f92-openshift-service-ca\") pod \"9d612f75-d8c2-4499-9826-377b62535f92\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") "
Sep 09 20:55:24.974482 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.974452    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-maas-api-tls\") pod \"9d612f75-d8c2-4499-9826-377b62535f92\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") "
Sep 09 20:55:24.974582 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.974506    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-metrics-certs\") pod \"9d612f75-d8c2-4499-9826-377b62535f92\" (UID: \"9d612f75-d8c2-4499-9826-377b62535f92\") "
Sep 09 20:55:24.974733 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.974711    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d612f75-d8c2-4499-9826-377b62535f92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d612f75-d8c2-4499-9826-377b62535f92" (UID: "9d612f75-d8c2-4499-9826-377b62535f92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:55:24.974828 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.974810    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d612f75-d8c2-4499-9826-377b62535f92-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:55:24.976709 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.976673    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9d612f75-d8c2-4499-9826-377b62535f92" (UID: "9d612f75-d8c2-4499-9826-377b62535f92"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:55:24.976709 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.976700    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d612f75-d8c2-4499-9826-377b62535f92-kube-api-access-gj886" (OuterVolumeSpecName: "kube-api-access-gj886") pod "9d612f75-d8c2-4499-9826-377b62535f92" (UID: "9d612f75-d8c2-4499-9826-377b62535f92"). InnerVolumeSpecName "kube-api-access-gj886". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:55:24.976709 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:24.976685    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d612f75-d8c2-4499-9826-377b62535f92" (UID: "9d612f75-d8c2-4499-9826-377b62535f92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:55:25.075708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.075598    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:55:25.075708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.075645    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d612f75-d8c2-4499-9826-377b62535f92-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:55:25.075708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.075657    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj886\" (UniqueName: \"kubernetes.io/projected/9d612f75-d8c2-4499-9826-377b62535f92-kube-api-access-gj886\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:55:25.381454 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.381368    2555 generic.go:356] "Generic (PLEG): container finished" podID="9d612f75-d8c2-4499-9826-377b62535f92" containerID="0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724" exitCode=0
Sep 09 20:55:25.381454 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.381420    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"
Sep 09 20:55:25.381645 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.381452    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5" event={"ID":"9d612f75-d8c2-4499-9826-377b62535f92","Type":"ContainerDied","Data":"0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724"}
Sep 09 20:55:25.381645 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.381516    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5" event={"ID":"9d612f75-d8c2-4499-9826-377b62535f92","Type":"ContainerDied","Data":"d06b32959fbcb7ac116894313f61e02fd74b3bcf5ad641d205e5e9892eaf66b3"}
Sep 09 20:55:25.381645 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.381548    2555 scope.go:117] "RemoveContainer" containerID="0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724"
Sep 09 20:55:25.395108 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.395083    2555 scope.go:117] "RemoveContainer" containerID="0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724"
Sep 09 20:55:25.395488 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:55:25.395457    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724\": container with ID starting with 0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724 not found: ID does not exist" containerID="0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724"
Sep 09 20:55:25.395544 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.395504    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724"} err="failed to get container status \"0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724\": rpc error: code = NotFound desc = could not find container \"0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724\": container with ID starting with 0f4eac36ca2972beb9d64f17f293b0b85cdf70ad0ccaaf1ad5c067844d44f724 not found: ID does not exist"
Sep 09 20:55:25.407408 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.407381    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"]
Sep 09 20:55:25.413079 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.413054    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8cfb58ee-54c877bd87-p25n5"]
Sep 09 20:55:25.431995 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:25.431960    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d612f75-d8c2-4499-9826-377b62535f92" path="/var/lib/kubelet/pods/9d612f75-d8c2-4499-9826-377b62535f92/volumes"
Sep 09 20:55:29.810384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.810343    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"]
Sep 09 20:55:29.810893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.810815    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d612f75-d8c2-4499-9826-377b62535f92" containerName="maas-api"
Sep 09 20:55:29.810893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.810828    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d612f75-d8c2-4499-9826-377b62535f92" containerName="maas-api"
Sep 09 20:55:29.810893 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.810928    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d612f75-d8c2-4499-9826-377b62535f92" containerName="maas-api"
Sep 09 20:55:29.814753 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.814730    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.817200 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.817177    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-69911538-serving-cert\""
Sep 09 20:55:29.819791 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.819764    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-maas-api-tls\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.819938 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.819801    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-metrics-certs\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.819990 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.819952    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsrqt\" (UniqueName: \"kubernetes.io/projected/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-kube-api-access-hsrqt\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.820039 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.819994    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-openshift-service-ca\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.826004 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.825978    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"]
Sep 09 20:55:29.920501 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.920460    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-metrics-certs\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.920708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.920553    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsrqt\" (UniqueName: \"kubernetes.io/projected/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-kube-api-access-hsrqt\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.920708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.920579    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-openshift-service-ca\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.920708 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.920615    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-maas-api-tls\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.920708 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:55:29.920707    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-69911538-serving-cert: secret "maas-api-e2e-ait-69911538-serving-cert" not found
Sep 09 20:55:29.920996 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:55:29.920783    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-maas-api-tls podName:3c14eb5d-c39f-4442-8925-5fc3cdff50ae nodeName:}" failed. No retries permitted until 2026-09-09 20:55:30.420762327 +0000 UTC m=+889.477299460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-maas-api-tls") pod "maas-api-e2e-ait-69911538-6966785958-f8544" (UID: "3c14eb5d-c39f-4442-8925-5fc3cdff50ae") : secret "maas-api-e2e-ait-69911538-serving-cert" not found
Sep 09 20:55:29.921621 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.921595    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-openshift-service-ca\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.923394 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.923369    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-metrics-certs\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:29.930748 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:29.930726    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsrqt\" (UniqueName: \"kubernetes.io/projected/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-kube-api-access-hsrqt\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:30.425186 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:30.425138    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-maas-api-tls\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:30.427767 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:30.427736    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-maas-api-tls\") pod \"maas-api-e2e-ait-69911538-6966785958-f8544\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:30.448433 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:30.448407    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:30.755748 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:30.755721    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"]
Sep 09 20:55:30.757490 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:55:30.757458    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c14eb5d_c39f_4442_8925_5fc3cdff50ae.slice/crio-15e8f685e2fd6b8558ba53a22494f39500857f3823a85e39d500505132dad4e2 WatchSource:0}: Error finding container 15e8f685e2fd6b8558ba53a22494f39500857f3823a85e39d500505132dad4e2: Status 404 returned error can't find the container with id 15e8f685e2fd6b8558ba53a22494f39500857f3823a85e39d500505132dad4e2
Sep 09 20:55:31.421770 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:31.421732    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544" event={"ID":"3c14eb5d-c39f-4442-8925-5fc3cdff50ae","Type":"ContainerStarted","Data":"15e8f685e2fd6b8558ba53a22494f39500857f3823a85e39d500505132dad4e2"}
Sep 09 20:55:32.429557 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:32.429461    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544" event={"ID":"3c14eb5d-c39f-4442-8925-5fc3cdff50ae","Type":"ContainerStarted","Data":"a5183ed3ce1ce6603f85d33fd97e60fa2773dd1314bd94fea4769f1494846a4f"}
Sep 09 20:55:32.429557 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:32.429535    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:55:32.456056 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:32.456001    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544" podStartSLOduration=2.712640586 podStartE2EDuration="3.455981568s" totalImagesPullingTime="743.340982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:55:32.454803391 +0000 UTC m=+891.511340532" watchObservedRunningTime="2026-09-09 20:55:32.455981568 +0000 UTC m=+891.512518710"
Sep 09 20:55:38.440966 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:55:38.440932    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:56:00.355697 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.355656    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"]
Sep 09 20:56:00.358336 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.355958    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544" podUID="3c14eb5d-c39f-4442-8925-5fc3cdff50ae" containerName="maas-api" containerID="cri-o://a5183ed3ce1ce6603f85d33fd97e60fa2773dd1314bd94fea4769f1494846a4f" gracePeriod=30
Sep 09 20:56:00.608813 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.608730    2555 generic.go:356] "Generic (PLEG): container finished" podID="3c14eb5d-c39f-4442-8925-5fc3cdff50ae" containerID="a5183ed3ce1ce6603f85d33fd97e60fa2773dd1314bd94fea4769f1494846a4f" exitCode=0
Sep 09 20:56:00.608813 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.608769    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544" event={"ID":"3c14eb5d-c39f-4442-8925-5fc3cdff50ae","Type":"ContainerDied","Data":"a5183ed3ce1ce6603f85d33fd97e60fa2773dd1314bd94fea4769f1494846a4f"}
Sep 09 20:56:00.608813 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.608808    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544" event={"ID":"3c14eb5d-c39f-4442-8925-5fc3cdff50ae","Type":"ContainerDied","Data":"15e8f685e2fd6b8558ba53a22494f39500857f3823a85e39d500505132dad4e2"}
Sep 09 20:56:00.609040 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.608824    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15e8f685e2fd6b8558ba53a22494f39500857f3823a85e39d500505132dad4e2"
Sep 09 20:56:00.617329 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.617306    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:56:00.741275 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.741235    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-maas-api-tls\") pod \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") "
Sep 09 20:56:00.741462 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.741298    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-metrics-certs\") pod \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") "
Sep 09 20:56:00.741462 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.741359    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-openshift-service-ca\") pod \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") "
Sep 09 20:56:00.741462 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.741416    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsrqt\" (UniqueName: \"kubernetes.io/projected/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-kube-api-access-hsrqt\") pod \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\" (UID: \"3c14eb5d-c39f-4442-8925-5fc3cdff50ae\") "
Sep 09 20:56:00.741721 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.741687    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c14eb5d-c39f-4442-8925-5fc3cdff50ae" (UID: "3c14eb5d-c39f-4442-8925-5fc3cdff50ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:56:00.741874 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.741815    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:00.743652 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.743624    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c14eb5d-c39f-4442-8925-5fc3cdff50ae" (UID: "3c14eb5d-c39f-4442-8925-5fc3cdff50ae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:56:00.743736 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.743677    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c14eb5d-c39f-4442-8925-5fc3cdff50ae" (UID: "3c14eb5d-c39f-4442-8925-5fc3cdff50ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:56:00.743736 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.743679    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-kube-api-access-hsrqt" (OuterVolumeSpecName: "kube-api-access-hsrqt") pod "3c14eb5d-c39f-4442-8925-5fc3cdff50ae" (UID: "3c14eb5d-c39f-4442-8925-5fc3cdff50ae"). InnerVolumeSpecName "kube-api-access-hsrqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:56:00.842553 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.842505    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsrqt\" (UniqueName: \"kubernetes.io/projected/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-kube-api-access-hsrqt\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:00.842553 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.842550    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:00.842774 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:00.842565    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c14eb5d-c39f-4442-8925-5fc3cdff50ae-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:01.614702 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:01.614672    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"
Sep 09 20:56:01.632959 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:01.632926    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"]
Sep 09 20:56:01.635768 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:01.635736    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69911538-6966785958-f8544"]
Sep 09 20:56:03.432137 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:03.432102    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c14eb5d-c39f-4442-8925-5fc3cdff50ae" path="/var/lib/kubelet/pods/3c14eb5d-c39f-4442-8925-5fc3cdff50ae/volumes"
Sep 09 20:56:06.091976 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.091937    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"]
Sep 09 20:56:06.092682 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.092663    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c14eb5d-c39f-4442-8925-5fc3cdff50ae" containerName="maas-api"
Sep 09 20:56:06.092682 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.092684    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c14eb5d-c39f-4442-8925-5fc3cdff50ae" containerName="maas-api"
Sep 09 20:56:06.092805 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.092798    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c14eb5d-c39f-4442-8925-5fc3cdff50ae" containerName="maas-api"
Sep 09 20:56:06.098149 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.097131    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.101305 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.101279    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-c4796c6d-serving-cert\""
Sep 09 20:56:06.109789 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.109758    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"]
Sep 09 20:56:06.200050 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.200011    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-metrics-certs\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.200264 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.200094    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-maas-api-tls\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.200264 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.200140    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wt99\" (UniqueName: \"kubernetes.io/projected/ec9e1366-3905-438e-ad25-644b3eaac659-kube-api-access-6wt99\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.200391 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.200273    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9e1366-3905-438e-ad25-644b3eaac659-openshift-service-ca\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.301827 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.301767    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9e1366-3905-438e-ad25-644b3eaac659-openshift-service-ca\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.302067 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.301889    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-metrics-certs\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.302067 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.301950    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-maas-api-tls\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.302067 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.301989    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wt99\" (UniqueName: \"kubernetes.io/projected/ec9e1366-3905-438e-ad25-644b3eaac659-kube-api-access-6wt99\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.302394 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:56:06.302360    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-serving-cert: secret "maas-api-e2e-derive-c4796c6d-serving-cert" not found
Sep 09 20:56:06.302538 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:56:06.302469    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-maas-api-tls podName:ec9e1366-3905-438e-ad25-644b3eaac659 nodeName:}" failed. No retries permitted until 2026-09-09 20:56:06.802444608 +0000 UTC m=+925.858981740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-maas-api-tls") pod "maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv" (UID: "ec9e1366-3905-438e-ad25-644b3eaac659") : secret "maas-api-e2e-derive-c4796c6d-serving-cert" not found
Sep 09 20:56:06.302639 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.302619    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9e1366-3905-438e-ad25-644b3eaac659-openshift-service-ca\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.305167 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.305142    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-metrics-certs\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.311861 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.311835    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wt99\" (UniqueName: \"kubernetes.io/projected/ec9e1366-3905-438e-ad25-644b3eaac659-kube-api-access-6wt99\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.807838 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.807800    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-maas-api-tls\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:06.810544 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:06.810510    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-maas-api-tls\") pod \"maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:07.015235 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:07.014864    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:07.311293 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:07.311260    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"]
Sep 09 20:56:07.313335 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:56:07.313303    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9e1366_3905_438e_ad25_644b3eaac659.slice/crio-c19102ae6dee9b6b88570d954dea6b438f44ba4c5114005050beec50dea1a917 WatchSource:0}: Error finding container c19102ae6dee9b6b88570d954dea6b438f44ba4c5114005050beec50dea1a917: Status 404 returned error can't find the container with id c19102ae6dee9b6b88570d954dea6b438f44ba4c5114005050beec50dea1a917
Sep 09 20:56:07.656629 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:07.656597    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv" event={"ID":"ec9e1366-3905-438e-ad25-644b3eaac659","Type":"ContainerStarted","Data":"c19102ae6dee9b6b88570d954dea6b438f44ba4c5114005050beec50dea1a917"}
Sep 09 20:56:08.664087 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:08.664040    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv" event={"ID":"ec9e1366-3905-438e-ad25-644b3eaac659","Type":"ContainerStarted","Data":"c7d84d199082e0ffda868c0c9284e3723dc5118876322851238ee4316aaa4097"}
Sep 09 20:56:08.664481 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:08.664123    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:08.685384 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:08.685325    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv" podStartSLOduration=2.308138822 podStartE2EDuration="2.68530361s" totalImagesPullingTime="377.164788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:08.681323472 +0000 UTC m=+927.737860605" watchObservedRunningTime="2026-09-09 20:56:08.68530361 +0000 UTC m=+927.741840753"
Sep 09 20:56:14.683254 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:14.683216    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:14.974701 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:14.974622    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"]
Sep 09 20:56:14.978500 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:14.978474    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:14.981066 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:14.981043    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5eef90\"/\"kube-root-ca.crt\""
Sep 09 20:56:14.981218 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:14.981142    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5eef90\"/\"default-dockercfg-vb5cq\""
Sep 09 20:56:14.981971 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:14.981956    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5eef90\"/\"openshift-service-ca.crt\""
Sep 09 20:56:14.982027 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:14.981968    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5eef90\"/\"test-model-5eef90-kserve-self-signed-certs\""
Sep 09 20:56:14.991081 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:14.991055    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"]
Sep 09 20:56:15.086387 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.086349    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-home\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.086575 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.086397    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tls-certs\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.086575 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.086491    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-dshm\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.086575 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.086533    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-model-cache\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.086684 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.086603    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tmp-dir\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.086684 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.086634    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhc4f\" (UniqueName: \"kubernetes.io/projected/f71c3452-e2e3-4ed8-b4b6-867904b2f967-kube-api-access-mhc4f\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.188181 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.188135    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-dshm\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.188372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.188196    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-model-cache\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.188372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.188246    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tmp-dir\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.188372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.188269    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhc4f\" (UniqueName: \"kubernetes.io/projected/f71c3452-e2e3-4ed8-b4b6-867904b2f967-kube-api-access-mhc4f\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.188372 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.188344    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-home\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.188540 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.188385    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tls-certs\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.188757 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.188702    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-model-cache\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.188757 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.188739    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tmp-dir\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.188757 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.188755    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-home\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.190792 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.190769    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-dshm\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.190967 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.190950    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tls-certs\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.197861 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.197828    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhc4f\" (UniqueName: \"kubernetes.io/projected/f71c3452-e2e3-4ed8-b4b6-867904b2f967-kube-api-access-mhc4f\") pod \"test-model-5eef90-kserve-5b6d68cdbf-hkfnh\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") " pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.288959 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.288815    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:15.566481 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.566450    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"]
Sep 09 20:56:15.567952 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:56:15.567923    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf71c3452_e2e3_4ed8_b4b6_867904b2f967.slice/crio-2720b8d39fbb1abcf1b9d5e4a05b2ab1c70d432fd26bf47c7d0c7a5e32edf452 WatchSource:0}: Error finding container 2720b8d39fbb1abcf1b9d5e4a05b2ab1c70d432fd26bf47c7d0c7a5e32edf452: Status 404 returned error can't find the container with id 2720b8d39fbb1abcf1b9d5e4a05b2ab1c70d432fd26bf47c7d0c7a5e32edf452
Sep 09 20:56:15.716207 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.716168    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh" event={"ID":"f71c3452-e2e3-4ed8-b4b6-867904b2f967","Type":"ContainerStarted","Data":"5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7"}
Sep 09 20:56:15.716207 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.716214    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh" event={"ID":"f71c3452-e2e3-4ed8-b4b6-867904b2f967","Type":"ContainerStarted","Data":"2720b8d39fbb1abcf1b9d5e4a05b2ab1c70d432fd26bf47c7d0c7a5e32edf452"}
Sep 09 20:56:15.736596 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:15.736545    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh" podStartSLOduration=1.736526179 podStartE2EDuration="1.736526179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:15.734527655 +0000 UTC m=+934.791064821" watchObservedRunningTime="2026-09-09 20:56:15.736526179 +0000 UTC m=+934.793063339"
Sep 09 20:56:25.289289 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:25.289249    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:25.289705 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:25.289308    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:25.307043 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:25.307009    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:25.797828 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:25.797796    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 20:56:28.064101 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.064065    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"]
Sep 09 20:56:28.064560 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.064307    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc" podUID="a20f4d9c-6efb-4c60-aef3-609f3cb46532" containerName="maas-api" containerID="cri-o://589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc" gracePeriod=30
Sep 09 20:56:28.127497 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.127460    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"]
Sep 09 20:56:28.127741 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.127715    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq" podUID="8956a604-ef37-475f-a846-561de6a4308c" containerName="payload-pre-processing" containerID="cri-o://a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82" gracePeriod=30
Sep 09 20:56:28.391033 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.391001    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:56:28.418579 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.418546    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:56:28.523746 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.523709    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20f4d9c-6efb-4c60-aef3-609f3cb46532-openshift-service-ca\") pod \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") "
Sep 09 20:56:28.523983 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.523757    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8956a604-ef37-475f-a846-561de6a4308c-plugins-config-volume\") pod \"8956a604-ef37-475f-a846-561de6a4308c\" (UID: \"8956a604-ef37-475f-a846-561de6a4308c\") "
Sep 09 20:56:28.523983 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.523835    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-maas-api-tls\") pod \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") "
Sep 09 20:56:28.523983 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.523884    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj9bq\" (UniqueName: \"kubernetes.io/projected/a20f4d9c-6efb-4c60-aef3-609f3cb46532-kube-api-access-bj9bq\") pod \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") "
Sep 09 20:56:28.523983 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.523941    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-metrics-certs\") pod \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\" (UID: \"a20f4d9c-6efb-4c60-aef3-609f3cb46532\") "
Sep 09 20:56:28.523983 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.523976    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fztcg\" (UniqueName: \"kubernetes.io/projected/8956a604-ef37-475f-a846-561de6a4308c-kube-api-access-fztcg\") pod \"8956a604-ef37-475f-a846-561de6a4308c\" (UID: \"8956a604-ef37-475f-a846-561de6a4308c\") "
Sep 09 20:56:28.524248 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.524138    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a20f4d9c-6efb-4c60-aef3-609f3cb46532-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a20f4d9c-6efb-4c60-aef3-609f3cb46532" (UID: "a20f4d9c-6efb-4c60-aef3-609f3cb46532"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:56:28.524248 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.524225    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8956a604-ef37-475f-a846-561de6a4308c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8956a604-ef37-475f-a846-561de6a4308c" (UID: "8956a604-ef37-475f-a846-561de6a4308c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:56:28.524349 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.524329    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20f4d9c-6efb-4c60-aef3-609f3cb46532-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:28.524387 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.524357    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8956a604-ef37-475f-a846-561de6a4308c-plugins-config-volume\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:28.526367 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.526335    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20f4d9c-6efb-4c60-aef3-609f3cb46532-kube-api-access-bj9bq" (OuterVolumeSpecName: "kube-api-access-bj9bq") pod "a20f4d9c-6efb-4c60-aef3-609f3cb46532" (UID: "a20f4d9c-6efb-4c60-aef3-609f3cb46532"). InnerVolumeSpecName "kube-api-access-bj9bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:56:28.526367 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.526336    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a20f4d9c-6efb-4c60-aef3-609f3cb46532" (UID: "a20f4d9c-6efb-4c60-aef3-609f3cb46532"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:56:28.526534 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.526404    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8956a604-ef37-475f-a846-561de6a4308c-kube-api-access-fztcg" (OuterVolumeSpecName: "kube-api-access-fztcg") pod "8956a604-ef37-475f-a846-561de6a4308c" (UID: "8956a604-ef37-475f-a846-561de6a4308c"). InnerVolumeSpecName "kube-api-access-fztcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:56:28.526534 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.526416    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a20f4d9c-6efb-4c60-aef3-609f3cb46532" (UID: "a20f4d9c-6efb-4c60-aef3-609f3cb46532"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:56:28.625264 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.625166    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:28.625264 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.625198    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj9bq\" (UniqueName: \"kubernetes.io/projected/a20f4d9c-6efb-4c60-aef3-609f3cb46532-kube-api-access-bj9bq\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:28.625264 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.625209    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20f4d9c-6efb-4c60-aef3-609f3cb46532-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:28.625264 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.625219    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fztcg\" (UniqueName: \"kubernetes.io/projected/8956a604-ef37-475f-a846-561de6a4308c-kube-api-access-fztcg\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:28.805432 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.805393    2555 generic.go:356] "Generic (PLEG): container finished" podID="8956a604-ef37-475f-a846-561de6a4308c" containerID="a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82" exitCode=0
Sep 09 20:56:28.805432 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.805436    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"
Sep 09 20:56:28.805723 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.805474    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq" event={"ID":"8956a604-ef37-475f-a846-561de6a4308c","Type":"ContainerDied","Data":"a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82"}
Sep 09 20:56:28.805723 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.805533    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq" event={"ID":"8956a604-ef37-475f-a846-561de6a4308c","Type":"ContainerDied","Data":"ad5fedc372b795442690b953976d20a1e9fd3c54e37165825dbf4a2526e68338"}
Sep 09 20:56:28.805723 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.805556    2555 scope.go:117] "RemoveContainer" containerID="a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82"
Sep 09 20:56:28.807385 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.807363    2555 generic.go:356] "Generic (PLEG): container finished" podID="a20f4d9c-6efb-4c60-aef3-609f3cb46532" containerID="589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc" exitCode=0
Sep 09 20:56:28.807502 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.807397    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc" event={"ID":"a20f4d9c-6efb-4c60-aef3-609f3cb46532","Type":"ContainerDied","Data":"589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc"}
Sep 09 20:56:28.807502 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.807439    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"
Sep 09 20:56:28.807502 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.807458    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc" event={"ID":"a20f4d9c-6efb-4c60-aef3-609f3cb46532","Type":"ContainerDied","Data":"1a351f08b627f22e092d6c01049ae6572debd9c7e22c9b7e9c7eadec11b25936"}
Sep 09 20:56:28.817150 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.817132    2555 scope.go:117] "RemoveContainer" containerID="a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82"
Sep 09 20:56:28.817581 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:56:28.817531    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82\": container with ID starting with a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82 not found: ID does not exist" containerID="a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82"
Sep 09 20:56:28.817694 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.817571    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82"} err="failed to get container status \"a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82\": rpc error: code = NotFound desc = could not find container \"a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82\": container with ID starting with a5bf375da3bf0f40d89d22de72b2642f79013daedf66058e50d71f0a3d087f82 not found: ID does not exist"
Sep 09 20:56:28.817694 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.817598    2555 scope.go:117] "RemoveContainer" containerID="589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc"
Sep 09 20:56:28.828983 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.828959    2555 scope.go:117] "RemoveContainer" containerID="589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc"
Sep 09 20:56:28.829405 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:56:28.829366    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc\": container with ID starting with 589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc not found: ID does not exist" containerID="589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc"
Sep 09 20:56:28.829509 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.829417    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc"} err="failed to get container status \"589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc\": rpc error: code = NotFound desc = could not find container \"589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc\": container with ID starting with 589ed8593f6c94d6c297288221188e2e52de8fa6968617bd3a2787a37a273bfc not found: ID does not exist"
Sep 09 20:56:28.832825 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.832800    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"]
Sep 09 20:56:28.835494 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.835469    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq"]
Sep 09 20:56:28.845972 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.845949    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"]
Sep 09 20:56:28.850061 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:28.850037    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-864e4e-55b4886bf5-5w2mc"]
Sep 09 20:56:29.431978 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:29.431873    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8956a604-ef37-475f-a846-561de6a4308c" path="/var/lib/kubelet/pods/8956a604-ef37-475f-a846-561de6a4308c/volumes"
Sep 09 20:56:29.432334 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:29.432268    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a20f4d9c-6efb-4c60-aef3-609f3cb46532" path="/var/lib/kubelet/pods/a20f4d9c-6efb-4c60-aef3-609f3cb46532/volumes"
Sep 09 20:56:46.675446 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:46.675405    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"]
Sep 09 20:56:46.676030 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:46.675667    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv" podUID="ec9e1366-3905-438e-ad25-644b3eaac659" containerName="maas-api" containerID="cri-o://c7d84d199082e0ffda868c0c9284e3723dc5118876322851238ee4316aaa4097" gracePeriod=30
Sep 09 20:56:46.922393 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:46.922362    2555 generic.go:356] "Generic (PLEG): container finished" podID="ec9e1366-3905-438e-ad25-644b3eaac659" containerID="c7d84d199082e0ffda868c0c9284e3723dc5118876322851238ee4316aaa4097" exitCode=0
Sep 09 20:56:46.922545 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:46.922435    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv" event={"ID":"ec9e1366-3905-438e-ad25-644b3eaac659","Type":"ContainerDied","Data":"c7d84d199082e0ffda868c0c9284e3723dc5118876322851238ee4316aaa4097"}
Sep 09 20:56:46.940539 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:46.940469    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:47.004427 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.004387    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9e1366-3905-438e-ad25-644b3eaac659-openshift-service-ca\") pod \"ec9e1366-3905-438e-ad25-644b3eaac659\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") "
Sep 09 20:56:47.004606 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.004492    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-maas-api-tls\") pod \"ec9e1366-3905-438e-ad25-644b3eaac659\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") "
Sep 09 20:56:47.004606 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.004543    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-metrics-certs\") pod \"ec9e1366-3905-438e-ad25-644b3eaac659\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") "
Sep 09 20:56:47.004606 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.004573    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wt99\" (UniqueName: \"kubernetes.io/projected/ec9e1366-3905-438e-ad25-644b3eaac659-kube-api-access-6wt99\") pod \"ec9e1366-3905-438e-ad25-644b3eaac659\" (UID: \"ec9e1366-3905-438e-ad25-644b3eaac659\") "
Sep 09 20:56:47.004804 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.004776    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec9e1366-3905-438e-ad25-644b3eaac659-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec9e1366-3905-438e-ad25-644b3eaac659" (UID: "ec9e1366-3905-438e-ad25-644b3eaac659"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:56:47.005059 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.005030    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9e1366-3905-438e-ad25-644b3eaac659-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:47.006861 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.006828    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ec9e1366-3905-438e-ad25-644b3eaac659" (UID: "ec9e1366-3905-438e-ad25-644b3eaac659"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:56:47.006994 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.006854    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec9e1366-3905-438e-ad25-644b3eaac659" (UID: "ec9e1366-3905-438e-ad25-644b3eaac659"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:56:47.006994 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.006985    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9e1366-3905-438e-ad25-644b3eaac659-kube-api-access-6wt99" (OuterVolumeSpecName: "kube-api-access-6wt99") pod "ec9e1366-3905-438e-ad25-644b3eaac659" (UID: "ec9e1366-3905-438e-ad25-644b3eaac659"). InnerVolumeSpecName "kube-api-access-6wt99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:56:47.105625 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.105582    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:47.105625 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.105616    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec9e1366-3905-438e-ad25-644b3eaac659-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:47.105625 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.105627    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wt99\" (UniqueName: \"kubernetes.io/projected/ec9e1366-3905-438e-ad25-644b3eaac659-kube-api-access-6wt99\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:56:47.929153 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.929120    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"
Sep 09 20:56:47.929597 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.929150    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv" event={"ID":"ec9e1366-3905-438e-ad25-644b3eaac659","Type":"ContainerDied","Data":"c19102ae6dee9b6b88570d954dea6b438f44ba4c5114005050beec50dea1a917"}
Sep 09 20:56:47.929597 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.929211    2555 scope.go:117] "RemoveContainer" containerID="c7d84d199082e0ffda868c0c9284e3723dc5118876322851238ee4316aaa4097"
Sep 09 20:56:47.959274 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.957772    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"]
Sep 09 20:56:47.966673 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:47.966639    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c4796c6d-f74b6cd9c-8httv"]
Sep 09 20:56:49.431638 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:56:49.431601    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec9e1366-3905-438e-ad25-644b3eaac659" path="/var/lib/kubelet/pods/ec9e1366-3905-438e-ad25-644b3eaac659/volumes"
Sep 09 20:57:04.107454 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107367    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"]
Sep 09 20:57:04.107989 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107832    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20f4d9c-6efb-4c60-aef3-609f3cb46532" containerName="maas-api"
Sep 09 20:57:04.107989 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107846    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20f4d9c-6efb-4c60-aef3-609f3cb46532" containerName="maas-api"
Sep 09 20:57:04.107989 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107866    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9e1366-3905-438e-ad25-644b3eaac659" containerName="maas-api"
Sep 09 20:57:04.107989 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107872    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9e1366-3905-438e-ad25-644b3eaac659" containerName="maas-api"
Sep 09 20:57:04.107989 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107880    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8956a604-ef37-475f-a846-561de6a4308c" containerName="payload-pre-processing"
Sep 09 20:57:04.107989 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107886    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8956a604-ef37-475f-a846-561de6a4308c" containerName="payload-pre-processing"
Sep 09 20:57:04.107989 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107976    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9e1366-3905-438e-ad25-644b3eaac659" containerName="maas-api"
Sep 09 20:57:04.107989 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107988    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8956a604-ef37-475f-a846-561de6a4308c" containerName="payload-pre-processing"
Sep 09 20:57:04.108418 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.107996    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20f4d9c-6efb-4c60-aef3-609f3cb46532" containerName="maas-api"
Sep 09 20:57:04.112966 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.112944    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.115661 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.115633    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-2d4edf-serving-cert\""
Sep 09 20:57:04.123187 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.123155    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"]
Sep 09 20:57:04.284251 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.284210    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/959e4b00-42e2-4e1d-9d28-5561aae7701b-openshift-service-ca\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.284417 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.284267    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5xgv\" (UniqueName: \"kubernetes.io/projected/959e4b00-42e2-4e1d-9d28-5561aae7701b-kube-api-access-v5xgv\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.284417 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.284297    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-metrics-certs\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.284417 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.284394    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-maas-api-tls\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.385279 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.385178    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/959e4b00-42e2-4e1d-9d28-5561aae7701b-openshift-service-ca\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.385279 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.385252    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5xgv\" (UniqueName: \"kubernetes.io/projected/959e4b00-42e2-4e1d-9d28-5561aae7701b-kube-api-access-v5xgv\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.385464 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.385294    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-metrics-certs\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.385464 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.385349    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-maas-api-tls\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.385536 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:57:04.385493    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-serving-cert: secret "maas-api-e2e-explicit-2d4edf-serving-cert" not found
Sep 09 20:57:04.385573 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:57:04.385566    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-maas-api-tls podName:959e4b00-42e2-4e1d-9d28-5561aae7701b nodeName:}" failed. No retries permitted until 2026-09-09 20:57:04.885543751 +0000 UTC m=+983.942080886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-maas-api-tls") pod "maas-api-e2e-explicit-2d4edf-58c857578f-vl57b" (UID: "959e4b00-42e2-4e1d-9d28-5561aae7701b") : secret "maas-api-e2e-explicit-2d4edf-serving-cert" not found
Sep 09 20:57:04.385992 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.385959    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/959e4b00-42e2-4e1d-9d28-5561aae7701b-openshift-service-ca\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.387993 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.387975    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-metrics-certs\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.408295 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.408266    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5xgv\" (UniqueName: \"kubernetes.io/projected/959e4b00-42e2-4e1d-9d28-5561aae7701b-kube-api-access-v5xgv\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.890269 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.890225    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-maas-api-tls\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:04.892856 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:04.892834    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-maas-api-tls\") pod \"maas-api-e2e-explicit-2d4edf-58c857578f-vl57b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:05.028098 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:05.028063    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:05.307957 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:05.307932    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"]
Sep 09 20:57:05.310229 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:57:05.310195    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959e4b00_42e2_4e1d_9d28_5561aae7701b.slice/crio-55a303d66f01058fdc8c3d8f0f3a8f420d7150c32d4ad264eed9c9e9b6837acf WatchSource:0}: Error finding container 55a303d66f01058fdc8c3d8f0f3a8f420d7150c32d4ad264eed9c9e9b6837acf: Status 404 returned error can't find the container with id 55a303d66f01058fdc8c3d8f0f3a8f420d7150c32d4ad264eed9c9e9b6837acf
Sep 09 20:57:05.312008 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:05.311989    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:57:06.039622 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:06.039528    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b" event={"ID":"959e4b00-42e2-4e1d-9d28-5561aae7701b","Type":"ContainerStarted","Data":"1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd"}
Sep 09 20:57:06.039622 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:06.039601    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:57:06.039820 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:06.039624    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b" event={"ID":"959e4b00-42e2-4e1d-9d28-5561aae7701b","Type":"ContainerStarted","Data":"55a303d66f01058fdc8c3d8f0f3a8f420d7150c32d4ad264eed9c9e9b6837acf"}
Sep 09 20:57:06.074199 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:06.074140    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b" podStartSLOduration=1.6275452750000001 podStartE2EDuration="2.07412022s" totalImagesPullingTime="446.574945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:57:06.072829265 +0000 UTC m=+985.129366408" watchObservedRunningTime="2026-09-09 20:57:06.07412022 +0000 UTC m=+985.130657361"
Sep 09 20:57:12.053377 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:57:12.053346    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:58:32.511829 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.511746    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"]
Sep 09 20:58:32.515511 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.515492    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.520453 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.520427    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e2f4649f-serving-cert\""
Sep 09 20:58:32.529328 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.529304    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"]
Sep 09 20:58:32.665910 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.665864    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-maas-api-tls\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.666097 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.665956    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a917b8-9df7-4775-ac6c-246a7aca6956-openshift-service-ca\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.666097 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.665977    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-metrics-certs\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.666186 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.666108    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n29rp\" (UniqueName: \"kubernetes.io/projected/85a917b8-9df7-4775-ac6c-246a7aca6956-kube-api-access-n29rp\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.772395 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.767978    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a917b8-9df7-4775-ac6c-246a7aca6956-openshift-service-ca\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.772395 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.768037    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-metrics-certs\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.772395 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.768172    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n29rp\" (UniqueName: \"kubernetes.io/projected/85a917b8-9df7-4775-ac6c-246a7aca6956-kube-api-access-n29rp\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.772395 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.768207    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-maas-api-tls\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.772395 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:58:32.768392    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-serving-cert: secret "maas-api-e2e-mt-e2f4649f-serving-cert" not found
Sep 09 20:58:32.772395 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:58:32.768459    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-maas-api-tls podName:85a917b8-9df7-4775-ac6c-246a7aca6956 nodeName:}" failed. No retries permitted until 2026-09-09 20:58:33.268438963 +0000 UTC m=+1072.324976083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-maas-api-tls") pod "maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m" (UID: "85a917b8-9df7-4775-ac6c-246a7aca6956") : secret "maas-api-e2e-mt-e2f4649f-serving-cert" not found
Sep 09 20:58:32.772395 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.768816    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a917b8-9df7-4775-ac6c-246a7aca6956-openshift-service-ca\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.777925 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.777866    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-metrics-certs\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:32.778472 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:32.778442    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n29rp\" (UniqueName: \"kubernetes.io/projected/85a917b8-9df7-4775-ac6c-246a7aca6956-kube-api-access-n29rp\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:33.272411 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:33.272375    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-maas-api-tls\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:33.275474 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:33.275443    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-maas-api-tls\") pod \"maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:33.426917 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:33.426869    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:33.709841 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:33.709817    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"]
Sep 09 20:58:33.712623 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:58:33.712594    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a917b8_9df7_4775_ac6c_246a7aca6956.slice/crio-aa98eb21c78405922195dccd38bb5ef4f60ad9ded73ebe67ec52521e5ec3ee5f WatchSource:0}: Error finding container aa98eb21c78405922195dccd38bb5ef4f60ad9ded73ebe67ec52521e5ec3ee5f: Status 404 returned error can't find the container with id aa98eb21c78405922195dccd38bb5ef4f60ad9ded73ebe67ec52521e5ec3ee5f
Sep 09 20:58:34.603504 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:34.603471    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m" event={"ID":"85a917b8-9df7-4775-ac6c-246a7aca6956","Type":"ContainerStarted","Data":"8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e"}
Sep 09 20:58:34.603674 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:34.603521    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m" event={"ID":"85a917b8-9df7-4775-ac6c-246a7aca6956","Type":"ContainerStarted","Data":"aa98eb21c78405922195dccd38bb5ef4f60ad9ded73ebe67ec52521e5ec3ee5f"}
Sep 09 20:58:34.603674 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:34.603599    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:40.615311 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:40.615283    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:58:40.635654 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:40.635593    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m" podStartSLOduration=8.233741192 podStartE2EDuration="8.635572458s" totalImagesPullingTime="401.831266ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:34.622427636 +0000 UTC m=+1073.678964777" watchObservedRunningTime="2026-09-09 20:58:40.635572458 +0000 UTC m=+1079.692109602"
Sep 09 20:58:45.285776 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.285693    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"]
Sep 09 20:58:45.286440 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.286348    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b" podUID="959e4b00-42e2-4e1d-9d28-5561aae7701b" containerName="maas-api" containerID="cri-o://1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd" gracePeriod=30
Sep 09 20:58:45.543965 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.543939    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:58:45.593828 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.593784    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/959e4b00-42e2-4e1d-9d28-5561aae7701b-openshift-service-ca\") pod \"959e4b00-42e2-4e1d-9d28-5561aae7701b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") "
Sep 09 20:58:45.594035 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.593874    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-maas-api-tls\") pod \"959e4b00-42e2-4e1d-9d28-5561aae7701b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") "
Sep 09 20:58:45.594035 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.594023    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5xgv\" (UniqueName: \"kubernetes.io/projected/959e4b00-42e2-4e1d-9d28-5561aae7701b-kube-api-access-v5xgv\") pod \"959e4b00-42e2-4e1d-9d28-5561aae7701b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") "
Sep 09 20:58:45.594163 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.594057    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-metrics-certs\") pod \"959e4b00-42e2-4e1d-9d28-5561aae7701b\" (UID: \"959e4b00-42e2-4e1d-9d28-5561aae7701b\") "
Sep 09 20:58:45.594220 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.594158    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/959e4b00-42e2-4e1d-9d28-5561aae7701b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "959e4b00-42e2-4e1d-9d28-5561aae7701b" (UID: "959e4b00-42e2-4e1d-9d28-5561aae7701b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:58:45.594448 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.594429    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/959e4b00-42e2-4e1d-9d28-5561aae7701b-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:58:45.596298 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.596266    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "959e4b00-42e2-4e1d-9d28-5561aae7701b" (UID: "959e4b00-42e2-4e1d-9d28-5561aae7701b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:58:45.596523 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.596503    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/959e4b00-42e2-4e1d-9d28-5561aae7701b-kube-api-access-v5xgv" (OuterVolumeSpecName: "kube-api-access-v5xgv") pod "959e4b00-42e2-4e1d-9d28-5561aae7701b" (UID: "959e4b00-42e2-4e1d-9d28-5561aae7701b"). InnerVolumeSpecName "kube-api-access-v5xgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:58:45.596597 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.596579    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "959e4b00-42e2-4e1d-9d28-5561aae7701b" (UID: "959e4b00-42e2-4e1d-9d28-5561aae7701b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:58:45.673523 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.673481    2555 generic.go:356] "Generic (PLEG): container finished" podID="959e4b00-42e2-4e1d-9d28-5561aae7701b" containerID="1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd" exitCode=0
Sep 09 20:58:45.673523 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.673526    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"
Sep 09 20:58:45.673779 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.673566    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b" event={"ID":"959e4b00-42e2-4e1d-9d28-5561aae7701b","Type":"ContainerDied","Data":"1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd"}
Sep 09 20:58:45.673779 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.673621    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b" event={"ID":"959e4b00-42e2-4e1d-9d28-5561aae7701b","Type":"ContainerDied","Data":"55a303d66f01058fdc8c3d8f0f3a8f420d7150c32d4ad264eed9c9e9b6837acf"}
Sep 09 20:58:45.673779 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.673647    2555 scope.go:117] "RemoveContainer" containerID="1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd"
Sep 09 20:58:45.683676 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.683656    2555 scope.go:117] "RemoveContainer" containerID="1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd"
Sep 09 20:58:45.684019 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:58:45.684001    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd\": container with ID starting with 1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd not found: ID does not exist" containerID="1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd"
Sep 09 20:58:45.684102 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.684026    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd"} err="failed to get container status \"1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd\": rpc error: code = NotFound desc = could not find container \"1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd\": container with ID starting with 1b938edc347517881455185fe795bd0a97b4bf8173308ff747e26f0328a377fd not found: ID does not exist"
Sep 09 20:58:45.696418 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.696389    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5xgv\" (UniqueName: \"kubernetes.io/projected/959e4b00-42e2-4e1d-9d28-5561aae7701b-kube-api-access-v5xgv\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:58:45.696418 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.696414    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:58:45.696592 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.696424    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/959e4b00-42e2-4e1d-9d28-5561aae7701b-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:58:45.697417 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.697356    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"]
Sep 09 20:58:45.702006 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:45.701983    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4edf-58c857578f-vl57b"]
Sep 09 20:58:47.433494 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:47.433457    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="959e4b00-42e2-4e1d-9d28-5561aae7701b" path="/var/lib/kubelet/pods/959e4b00-42e2-4e1d-9d28-5561aae7701b/volumes"
Sep 09 20:58:54.261141 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.261099    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"]
Sep 09 20:58:54.261596 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.261552    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="959e4b00-42e2-4e1d-9d28-5561aae7701b" containerName="maas-api"
Sep 09 20:58:54.261596 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.261565    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="959e4b00-42e2-4e1d-9d28-5561aae7701b" containerName="maas-api"
Sep 09 20:58:54.261668 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.261634    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="959e4b00-42e2-4e1d-9d28-5561aae7701b" containerName="maas-api"
Sep 09 20:58:54.266038 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.266017    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.268618 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.268595    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d36b91\"/\"default-dockercfg-cw4tw\""
Sep 09 20:58:54.268872 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.268853    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-d36b91\"/\"openshift-service-ca.crt\""
Sep 09 20:58:54.269675 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.269655    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-d36b91\"/\"kube-root-ca.crt\""
Sep 09 20:58:54.269772 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.269691    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d36b91\"/\"distinct-w0-d36b91-kserve-self-signed-certs\""
Sep 09 20:58:54.284527 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.284493    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"]
Sep 09 20:58:54.377945 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.377885    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tls-certs\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.378114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.377999    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-model-cache\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.378114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.378033    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28cbn\" (UniqueName: \"kubernetes.io/projected/aa59e886-3812-4cd3-8bf0-e08fb2d52099-kube-api-access-28cbn\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.378114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.378064    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tmp-dir\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.378114 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.378101    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-home\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.378262 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.378173    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-dshm\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.479322 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.479286    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tls-certs\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.479484 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.479340    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-model-cache\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.479484 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.479451    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28cbn\" (UniqueName: \"kubernetes.io/projected/aa59e886-3812-4cd3-8bf0-e08fb2d52099-kube-api-access-28cbn\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.479575 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.479495    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tmp-dir\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.479575 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.479556    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-home\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.479686 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.479590    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-dshm\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.479749 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.479709    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-model-cache\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.479871 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.479848    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tmp-dir\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.479968 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.479882    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-home\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.481784 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.481764    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-dshm\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.481974 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.481957    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tls-certs\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.488634 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.488613    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28cbn\" (UniqueName: \"kubernetes.io/projected/aa59e886-3812-4cd3-8bf0-e08fb2d52099-kube-api-access-28cbn\") pod \"distinct-w0-d36b91-kserve-6d47c96b56-pvs66\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.575808 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.575774    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:58:54.866880 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:54.866790    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"]
Sep 09 20:58:54.870468 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:58:54.870431    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa59e886_3812_4cd3_8bf0_e08fb2d52099.slice/crio-6134076aeb29121d3516ef400da67be132d7790d1f12e905bf66d2e65d8f6c78 WatchSource:0}: Error finding container 6134076aeb29121d3516ef400da67be132d7790d1f12e905bf66d2e65d8f6c78: Status 404 returned error can't find the container with id 6134076aeb29121d3516ef400da67be132d7790d1f12e905bf66d2e65d8f6c78
Sep 09 20:58:55.739998 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:55.739945    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66" event={"ID":"aa59e886-3812-4cd3-8bf0-e08fb2d52099","Type":"ContainerStarted","Data":"f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd"}
Sep 09 20:58:55.739998 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:55.740003    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66" event={"ID":"aa59e886-3812-4cd3-8bf0-e08fb2d52099","Type":"ContainerStarted","Data":"6134076aeb29121d3516ef400da67be132d7790d1f12e905bf66d2e65d8f6c78"}
Sep 09 20:58:55.760240 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:58:55.760195    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66" podStartSLOduration=1.760178551 podStartE2EDuration="1.760178551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:55.757091044 +0000 UTC m=+1094.813628238" watchObservedRunningTime="2026-09-09 20:58:55.760178551 +0000 UTC m=+1094.816715724"
Sep 09 20:59:04.576207 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:04.576162    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:59:04.576687 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:04.576248    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:59:04.589191 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:04.589159    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:59:04.807859 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:04.807827    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 20:59:14.276778 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.276740    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"]
Sep 09 20:59:14.277285 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.277072    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m" podUID="85a917b8-9df7-4775-ac6c-246a7aca6956" containerName="maas-api" containerID="cri-o://8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e" gracePeriod=30
Sep 09 20:59:14.530737 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.530679    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:59:14.573264 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.573232    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-maas-api-tls\") pod \"85a917b8-9df7-4775-ac6c-246a7aca6956\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") "
Sep 09 20:59:14.573393 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.573348    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a917b8-9df7-4775-ac6c-246a7aca6956-openshift-service-ca\") pod \"85a917b8-9df7-4775-ac6c-246a7aca6956\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") "
Sep 09 20:59:14.573393 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.573376    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-metrics-certs\") pod \"85a917b8-9df7-4775-ac6c-246a7aca6956\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") "
Sep 09 20:59:14.573489 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.573477    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n29rp\" (UniqueName: \"kubernetes.io/projected/85a917b8-9df7-4775-ac6c-246a7aca6956-kube-api-access-n29rp\") pod \"85a917b8-9df7-4775-ac6c-246a7aca6956\" (UID: \"85a917b8-9df7-4775-ac6c-246a7aca6956\") "
Sep 09 20:59:14.573737 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.573706    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a917b8-9df7-4775-ac6c-246a7aca6956-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "85a917b8-9df7-4775-ac6c-246a7aca6956" (UID: "85a917b8-9df7-4775-ac6c-246a7aca6956"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:59:14.574038 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.573940    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a917b8-9df7-4775-ac6c-246a7aca6956-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:59:14.575459 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.575432    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "85a917b8-9df7-4775-ac6c-246a7aca6956" (UID: "85a917b8-9df7-4775-ac6c-246a7aca6956"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:59:14.575595 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.575572    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a917b8-9df7-4775-ac6c-246a7aca6956-kube-api-access-n29rp" (OuterVolumeSpecName: "kube-api-access-n29rp") pod "85a917b8-9df7-4775-ac6c-246a7aca6956" (UID: "85a917b8-9df7-4775-ac6c-246a7aca6956"). InnerVolumeSpecName "kube-api-access-n29rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:59:14.575639 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.575591    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "85a917b8-9df7-4775-ac6c-246a7aca6956" (UID: "85a917b8-9df7-4775-ac6c-246a7aca6956"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:59:14.674806 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.674771    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:59:14.674806 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.674795    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n29rp\" (UniqueName: \"kubernetes.io/projected/85a917b8-9df7-4775-ac6c-246a7aca6956-kube-api-access-n29rp\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:59:14.674806 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.674804    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a917b8-9df7-4775-ac6c-246a7aca6956-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 20:59:14.864526 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.864494    2555 generic.go:356] "Generic (PLEG): container finished" podID="85a917b8-9df7-4775-ac6c-246a7aca6956" containerID="8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e" exitCode=0
Sep 09 20:59:14.864716 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.864570    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m" event={"ID":"85a917b8-9df7-4775-ac6c-246a7aca6956","Type":"ContainerDied","Data":"8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e"}
Sep 09 20:59:14.864716 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.864585    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"
Sep 09 20:59:14.864716 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.864617    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m" event={"ID":"85a917b8-9df7-4775-ac6c-246a7aca6956","Type":"ContainerDied","Data":"aa98eb21c78405922195dccd38bb5ef4f60ad9ded73ebe67ec52521e5ec3ee5f"}
Sep 09 20:59:14.864716 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.864640    2555 scope.go:117] "RemoveContainer" containerID="8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e"
Sep 09 20:59:14.875357 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.875337    2555 scope.go:117] "RemoveContainer" containerID="8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e"
Sep 09 20:59:14.875631 ip-10-0-135-158 kubenswrapper[2555]: E0909 20:59:14.875611    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e\": container with ID starting with 8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e not found: ID does not exist" containerID="8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e"
Sep 09 20:59:14.875691 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.875640    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e"} err="failed to get container status \"8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e\": rpc error: code = NotFound desc = could not find container \"8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e\": container with ID starting with 8c8f230d01087cb528c99127743eb9041d78ababe124e3907806ba3ce021776e not found: ID does not exist"
Sep 09 20:59:14.891572 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.891539    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"]
Sep 09 20:59:14.895997 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:14.895973    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2f4649f-6946ff464f-2dw6m"]
Sep 09 20:59:15.432134 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:15.432102    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85a917b8-9df7-4775-ac6c-246a7aca6956" path="/var/lib/kubelet/pods/85a917b8-9df7-4775-ac6c-246a7aca6956/volumes"
Sep 09 20:59:39.938930 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:39.938877    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"]
Sep 09 20:59:39.939436 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:39.939419    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a917b8-9df7-4775-ac6c-246a7aca6956" containerName="maas-api"
Sep 09 20:59:39.939482 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:39.939439    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a917b8-9df7-4775-ac6c-246a7aca6956" containerName="maas-api"
Sep 09 20:59:39.939549 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:39.939537    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85a917b8-9df7-4775-ac6c-246a7aca6956" containerName="maas-api"
Sep 09 20:59:39.943336 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:39.943315    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:39.946548 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:39.946526    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-e73aab-serving-cert\""
Sep 09 20:59:39.960712 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:39.960688    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"]
Sep 09 20:59:40.134316 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.134276    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.134516 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.134340    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc89l\" (UniqueName: \"kubernetes.io/projected/6806ac69-9db9-4992-be74-20ea5f816877-kube-api-access-lc89l\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.134516 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.134439    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6806ac69-9db9-4992-be74-20ea5f816877-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.134516 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.134490    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.235434 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.235333    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.235727 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.235704    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc89l\" (UniqueName: \"kubernetes.io/projected/6806ac69-9db9-4992-be74-20ea5f816877-kube-api-access-lc89l\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.236013 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.235989    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6806ac69-9db9-4992-be74-20ea5f816877-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.236175 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.236158    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.237247 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.237220    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6806ac69-9db9-4992-be74-20ea5f816877-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.239333 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.239300    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.239450 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.239385    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.247222 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.247198    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc89l\" (UniqueName: \"kubernetes.io/projected/6806ac69-9db9-4992-be74-20ea5f816877-kube-api-access-lc89l\") pod \"maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.255058 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.255035    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:40.536104 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:40.536080    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"]
Sep 09 20:59:40.537748 ip-10-0-135-158 kubenswrapper[2555]: W0909 20:59:40.537724    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6806ac69_9db9_4992_be74_20ea5f816877.slice/crio-be9b84c4f35dc79b49d98a201dbd4e7d3863b669ca5cebc7fb07340693a5fce4 WatchSource:0}: Error finding container be9b84c4f35dc79b49d98a201dbd4e7d3863b669ca5cebc7fb07340693a5fce4: Status 404 returned error can't find the container with id be9b84c4f35dc79b49d98a201dbd4e7d3863b669ca5cebc7fb07340693a5fce4
Sep 09 20:59:41.031180 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:41.031152    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb" event={"ID":"6806ac69-9db9-4992-be74-20ea5f816877","Type":"ContainerStarted","Data":"be9b84c4f35dc79b49d98a201dbd4e7d3863b669ca5cebc7fb07340693a5fce4"}
Sep 09 20:59:42.039573 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:42.039537    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb" event={"ID":"6806ac69-9db9-4992-be74-20ea5f816877","Type":"ContainerStarted","Data":"ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b"}
Sep 09 20:59:42.040018 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:42.039651    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 20:59:42.059617 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:42.059550    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb" podStartSLOduration=2.6073287880000002 podStartE2EDuration="3.059535741s" totalImagesPullingTime="452.206953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:59:42.057073974 +0000 UTC m=+1141.113611118" watchObservedRunningTime="2026-09-09 20:59:42.059535741 +0000 UTC m=+1141.116072882"
Sep 09 20:59:48.050918 ip-10-0-135-158 kubenswrapper[2555]: I0909 20:59:48.050875    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 21:00:01.768226 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.768192    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"]
Sep 09 21:00:01.773005 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.772980    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.775514 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.775487    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d36b91\"/\"distinct-2-w0-d36b91-kserve-self-signed-certs\""
Sep 09 21:00:01.782016 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.781992    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"]
Sep 09 21:00:01.838266 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.838229    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-model-cache\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.838458 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.838275    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tmp-dir\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.838458 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.838329    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zvpc\" (UniqueName: \"kubernetes.io/projected/2c3b3a3a-c775-4557-93c9-46fb856afe9e-kube-api-access-9zvpc\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.838458 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.838416    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-dshm\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.838628 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.838465    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-home\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.838628 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.838494    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tls-certs\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.939121 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.939071    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-dshm\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.939325 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.939150    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-home\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.939325 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.939187    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tls-certs\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.939325 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.939268    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-model-cache\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.939325 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.939316    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tmp-dir\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.939567 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.939358    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zvpc\" (UniqueName: \"kubernetes.io/projected/2c3b3a3a-c775-4557-93c9-46fb856afe9e-kube-api-access-9zvpc\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.939683 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.939652    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-model-cache\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.939757 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.939698    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tmp-dir\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.940101 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.940078    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-home\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.941585 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.941560    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-dshm\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.942008 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.941987    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tls-certs\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:01.953084 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:01.948976    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zvpc\" (UniqueName: \"kubernetes.io/projected/2c3b3a3a-c775-4557-93c9-46fb856afe9e-kube-api-access-9zvpc\") pod \"distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") " pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:02.083884 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:02.083844    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:02.364678 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:02.364652    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"]
Sep 09 21:00:02.366603 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:00:02.366577    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c3b3a3a_c775_4557_93c9_46fb856afe9e.slice/crio-44ef6483d041584b8bee30b80a75297eb7088ccfb8fe24a98411c883638738ff WatchSource:0}: Error finding container 44ef6483d041584b8bee30b80a75297eb7088ccfb8fe24a98411c883638738ff: Status 404 returned error can't find the container with id 44ef6483d041584b8bee30b80a75297eb7088ccfb8fe24a98411c883638738ff
Sep 09 21:00:03.173710 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:03.173675    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r" event={"ID":"2c3b3a3a-c775-4557-93c9-46fb856afe9e","Type":"ContainerStarted","Data":"4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e"}
Sep 09 21:00:03.173710 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:03.173719    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r" event={"ID":"2c3b3a3a-c775-4557-93c9-46fb856afe9e","Type":"ContainerStarted","Data":"44ef6483d041584b8bee30b80a75297eb7088ccfb8fe24a98411c883638738ff"}
Sep 09 21:00:03.198446 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:03.198390    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r" podStartSLOduration=2.198373069 podStartE2EDuration="2.198373069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:00:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:03.196422587 +0000 UTC m=+1162.252959730" watchObservedRunningTime="2026-09-09 21:00:03.198373069 +0000 UTC m=+1162.254910205"
Sep 09 21:00:06.967614 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:06.967573    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"]
Sep 09 21:00:09.232486 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.232454    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"]
Sep 09 21:00:09.235804 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.235778    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.238642 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.238619    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-06e1ff-serving-cert\""
Sep 09 21:00:09.252204 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.252172    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"]
Sep 09 21:00:09.311841 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.311807    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01ee8c-5a54-45db-a249-bda1c9327358-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.312035 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.311858    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.312035 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.311881    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.312035 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.311967    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k755p\" (UniqueName: \"kubernetes.io/projected/2b01ee8c-5a54-45db-a249-bda1c9327358-kube-api-access-k755p\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.413422 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.413385    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01ee8c-5a54-45db-a249-bda1c9327358-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.413614 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.413448    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.413614 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.413479    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.413614 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:09.413595    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-serving-cert: secret "maas-api-e2e-shared-b-w2-06e1ff-serving-cert" not found
Sep 09 21:00:09.413802 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.413648    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k755p\" (UniqueName: \"kubernetes.io/projected/2b01ee8c-5a54-45db-a249-bda1c9327358-kube-api-access-k755p\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.413802 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:09.413668    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-maas-api-tls podName:2b01ee8c-5a54-45db-a249-bda1c9327358 nodeName:}" failed. No retries permitted until 2026-09-09 21:00:09.913647965 +0000 UTC m=+1168.970185097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-maas-api-tls") pod "maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc" (UID: "2b01ee8c-5a54-45db-a249-bda1c9327358") : secret "maas-api-e2e-shared-b-w2-06e1ff-serving-cert" not found
Sep 09 21:00:09.414268 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.414245    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01ee8c-5a54-45db-a249-bda1c9327358-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.417459 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.417434    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.424979 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.424950    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k755p\" (UniqueName: \"kubernetes.io/projected/2b01ee8c-5a54-45db-a249-bda1c9327358-kube-api-access-k755p\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.918167 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.918130    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:09.920564 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:09.920545    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:10.150569 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:10.150529    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:10.430701 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:10.430677    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"]
Sep 09 21:00:10.432309 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:00:10.432275    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b01ee8c_5a54_45db_a249_bda1c9327358.slice/crio-dcca14bdd6cdd04c2e4c24a7beac149f7501b858394faf211e11f8b9804cff32 WatchSource:0}: Error finding container dcca14bdd6cdd04c2e4c24a7beac149f7501b858394faf211e11f8b9804cff32: Status 404 returned error can't find the container with id dcca14bdd6cdd04c2e4c24a7beac149f7501b858394faf211e11f8b9804cff32
Sep 09 21:00:11.231973 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:11.231937    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc" event={"ID":"2b01ee8c-5a54-45db-a249-bda1c9327358","Type":"ContainerStarted","Data":"dcca14bdd6cdd04c2e4c24a7beac149f7501b858394faf211e11f8b9804cff32"}
Sep 09 21:00:12.084211 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:12.084176    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:12.084667 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:12.084232    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:12.096535 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:12.096511    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:12.239946 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:12.239879    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc" event={"ID":"2b01ee8c-5a54-45db-a249-bda1c9327358","Type":"ContainerStarted","Data":"7065d0c9f4b1443a3f18f4e9954b782b9fcac6f8a9bf83794b9c88691e68f681"}
Sep 09 21:00:12.240146 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:12.239988    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:12.251103 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:12.251076    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:00:12.257811 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:12.257754    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc" podStartSLOduration=2.439011923 podStartE2EDuration="3.257739529s" totalImagesPullingTime="818.727606ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:12.256488452 +0000 UTC m=+1171.313025592" watchObservedRunningTime="2026-09-09 21:00:12.257739529 +0000 UTC m=+1171.314276668"
Sep 09 21:00:18.252433 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:18.252402    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:00:21.987350 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:21.987305    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh" podUID="f71c3452-e2e3-4ed8-b4b6-867904b2f967" containerName="main" containerID="cri-o://5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7" gracePeriod=45
Sep 09 21:00:22.239280 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.239217    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 21:00:22.302069 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.302038    2555 generic.go:356] "Generic (PLEG): container finished" podID="f71c3452-e2e3-4ed8-b4b6-867904b2f967" containerID="5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7" exitCode=0
Sep 09 21:00:22.302278 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.302083    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"
Sep 09 21:00:22.302278 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.302132    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh" event={"ID":"f71c3452-e2e3-4ed8-b4b6-867904b2f967","Type":"ContainerDied","Data":"5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7"}
Sep 09 21:00:22.302278 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.302181    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh" event={"ID":"f71c3452-e2e3-4ed8-b4b6-867904b2f967","Type":"ContainerDied","Data":"2720b8d39fbb1abcf1b9d5e4a05b2ab1c70d432fd26bf47c7d0c7a5e32edf452"}
Sep 09 21:00:22.302278 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.302203    2555 scope.go:117] "RemoveContainer" containerID="5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7"
Sep 09 21:00:22.311840 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.311821    2555 scope.go:117] "RemoveContainer" containerID="5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7"
Sep 09 21:00:22.312164 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:22.312146    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7\": container with ID starting with 5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7 not found: ID does not exist" containerID="5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7"
Sep 09 21:00:22.312233 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.312175    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7"} err="failed to get container status \"5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7\": rpc error: code = NotFound desc = could not find container \"5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7\": container with ID starting with 5d7bdb37024bfd5d665951db6d9fcc382da640ca957d70ddfbbaa83bd8e1d9d7 not found: ID does not exist"
Sep 09 21:00:22.335509 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.335481    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tls-certs\") pod \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") "
Sep 09 21:00:22.335618 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.335544    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-dshm\") pod \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") "
Sep 09 21:00:22.335618 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.335567    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-model-cache\") pod \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") "
Sep 09 21:00:22.335730 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.335638    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tmp-dir\") pod \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") "
Sep 09 21:00:22.335730 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.335659    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhc4f\" (UniqueName: \"kubernetes.io/projected/f71c3452-e2e3-4ed8-b4b6-867904b2f967-kube-api-access-mhc4f\") pod \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") "
Sep 09 21:00:22.335730 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.335699    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-home\") pod \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\" (UID: \"f71c3452-e2e3-4ed8-b4b6-867904b2f967\") "
Sep 09 21:00:22.335976 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.335948    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f71c3452-e2e3-4ed8-b4b6-867904b2f967" (UID: "f71c3452-e2e3-4ed8-b4b6-867904b2f967"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:00:22.336075 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.335962    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-model-cache" (OuterVolumeSpecName: "model-cache") pod "f71c3452-e2e3-4ed8-b4b6-867904b2f967" (UID: "f71c3452-e2e3-4ed8-b4b6-867904b2f967"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:00:22.336075 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.336045    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-home" (OuterVolumeSpecName: "home") pod "f71c3452-e2e3-4ed8-b4b6-867904b2f967" (UID: "f71c3452-e2e3-4ed8-b4b6-867904b2f967"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:00:22.338007 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.337960    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f71c3452-e2e3-4ed8-b4b6-867904b2f967" (UID: "f71c3452-e2e3-4ed8-b4b6-867904b2f967"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:00:22.338116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.338023    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f71c3452-e2e3-4ed8-b4b6-867904b2f967-kube-api-access-mhc4f" (OuterVolumeSpecName: "kube-api-access-mhc4f") pod "f71c3452-e2e3-4ed8-b4b6-867904b2f967" (UID: "f71c3452-e2e3-4ed8-b4b6-867904b2f967"). InnerVolumeSpecName "kube-api-access-mhc4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:22.338116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.338065    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-dshm" (OuterVolumeSpecName: "dshm") pod "f71c3452-e2e3-4ed8-b4b6-867904b2f967" (UID: "f71c3452-e2e3-4ed8-b4b6-867904b2f967"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:00:22.436973 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.436936    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tls-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.436973 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.436965    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-dshm\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.436973 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.436975    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-model-cache\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.436973 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.436985    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-tmp-dir\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.437247 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.436996    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhc4f\" (UniqueName: \"kubernetes.io/projected/f71c3452-e2e3-4ed8-b4b6-867904b2f967-kube-api-access-mhc4f\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.437247 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.437008    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f71c3452-e2e3-4ed8-b4b6-867904b2f967-home\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.629106 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.629077    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"]
Sep 09 21:00:22.633561 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:22.633537    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-5eef90/test-model-5eef90-kserve-5b6d68cdbf-hkfnh"]
Sep 09 21:00:23.432216 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:23.432178    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f71c3452-e2e3-4ed8-b4b6-867904b2f967" path="/var/lib/kubelet/pods/f71c3452-e2e3-4ed8-b4b6-867904b2f967/volumes"
Sep 09 21:00:31.998921 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:31.998861    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"]
Sep 09 21:00:31.999402 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:31.999138    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp" podUID="bd1bf360-746e-4a7a-b507-70339d00ae1d" containerName="maas-api" containerID="cri-o://be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99" gracePeriod=30
Sep 09 21:00:32.256336 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.256276    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 21:00:32.328976 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.328945    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bf360-746e-4a7a-b507-70339d00ae1d-openshift-service-ca\") pod \"bd1bf360-746e-4a7a-b507-70339d00ae1d\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") "
Sep 09 21:00:32.328976 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.328979    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-metrics-certs\") pod \"bd1bf360-746e-4a7a-b507-70339d00ae1d\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") "
Sep 09 21:00:32.329184 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.329010    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pndtn\" (UniqueName: \"kubernetes.io/projected/bd1bf360-746e-4a7a-b507-70339d00ae1d-kube-api-access-pndtn\") pod \"bd1bf360-746e-4a7a-b507-70339d00ae1d\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") "
Sep 09 21:00:32.329184 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.329090    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls\") pod \"bd1bf360-746e-4a7a-b507-70339d00ae1d\" (UID: \"bd1bf360-746e-4a7a-b507-70339d00ae1d\") "
Sep 09 21:00:32.329404 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.329374    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1bf360-746e-4a7a-b507-70339d00ae1d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd1bf360-746e-4a7a-b507-70339d00ae1d" (UID: "bd1bf360-746e-4a7a-b507-70339d00ae1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:00:32.331331 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.331294    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd1bf360-746e-4a7a-b507-70339d00ae1d" (UID: "bd1bf360-746e-4a7a-b507-70339d00ae1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:00:32.331462 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.331348    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1bf360-746e-4a7a-b507-70339d00ae1d-kube-api-access-pndtn" (OuterVolumeSpecName: "kube-api-access-pndtn") pod "bd1bf360-746e-4a7a-b507-70339d00ae1d" (UID: "bd1bf360-746e-4a7a-b507-70339d00ae1d"). InnerVolumeSpecName "kube-api-access-pndtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:32.331462 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.331369    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bd1bf360-746e-4a7a-b507-70339d00ae1d" (UID: "bd1bf360-746e-4a7a-b507-70339d00ae1d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:00:32.366157 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.366126    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd1bf360-746e-4a7a-b507-70339d00ae1d" containerID="be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99" exitCode=0
Sep 09 21:00:32.366298 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.366161    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp" event={"ID":"bd1bf360-746e-4a7a-b507-70339d00ae1d","Type":"ContainerDied","Data":"be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99"}
Sep 09 21:00:32.366298 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.366171    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"
Sep 09 21:00:32.366298 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.366217    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp" event={"ID":"bd1bf360-746e-4a7a-b507-70339d00ae1d","Type":"ContainerDied","Data":"1abd165a74fd86c0970b1aa263e4a51f21b19c081a98feba5f9a96e645378552"}
Sep 09 21:00:32.366298 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.366241    2555 scope.go:117] "RemoveContainer" containerID="be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99"
Sep 09 21:00:32.376811 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.376788    2555 scope.go:117] "RemoveContainer" containerID="be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99"
Sep 09 21:00:32.377151 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:32.377127    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99\": container with ID starting with be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99 not found: ID does not exist" containerID="be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99"
Sep 09 21:00:32.377233 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.377158    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99"} err="failed to get container status \"be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99\": rpc error: code = NotFound desc = could not find container \"be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99\": container with ID starting with be0ba0e34a6a0be92a07b8596584fed92184911ec53d10559e3e549024263d99 not found: ID does not exist"
Sep 09 21:00:32.392781 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.392760    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"]
Sep 09 21:00:32.395509 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.395488    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5eef90-7df559fff-fwckp"]
Sep 09 21:00:32.430416 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.430383    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1bf360-746e-4a7a-b507-70339d00ae1d-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:32.430416 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.430409    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:32.430416 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.430419    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pndtn\" (UniqueName: \"kubernetes.io/projected/bd1bf360-746e-4a7a-b507-70339d00ae1d-kube-api-access-pndtn\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:32.430626 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:32.430430    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd1bf360-746e-4a7a-b507-70339d00ae1d-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:33.431168 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:33.431129    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd1bf360-746e-4a7a-b507-70339d00ae1d" path="/var/lib/kubelet/pods/bd1bf360-746e-4a7a-b507-70339d00ae1d/volumes"
Sep 09 21:00:34.226834 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.226799    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7537-cbbc1a"]
Sep 09 21:00:34.227251 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.227238    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1bf360-746e-4a7a-b507-70339d00ae1d" containerName="maas-api"
Sep 09 21:00:34.227305 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.227253    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1bf360-746e-4a7a-b507-70339d00ae1d" containerName="maas-api"
Sep 09 21:00:34.227305 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.227273    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f71c3452-e2e3-4ed8-b4b6-867904b2f967" containerName="main"
Sep 09 21:00:34.227305 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.227278    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f71c3452-e2e3-4ed8-b4b6-867904b2f967" containerName="main"
Sep 09 21:00:34.227396 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.227338    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd1bf360-746e-4a7a-b507-70339d00ae1d" containerName="maas-api"
Sep 09 21:00:34.227396 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.227349    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f71c3452-e2e3-4ed8-b4b6-867904b2f967" containerName="main"
Sep 09 21:00:34.232029 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.232010    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:34.234816 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.234791    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n65wg\""
Sep 09 21:00:34.237427 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.237400    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7537-cbbc1a"]
Sep 09 21:00:34.349330 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.349294    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxxh\" (UniqueName: \"kubernetes.io/projected/141dc376-d701-41c7-956b-05fcd8900090-kube-api-access-dbxxh\") pod \"test-curl-7537-cbbc1a\" (UID: \"141dc376-d701-41c7-956b-05fcd8900090\") " pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:34.450073 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.450038    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxxh\" (UniqueName: \"kubernetes.io/projected/141dc376-d701-41c7-956b-05fcd8900090-kube-api-access-dbxxh\") pod \"test-curl-7537-cbbc1a\" (UID: \"141dc376-d701-41c7-956b-05fcd8900090\") " pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:34.458185 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.458155    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxxh\" (UniqueName: \"kubernetes.io/projected/141dc376-d701-41c7-956b-05fcd8900090-kube-api-access-dbxxh\") pod \"test-curl-7537-cbbc1a\" (UID: \"141dc376-d701-41c7-956b-05fcd8900090\") " pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:34.543324 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.543292    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:34.821750 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:34.821719    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7537-cbbc1a"]
Sep 09 21:00:34.823377 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:00:34.823350    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod141dc376_d701_41c7_956b_05fcd8900090.slice/crio-071a3dd876c9fcab480d0da96edf0b84a7c5e12c0cabe3ff77a07419cbd227d8 WatchSource:0}: Error finding container 071a3dd876c9fcab480d0da96edf0b84a7c5e12c0cabe3ff77a07419cbd227d8: Status 404 returned error can't find the container with id 071a3dd876c9fcab480d0da96edf0b84a7c5e12c0cabe3ff77a07419cbd227d8
Sep 09 21:00:35.386309 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:35.386265    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7537-cbbc1a" event={"ID":"141dc376-d701-41c7-956b-05fcd8900090","Type":"ContainerStarted","Data":"698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d"}
Sep 09 21:00:35.386505 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:35.386318    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7537-cbbc1a" event={"ID":"141dc376-d701-41c7-956b-05fcd8900090","Type":"ContainerStarted","Data":"071a3dd876c9fcab480d0da96edf0b84a7c5e12c0cabe3ff77a07419cbd227d8"}
Sep 09 21:00:36.039516 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.039464    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7537-cbbc1a" podStartSLOduration=2.03944598 podStartE2EDuration="2.03944598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:00:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:35.405771637 +0000 UTC m=+1194.462308788" watchObservedRunningTime="2026-09-09 21:00:36.03944598 +0000 UTC m=+1195.095983123"
Sep 09 21:00:36.041326 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.041298    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7537-cbbc1a"]
Sep 09 21:00:36.051057 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.051032    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7537-cbbc1a"]
Sep 09 21:00:36.156886 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.156810    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7537-53d529"]
Sep 09 21:00:36.157266 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.157252    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141dc376-d701-41c7-956b-05fcd8900090" containerName="test-curl-7537-cbbc1a"
Sep 09 21:00:36.157309 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.157269    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="141dc376-d701-41c7-956b-05fcd8900090" containerName="test-curl-7537-cbbc1a"
Sep 09 21:00:36.157366 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.157358    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="141dc376-d701-41c7-956b-05fcd8900090" containerName="test-curl-7537-cbbc1a"
Sep 09 21:00:36.160636 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.160618    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:36.167107 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.167082    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7537-53d529"]
Sep 09 21:00:36.270268 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.270233    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgmwj\" (UniqueName: \"kubernetes.io/projected/45fe549c-fc67-4d91-8f15-c986cc8036ca-kube-api-access-sgmwj\") pod \"test-curl-7537-53d529\" (UID: \"45fe549c-fc67-4d91-8f15-c986cc8036ca\") " pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:36.371673 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.371638    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgmwj\" (UniqueName: \"kubernetes.io/projected/45fe549c-fc67-4d91-8f15-c986cc8036ca-kube-api-access-sgmwj\") pod \"test-curl-7537-53d529\" (UID: \"45fe549c-fc67-4d91-8f15-c986cc8036ca\") " pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:36.382410 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.382381    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgmwj\" (UniqueName: \"kubernetes.io/projected/45fe549c-fc67-4d91-8f15-c986cc8036ca-kube-api-access-sgmwj\") pod \"test-curl-7537-53d529\" (UID: \"45fe549c-fc67-4d91-8f15-c986cc8036ca\") " pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:36.393438 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:36.393417    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7537-cbbc1a" container="test-curl-7537-cbbc1a"
Sep 09 21:00:36.470753 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.470679    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:36.744263 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:36.744237    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7537-53d529"]
Sep 09 21:00:36.745941 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:00:36.745891    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45fe549c_fc67_4d91_8f15_c986cc8036ca.slice/crio-b97f95fb79e1d6116554bc436dfeb718945a136b2dbfb88f053a7df48ce6d2d1 WatchSource:0}: Error finding container b97f95fb79e1d6116554bc436dfeb718945a136b2dbfb88f053a7df48ce6d2d1: Status 404 returned error can't find the container with id b97f95fb79e1d6116554bc436dfeb718945a136b2dbfb88f053a7df48ce6d2d1
Sep 09 21:00:37.401741 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:37.401703    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7537-53d529" event={"ID":"45fe549c-fc67-4d91-8f15-c986cc8036ca","Type":"ContainerStarted","Data":"7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166"}
Sep 09 21:00:37.402257 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:37.401756    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7537-53d529" event={"ID":"45fe549c-fc67-4d91-8f15-c986cc8036ca","Type":"ContainerStarted","Data":"b97f95fb79e1d6116554bc436dfeb718945a136b2dbfb88f053a7df48ce6d2d1"}
Sep 09 21:00:37.402514 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:37.402467    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7537-cbbc1a" podUID="141dc376-d701-41c7-956b-05fcd8900090" containerName="test-curl-7537-cbbc1a" containerID="cri-o://698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d" gracePeriod=2
Sep 09 21:00:37.425141 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:37.425105    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-cbbc1a\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="141dc376-d701-41c7-956b-05fcd8900090" pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:37.425408 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:37.425370    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7537-53d529" podStartSLOduration=1.425356341 podStartE2EDuration="1.425356341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:37.423106144 +0000 UTC m=+1196.479643282" watchObservedRunningTime="2026-09-09 21:00:37.425356341 +0000 UTC m=+1196.481893482"
Sep 09 21:00:38.008379 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.008344    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7537-53d529"]
Sep 09 21:00:38.011721 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.011686    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7537-53d529"]
Sep 09 21:00:38.122873 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.122781    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7537-058859"]
Sep 09 21:00:38.123431 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.123408    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45fe549c-fc67-4d91-8f15-c986cc8036ca" containerName="test-curl-7537-53d529"
Sep 09 21:00:38.123431 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.123432    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="45fe549c-fc67-4d91-8f15-c986cc8036ca" containerName="test-curl-7537-53d529"
Sep 09 21:00:38.123625 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.123585    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="45fe549c-fc67-4d91-8f15-c986cc8036ca" containerName="test-curl-7537-53d529"
Sep 09 21:00:38.126946 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.126892    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-058859"
Sep 09 21:00:38.134235 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.134213    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7537-058859"]
Sep 09 21:00:38.191146 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.191114    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd77h\" (UniqueName: \"kubernetes.io/projected/2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a-kube-api-access-qd77h\") pod \"test-curl-7537-058859\" (UID: \"2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a\") " pod="opendatahub/test-curl-7537-058859"
Sep 09 21:00:38.291542 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.291511    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd77h\" (UniqueName: \"kubernetes.io/projected/2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a-kube-api-access-qd77h\") pod \"test-curl-7537-058859\" (UID: \"2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a\") " pod="opendatahub/test-curl-7537-058859"
Sep 09 21:00:38.299415 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.299385    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd77h\" (UniqueName: \"kubernetes.io/projected/2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a-kube-api-access-qd77h\") pod \"test-curl-7537-058859\" (UID: \"2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a\") " pod="opendatahub/test-curl-7537-058859"
Sep 09 21:00:38.410143 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:38.410063    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7537-53d529" container="test-curl-7537-53d529"
Sep 09 21:00:38.437637 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.437612    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-058859"
Sep 09 21:00:38.710127 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:38.710102    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7537-058859"]
Sep 09 21:00:38.711350 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:00:38.711325    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b00e7d0_b1c9_44ef_a35f_16fd4d65d86a.slice/crio-6ce25f2ddb96a6e6424f35378e27e03bcb112ab12aeaecefa29e45fb123e4c1e WatchSource:0}: Error finding container 6ce25f2ddb96a6e6424f35378e27e03bcb112ab12aeaecefa29e45fb123e4c1e: Status 404 returned error can't find the container with id 6ce25f2ddb96a6e6424f35378e27e03bcb112ab12aeaecefa29e45fb123e4c1e
Sep 09 21:00:39.420405 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:39.420381    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7537-058859" event={"ID":"2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a","Type":"ContainerStarted","Data":"162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232"}
Sep 09 21:00:39.420706 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:39.420427    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7537-058859" event={"ID":"2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a","Type":"ContainerStarted","Data":"6ce25f2ddb96a6e6424f35378e27e03bcb112ab12aeaecefa29e45fb123e4c1e"}
Sep 09 21:00:39.420706 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:39.420486    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7537-53d529" podUID="45fe549c-fc67-4d91-8f15-c986cc8036ca" containerName="test-curl-7537-53d529" containerID="cri-o://7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166" gracePeriod=2
Sep 09 21:00:39.435536 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:39.435486    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7537-058859" podStartSLOduration=1.435467771 podStartE2EDuration="1.435467771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:39.43470743 +0000 UTC m=+1198.491244571" watchObservedRunningTime="2026-09-09 21:00:39.435467771 +0000 UTC m=+1198.492004964"
Sep 09 21:00:39.436799 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:39.436768    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-53d529\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="45fe549c-fc67-4d91-8f15-c986cc8036ca" pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:39.568659 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:39.568634    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:39.606097 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:39.606061    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbxxh\" (UniqueName: \"kubernetes.io/projected/141dc376-d701-41c7-956b-05fcd8900090-kube-api-access-dbxxh\") pod \"141dc376-d701-41c7-956b-05fcd8900090\" (UID: \"141dc376-d701-41c7-956b-05fcd8900090\") "
Sep 09 21:00:39.608395 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:39.608369    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/141dc376-d701-41c7-956b-05fcd8900090-kube-api-access-dbxxh" (OuterVolumeSpecName: "kube-api-access-dbxxh") pod "141dc376-d701-41c7-956b-05fcd8900090" (UID: "141dc376-d701-41c7-956b-05fcd8900090"). InnerVolumeSpecName "kube-api-access-dbxxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:39.707820 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:39.707745    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbxxh\" (UniqueName: \"kubernetes.io/projected/141dc376-d701-41c7-956b-05fcd8900090-kube-api-access-dbxxh\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:40.025609 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.025502    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7537-058859"]
Sep 09 21:00:40.029001 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.028955    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7537-058859"]
Sep 09 21:00:40.138184 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.138152    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7537-8765e1"]
Sep 09 21:00:40.138558 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.138546    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a" containerName="test-curl-7537-058859"
Sep 09 21:00:40.138601 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.138560    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a" containerName="test-curl-7537-058859"
Sep 09 21:00:40.138654 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.138644    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a" containerName="test-curl-7537-058859"
Sep 09 21:00:40.141812 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.141788    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-8765e1"
Sep 09 21:00:40.147796 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.147770    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7537-8765e1"]
Sep 09 21:00:40.213059 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.213030    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7lgw\" (UniqueName: \"kubernetes.io/projected/c02ff399-9179-4126-bddf-c73867acfa9f-kube-api-access-k7lgw\") pod \"test-curl-7537-8765e1\" (UID: \"c02ff399-9179-4126-bddf-c73867acfa9f\") " pod="opendatahub/test-curl-7537-8765e1"
Sep 09 21:00:40.314414 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.314376    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7lgw\" (UniqueName: \"kubernetes.io/projected/c02ff399-9179-4126-bddf-c73867acfa9f-kube-api-access-k7lgw\") pod \"test-curl-7537-8765e1\" (UID: \"c02ff399-9179-4126-bddf-c73867acfa9f\") " pod="opendatahub/test-curl-7537-8765e1"
Sep 09 21:00:40.325272 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.325239    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7lgw\" (UniqueName: \"kubernetes.io/projected/c02ff399-9179-4126-bddf-c73867acfa9f-kube-api-access-k7lgw\") pod \"test-curl-7537-8765e1\" (UID: \"c02ff399-9179-4126-bddf-c73867acfa9f\") " pod="opendatahub/test-curl-7537-8765e1"
Sep 09 21:00:40.429073 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.429040    2555 generic.go:356] "Generic (PLEG): container finished" podID="141dc376-d701-41c7-956b-05fcd8900090" containerID="698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d" exitCode=137
Sep 09 21:00:40.429462 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.429078    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:40.429462 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.429145    2555 scope.go:117] "RemoveContainer" containerID="698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d"
Sep 09 21:00:40.429462 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:40.429394    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7537-058859" container="test-curl-7537-058859"
Sep 09 21:00:40.438996 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.438980    2555 scope.go:117] "RemoveContainer" containerID="698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d"
Sep 09 21:00:40.439287 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:40.439271    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d\": container with ID starting with 698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d not found: ID does not exist" containerID="698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d"
Sep 09 21:00:40.439328 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.439297    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d"} err="failed to get container status \"698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d\": rpc error: code = NotFound desc = could not find container \"698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d\": container with ID starting with 698bac5d23b2a3c830883b7f9d039099a63012fabba18af74bd754d5f0b95f1d not found: ID does not exist"
Sep 09 21:00:40.439987 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:40.439965    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-cbbc1a\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="141dc376-d701-41c7-956b-05fcd8900090" pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:40.453120 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.453101    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-8765e1"
Sep 09 21:00:40.730225 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:40.730201    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7537-8765e1"]
Sep 09 21:00:40.731675 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:00:40.731649    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc02ff399_9179_4126_bddf_c73867acfa9f.slice/crio-a7c1efa4d6a0badcd01d51d6f4b0279d9cc4eb75cc10e715929c33b41f094b8b WatchSource:0}: Error finding container a7c1efa4d6a0badcd01d51d6f4b0279d9cc4eb75cc10e715929c33b41f094b8b: Status 404 returned error can't find the container with id a7c1efa4d6a0badcd01d51d6f4b0279d9cc4eb75cc10e715929c33b41f094b8b
Sep 09 21:00:41.432566 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:41.432517    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-cbbc1a\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="141dc376-d701-41c7-956b-05fcd8900090" pod="opendatahub/test-curl-7537-cbbc1a"
Sep 09 21:00:41.434630 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:41.434602    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="141dc376-d701-41c7-956b-05fcd8900090" path="/var/lib/kubelet/pods/141dc376-d701-41c7-956b-05fcd8900090/volumes"
Sep 09 21:00:41.440832 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:41.440802    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7537-8765e1" event={"ID":"c02ff399-9179-4126-bddf-c73867acfa9f","Type":"ContainerStarted","Data":"dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd"}
Sep 09 21:00:41.440966 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:41.440851    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7537-8765e1" event={"ID":"c02ff399-9179-4126-bddf-c73867acfa9f","Type":"ContainerStarted","Data":"a7c1efa4d6a0badcd01d51d6f4b0279d9cc4eb75cc10e715929c33b41f094b8b"}
Sep 09 21:00:41.441963 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:41.441933    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7537-058859" podUID="2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a" containerName="test-curl-7537-058859" containerID="cri-o://162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232" gracePeriod=2
Sep 09 21:00:41.458597 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:41.458544    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7537-8765e1" podStartSLOduration=1.45852713 podStartE2EDuration="1.45852713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:41.45763444 +0000 UTC m=+1200.514171592" watchObservedRunningTime="2026-09-09 21:00:41.45852713 +0000 UTC m=+1200.515064272"
Sep 09 21:00:41.588926 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:41.588888    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:41.591127 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:41.591106    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-53d529\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="45fe549c-fc67-4d91-8f15-c986cc8036ca" pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:41.728019 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:41.727924    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgmwj\" (UniqueName: \"kubernetes.io/projected/45fe549c-fc67-4d91-8f15-c986cc8036ca-kube-api-access-sgmwj\") pod \"45fe549c-fc67-4d91-8f15-c986cc8036ca\" (UID: \"45fe549c-fc67-4d91-8f15-c986cc8036ca\") "
Sep 09 21:00:41.730334 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:41.730305    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45fe549c-fc67-4d91-8f15-c986cc8036ca-kube-api-access-sgmwj" (OuterVolumeSpecName: "kube-api-access-sgmwj") pod "45fe549c-fc67-4d91-8f15-c986cc8036ca" (UID: "45fe549c-fc67-4d91-8f15-c986cc8036ca"). InnerVolumeSpecName "kube-api-access-sgmwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:41.829014 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:41.828993    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgmwj\" (UniqueName: \"kubernetes.io/projected/45fe549c-fc67-4d91-8f15-c986cc8036ca-kube-api-access-sgmwj\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:42.045778 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:42.045742    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7537-8765e1"]
Sep 09 21:00:42.048586 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:42.048556    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7537-8765e1"]
Sep 09 21:00:42.448966 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:42.448861    2555 generic.go:356] "Generic (PLEG): container finished" podID="45fe549c-fc67-4d91-8f15-c986cc8036ca" containerID="7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166" exitCode=137
Sep 09 21:00:42.448966 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:42.448928    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:42.448966 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:42.448946    2555 scope.go:117] "RemoveContainer" containerID="7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166"
Sep 09 21:00:42.449498 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:42.449399    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7537-8765e1" container="test-curl-7537-8765e1"
Sep 09 21:00:42.451250 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:42.451218    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-53d529\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="45fe549c-fc67-4d91-8f15-c986cc8036ca" pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:42.459157 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:42.459138    2555 scope.go:117] "RemoveContainer" containerID="7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166"
Sep 09 21:00:42.459455 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:42.459437    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166\": container with ID starting with 7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166 not found: ID does not exist" containerID="7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166"
Sep 09 21:00:42.459520 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:42.459465    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166"} err="failed to get container status \"7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166\": rpc error: code = NotFound desc = could not find container \"7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166\": container with ID starting with 7b8612489b4fb7f21b3412f33f15fbe53235bb1d870a9a91bdb48ff14ed20166 not found: ID does not exist"
Sep 09 21:00:42.459659 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:42.459639    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-53d529\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="45fe549c-fc67-4d91-8f15-c986cc8036ca" pod="opendatahub/test-curl-7537-53d529"
Sep 09 21:00:43.431973 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:43.431938    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45fe549c-fc67-4d91-8f15-c986cc8036ca" path="/var/lib/kubelet/pods/45fe549c-fc67-4d91-8f15-c986cc8036ca/volumes"
Sep 09 21:00:43.456288 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:43.456215    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7537-8765e1" podUID="c02ff399-9179-4126-bddf-c73867acfa9f" containerName="test-curl-7537-8765e1" containerID="cri-o://dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd" gracePeriod=2
Sep 09 21:00:43.622704 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:43.622679    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-058859"
Sep 09 21:00:43.746828 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:43.746728    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd77h\" (UniqueName: \"kubernetes.io/projected/2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a-kube-api-access-qd77h\") pod \"2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a\" (UID: \"2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a\") "
Sep 09 21:00:43.748969 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:43.748939    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a-kube-api-access-qd77h" (OuterVolumeSpecName: "kube-api-access-qd77h") pod "2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a" (UID: "2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a"). InnerVolumeSpecName "kube-api-access-qd77h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:43.847923 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:43.847863    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd77h\" (UniqueName: \"kubernetes.io/projected/2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a-kube-api-access-qd77h\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:44.463518 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:44.463483    2555 generic.go:356] "Generic (PLEG): container finished" podID="2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a" containerID="162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232" exitCode=137
Sep 09 21:00:44.463971 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:44.463521    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-058859"
Sep 09 21:00:44.463971 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:44.463578    2555 scope.go:117] "RemoveContainer" containerID="162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232"
Sep 09 21:00:44.473203 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:44.473185    2555 scope.go:117] "RemoveContainer" containerID="162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232"
Sep 09 21:00:44.473493 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:44.473476    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232\": container with ID starting with 162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232 not found: ID does not exist" containerID="162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232"
Sep 09 21:00:44.473541 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:44.473501    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232"} err="failed to get container status \"162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232\": rpc error: code = NotFound desc = could not find container \"162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232\": container with ID starting with 162d3559905a7f981bf78ff045e87d931ac98e4de3bb7259eb93f59ea4088232 not found: ID does not exist"
Sep 09 21:00:44.473856 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:44.473815    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-058859\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a" pod="opendatahub/test-curl-7537-058859"
Sep 09 21:00:45.431722 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:45.431694    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a" path="/var/lib/kubelet/pods/2b00e7d0-b1c9-44ef-a35f-16fd4d65d86a/volumes"
Sep 09 21:00:45.650910 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:45.650867    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-8765e1"
Sep 09 21:00:45.768107 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:45.768014    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7lgw\" (UniqueName: \"kubernetes.io/projected/c02ff399-9179-4126-bddf-c73867acfa9f-kube-api-access-k7lgw\") pod \"c02ff399-9179-4126-bddf-c73867acfa9f\" (UID: \"c02ff399-9179-4126-bddf-c73867acfa9f\") "
Sep 09 21:00:45.770154 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:45.770131    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c02ff399-9179-4126-bddf-c73867acfa9f-kube-api-access-k7lgw" (OuterVolumeSpecName: "kube-api-access-k7lgw") pod "c02ff399-9179-4126-bddf-c73867acfa9f" (UID: "c02ff399-9179-4126-bddf-c73867acfa9f"). InnerVolumeSpecName "kube-api-access-k7lgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:45.869532 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:45.869501    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7lgw\" (UniqueName: \"kubernetes.io/projected/c02ff399-9179-4126-bddf-c73867acfa9f-kube-api-access-k7lgw\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:46.478525 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.478490    2555 generic.go:356] "Generic (PLEG): container finished" podID="c02ff399-9179-4126-bddf-c73867acfa9f" containerID="dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd" exitCode=137
Sep 09 21:00:46.478670 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.478534    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7537-8765e1"
Sep 09 21:00:46.478670 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.478596    2555 scope.go:117] "RemoveContainer" containerID="dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd"
Sep 09 21:00:46.488712 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.488692    2555 scope.go:117] "RemoveContainer" containerID="dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd"
Sep 09 21:00:46.489032 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:46.489010    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd\": container with ID starting with dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd not found: ID does not exist" containerID="dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd"
Sep 09 21:00:46.489125 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.489042    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd"} err="failed to get container status \"dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd\": rpc error: code = NotFound desc = could not find container \"dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd\": container with ID starting with dd0ee51f84a3cbbbb99fdedb2170103f9fc94ae83d3a5a14517d3a619367f5bd not found: ID does not exist"
Sep 09 21:00:46.489347 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:46.489330    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-8765e1\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="c02ff399-9179-4126-bddf-c73867acfa9f" pod="opendatahub/test-curl-7537-8765e1"
Sep 09 21:00:46.714417 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.714385    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"]
Sep 09 21:00:46.715015 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.714995    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c02ff399-9179-4126-bddf-c73867acfa9f" containerName="test-curl-7537-8765e1"
Sep 09 21:00:46.715015 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.715015    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c02ff399-9179-4126-bddf-c73867acfa9f" containerName="test-curl-7537-8765e1"
Sep 09 21:00:46.715190 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.715141    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c02ff399-9179-4126-bddf-c73867acfa9f" containerName="test-curl-7537-8765e1"
Sep 09 21:00:46.719734 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.719704    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.722772 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.722745    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-12f2a92f-serving-cert\""
Sep 09 21:00:46.734714 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.734644    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"]
Sep 09 21:00:46.758266 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:46.758231    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7537-8765e1\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="c02ff399-9179-4126-bddf-c73867acfa9f" pod="opendatahub/test-curl-7537-8765e1"
Sep 09 21:00:46.778952 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.778922    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-maas-api-tls\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.779096 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.779057    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-metrics-certs\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.779145 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.779100    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6ws7\" (UniqueName: \"kubernetes.io/projected/b1278698-1590-4762-9431-3f6fef81b182-kube-api-access-p6ws7\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.779145 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.779132    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1278698-1590-4762-9431-3f6fef81b182-openshift-service-ca\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.880481 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.880444    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6ws7\" (UniqueName: \"kubernetes.io/projected/b1278698-1590-4762-9431-3f6fef81b182-kube-api-access-p6ws7\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.880669 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.880488    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1278698-1590-4762-9431-3f6fef81b182-openshift-service-ca\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.880669 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.880530    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-maas-api-tls\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.880669 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.880649    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-metrics-certs\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.880837 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:46.880720    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-serving-cert: secret "maas-api-e2e-mt-12f2a92f-serving-cert" not found
Sep 09 21:00:46.880837 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:00:46.880800    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-maas-api-tls podName:b1278698-1590-4762-9431-3f6fef81b182 nodeName:}" failed. No retries permitted until 2026-09-09 21:00:47.380785923 +0000 UTC m=+1206.437323042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-maas-api-tls") pod "maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px" (UID: "b1278698-1590-4762-9431-3f6fef81b182") : secret "maas-api-e2e-mt-12f2a92f-serving-cert" not found
Sep 09 21:00:46.881300 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.881279    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1278698-1590-4762-9431-3f6fef81b182-openshift-service-ca\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.883180 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.883161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-metrics-certs\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:46.890121 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:46.890101    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6ws7\" (UniqueName: \"kubernetes.io/projected/b1278698-1590-4762-9431-3f6fef81b182-kube-api-access-p6ws7\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:47.385278 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:47.385241    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-maas-api-tls\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:47.387721 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:47.387695    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-maas-api-tls\") pod \"maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:47.432351 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:47.432321    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c02ff399-9179-4126-bddf-c73867acfa9f" path="/var/lib/kubelet/pods/c02ff399-9179-4126-bddf-c73867acfa9f/volumes"
Sep 09 21:00:47.633622 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:47.633589    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:47.913257 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:47.913231    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"]
Sep 09 21:00:47.914745 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:00:47.914710    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1278698_1590_4762_9431_3f6fef81b182.slice/crio-ab9575a8b9d103bf02ba197dca32647af9d80dcc6d1231713d54495373510620 WatchSource:0}: Error finding container ab9575a8b9d103bf02ba197dca32647af9d80dcc6d1231713d54495373510620: Status 404 returned error can't find the container with id ab9575a8b9d103bf02ba197dca32647af9d80dcc6d1231713d54495373510620
Sep 09 21:00:48.501301 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:48.501267    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px" event={"ID":"b1278698-1590-4762-9431-3f6fef81b182","Type":"ContainerStarted","Data":"ab9575a8b9d103bf02ba197dca32647af9d80dcc6d1231713d54495373510620"}
Sep 09 21:00:49.509350 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:49.509316    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px" event={"ID":"b1278698-1590-4762-9431-3f6fef81b182","Type":"ContainerStarted","Data":"cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837"}
Sep 09 21:00:49.509753 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:49.509512    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:00:49.579474 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:49.579425    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px" podStartSLOduration=2.998688805 podStartE2EDuration="3.579410072s" totalImagesPullingTime="580.721267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:49.577396214 +0000 UTC m=+1208.633933355" watchObservedRunningTime="2026-09-09 21:00:49.579410072 +0000 UTC m=+1208.635947214"
Sep 09 21:00:50.272759 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.272726    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"]
Sep 09 21:00:50.273041 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.273011    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls" podUID="2cd71a15-d6f9-44b4-b472-e6ae7a494092" containerName="maas-api" containerID="cri-o://ca72b66a9b2f60b3a5cec852edc33d8b97e1900d8a20fce0a81831e4fbcc6f7b" gracePeriod=30
Sep 09 21:00:50.335584 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.335552    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"]
Sep 09 21:00:50.335774 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.335747    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d" podUID="ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c" containerName="payload-processing" containerID="cri-o://d0275fca0f381dc31bec77210505747280b85c3553bc14b1715bd7a9387e41f1" gracePeriod=30
Sep 09 21:00:50.520050 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.519881    2555 generic.go:356] "Generic (PLEG): container finished" podID="2cd71a15-d6f9-44b4-b472-e6ae7a494092" containerID="ca72b66a9b2f60b3a5cec852edc33d8b97e1900d8a20fce0a81831e4fbcc6f7b" exitCode=0
Sep 09 21:00:50.520050 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.519936    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls" event={"ID":"2cd71a15-d6f9-44b4-b472-e6ae7a494092","Type":"ContainerDied","Data":"ca72b66a9b2f60b3a5cec852edc33d8b97e1900d8a20fce0a81831e4fbcc6f7b"}
Sep 09 21:00:50.521951 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.521871    2555 generic.go:356] "Generic (PLEG): container finished" podID="ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c" containerID="d0275fca0f381dc31bec77210505747280b85c3553bc14b1715bd7a9387e41f1" exitCode=0
Sep 09 21:00:50.521951 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.521936    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d" event={"ID":"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c","Type":"ContainerDied","Data":"d0275fca0f381dc31bec77210505747280b85c3553bc14b1715bd7a9387e41f1"}
Sep 09 21:00:50.607073 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.607048    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 21:00:50.630062 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.630041    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 21:00:50.720688 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.720656    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-maas-api-tls\") pod \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") "
Sep 09 21:00:50.720688 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.720689    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-metrics-certs\") pod \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") "
Sep 09 21:00:50.720922 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.720712    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st7xk\" (UniqueName: \"kubernetes.io/projected/2cd71a15-d6f9-44b4-b472-e6ae7a494092-kube-api-access-st7xk\") pod \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") "
Sep 09 21:00:50.720922 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.720752    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-kube-api-access-hldwq\") pod \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\" (UID: \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\") "
Sep 09 21:00:50.720922 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.720774    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-plugins-config-volume\") pod \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\" (UID: \"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c\") "
Sep 09 21:00:50.720922 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.720801    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd71a15-d6f9-44b4-b472-e6ae7a494092-openshift-service-ca\") pod \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\" (UID: \"2cd71a15-d6f9-44b4-b472-e6ae7a494092\") "
Sep 09 21:00:50.721220 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.721192    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c" (UID: "ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:00:50.721340 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.721288    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cd71a15-d6f9-44b4-b472-e6ae7a494092-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2cd71a15-d6f9-44b4-b472-e6ae7a494092" (UID: "2cd71a15-d6f9-44b4-b472-e6ae7a494092"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:00:50.723044 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.723020    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2cd71a15-d6f9-44b4-b472-e6ae7a494092" (UID: "2cd71a15-d6f9-44b4-b472-e6ae7a494092"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:00:50.723129 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.723084    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cd71a15-d6f9-44b4-b472-e6ae7a494092-kube-api-access-st7xk" (OuterVolumeSpecName: "kube-api-access-st7xk") pod "2cd71a15-d6f9-44b4-b472-e6ae7a494092" (UID: "2cd71a15-d6f9-44b4-b472-e6ae7a494092"). InnerVolumeSpecName "kube-api-access-st7xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:50.723388 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.723367    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2cd71a15-d6f9-44b4-b472-e6ae7a494092" (UID: "2cd71a15-d6f9-44b4-b472-e6ae7a494092"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:00:50.723453 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.723369    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-kube-api-access-hldwq" (OuterVolumeSpecName: "kube-api-access-hldwq") pod "ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c" (UID: "ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c"). InnerVolumeSpecName "kube-api-access-hldwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:50.822154 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.822066    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-kube-api-access-hldwq\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:50.822154 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.822094    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c-plugins-config-volume\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:50.822154 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.822104    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd71a15-d6f9-44b4-b472-e6ae7a494092-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:50.822154 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.822116    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:50.822154 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.822124    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cd71a15-d6f9-44b4-b472-e6ae7a494092-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:50.822154 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:50.822131    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st7xk\" (UniqueName: \"kubernetes.io/projected/2cd71a15-d6f9-44b4-b472-e6ae7a494092-kube-api-access-st7xk\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:00:51.529238 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.529192    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"
Sep 09 21:00:51.529706 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.529235    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d" event={"ID":"ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c","Type":"ContainerDied","Data":"f4be0b60ef0420e039805c3853d1237670684befa27348a65bc629a361306fb9"}
Sep 09 21:00:51.529706 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.529297    2555 scope.go:117] "RemoveContainer" containerID="d0275fca0f381dc31bec77210505747280b85c3553bc14b1715bd7a9387e41f1"
Sep 09 21:00:51.530975 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.530953    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"
Sep 09 21:00:51.531075 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.530948    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls" event={"ID":"2cd71a15-d6f9-44b4-b472-e6ae7a494092","Type":"ContainerDied","Data":"3a12e48ef4a3e93f63a57ba12680cffb4ab9ba1a0ba650afcdef2a959384a913"}
Sep 09 21:00:51.539409 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.539394    2555 scope.go:117] "RemoveContainer" containerID="ca72b66a9b2f60b3a5cec852edc33d8b97e1900d8a20fce0a81831e4fbcc6f7b"
Sep 09 21:00:51.554022 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.553993    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"]
Sep 09 21:00:51.556648 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.556620    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d"]
Sep 09 21:00:51.569217 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.569191    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"]
Sep 09 21:00:51.580628 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:51.580600    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-423e6a-55bb6c865f-lsgls"]
Sep 09 21:00:53.431253 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:53.431215    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cd71a15-d6f9-44b4-b472-e6ae7a494092" path="/var/lib/kubelet/pods/2cd71a15-d6f9-44b4-b472-e6ae7a494092/volumes"
Sep 09 21:00:53.431626 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:53.431590    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c" path="/var/lib/kubelet/pods/ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c/volumes"
Sep 09 21:00:55.528103 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:00:55.528077    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:01:02.005990 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.005943    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"]
Sep 09 21:01:02.008539 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.006512    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd71a15-d6f9-44b4-b472-e6ae7a494092" containerName="maas-api"
Sep 09 21:01:02.008539 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.006527    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd71a15-d6f9-44b4-b472-e6ae7a494092" containerName="maas-api"
Sep 09 21:01:02.008539 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.006539    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c" containerName="payload-processing"
Sep 09 21:01:02.008539 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.006545    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c" containerName="payload-processing"
Sep 09 21:01:02.008539 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.006622    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea5e5b2b-9fdc-4638-94f5-b50425cf2b2c" containerName="payload-processing"
Sep 09 21:01:02.008539 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.006633    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd71a15-d6f9-44b4-b472-e6ae7a494092" containerName="maas-api"
Sep 09 21:01:02.009683 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.009660    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.012183 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.012159    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-615c6f-serving-cert\""
Sep 09 21:01:02.031289 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.031234    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"]
Sep 09 21:01:02.032272 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.032225    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.032581 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.032548    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.032778 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.032755    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39762fa-569b-4954-b6b2-281e9e686ee9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.032944 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.032885    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtvf8\" (UniqueName: \"kubernetes.io/projected/a39762fa-569b-4954-b6b2-281e9e686ee9-kube-api-access-rtvf8\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.134553 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.134516    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.134761 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.134619    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.134761 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.134710    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39762fa-569b-4954-b6b2-281e9e686ee9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.134761 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.134736    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtvf8\" (UniqueName: \"kubernetes.io/projected/a39762fa-569b-4954-b6b2-281e9e686ee9-kube-api-access-rtvf8\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.136125 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.136099    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39762fa-569b-4954-b6b2-281e9e686ee9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.137547 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.137521    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.137732 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.137713    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.143995 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.143967    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtvf8\" (UniqueName: \"kubernetes.io/projected/a39762fa-569b-4954-b6b2-281e9e686ee9-kube-api-access-rtvf8\") pod \"maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.326635 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.326601    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:02.611770 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:02.611744    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"]
Sep 09 21:01:02.613750 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:01:02.613719    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39762fa_569b_4954_b6b2_281e9e686ee9.slice/crio-13f6fda6fe47d432743dc0bb61d29a289f5ded424cc03854ff6d49486a12845c WatchSource:0}: Error finding container 13f6fda6fe47d432743dc0bb61d29a289f5ded424cc03854ff6d49486a12845c: Status 404 returned error can't find the container with id 13f6fda6fe47d432743dc0bb61d29a289f5ded424cc03854ff6d49486a12845c
Sep 09 21:01:03.611113 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:03.611077    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt" event={"ID":"a39762fa-569b-4954-b6b2-281e9e686ee9","Type":"ContainerStarted","Data":"be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0"}
Sep 09 21:01:03.611595 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:03.611126    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt" event={"ID":"a39762fa-569b-4954-b6b2-281e9e686ee9","Type":"ContainerStarted","Data":"13f6fda6fe47d432743dc0bb61d29a289f5ded424cc03854ff6d49486a12845c"}
Sep 09 21:01:03.611595 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:03.611286    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:03.630266 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:03.630201    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt" podStartSLOduration=2.052109298 podStartE2EDuration="2.630180231s" totalImagesPullingTime="578.070933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:03.627489174 +0000 UTC m=+1222.684026343" watchObservedRunningTime="2026-09-09 21:01:03.630180231 +0000 UTC m=+1222.686717373"
Sep 09 21:01:09.623169 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:09.623140    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:01:30.849171 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:30.849132    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"]
Sep 09 21:01:30.854645 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:30.853924    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:30.857221 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:30.857193    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-0b5d4c-serving-cert\""
Sep 09 21:01:30.866077 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:30.866047    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"]
Sep 09 21:01:31.022823 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.022790    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.023025 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.022856    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.023025 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.022932    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.023025 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.022966    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9qft\" (UniqueName: \"kubernetes.io/projected/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-kube-api-access-d9qft\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.124239 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.124155    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.124239 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.124215    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.124430 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.124268    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.124430 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.124307    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9qft\" (UniqueName: \"kubernetes.io/projected/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-kube-api-access-d9qft\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.124838 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.124816    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.126963 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.126930    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.127084 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.126976    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.133713 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.133689    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9qft\" (UniqueName: \"kubernetes.io/projected/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-kube-api-access-d9qft\") pod \"maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.168792 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.168753    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:31.463569 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.463539    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"]
Sep 09 21:01:31.466376 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:01:31.466341    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d619ae_758d_469a_91f6_d5ee92bf5e4f.slice/crio-71edf346b49959bf43d78ef0546cf6b178b74714b8c413dc8dd72839f6120d45 WatchSource:0}: Error finding container 71edf346b49959bf43d78ef0546cf6b178b74714b8c413dc8dd72839f6120d45: Status 404 returned error can't find the container with id 71edf346b49959bf43d78ef0546cf6b178b74714b8c413dc8dd72839f6120d45
Sep 09 21:01:31.794099 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:31.794062    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j" event={"ID":"c8d619ae-758d-469a-91f6-d5ee92bf5e4f","Type":"ContainerStarted","Data":"71edf346b49959bf43d78ef0546cf6b178b74714b8c413dc8dd72839f6120d45"}
Sep 09 21:01:32.801887 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:32.801850    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j" event={"ID":"c8d619ae-758d-469a-91f6-d5ee92bf5e4f","Type":"ContainerStarted","Data":"71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642"}
Sep 09 21:01:32.802315 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:32.801975    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:32.846098 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:32.846037    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j" podStartSLOduration=2.288281288 podStartE2EDuration="2.846018326s" totalImagesPullingTime="557.737038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:32.8415274 +0000 UTC m=+1251.898064539" watchObservedRunningTime="2026-09-09 21:01:32.846018326 +0000 UTC m=+1251.902555468"
Sep 09 21:01:38.814573 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:38.814543    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:01:41.557977 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:01:41.557939    2555 scope.go:117] "RemoveContainer" containerID="a5183ed3ce1ce6603f85d33fd97e60fa2773dd1314bd94fea4769f1494846a4f"
Sep 09 21:02:12.185336 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.185300    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"]
Sep 09 21:02:12.189752 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.189732    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.193583 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.193542    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-47e41c\"/\"kube-root-ca.crt\""
Sep 09 21:02:12.193583 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.193562    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-47e41c\"/\"unconfigured-w4-47e41c-kserve-self-signed-certs\""
Sep 09 21:02:12.193856 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.193556    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-47e41c\"/\"openshift-service-ca.crt\""
Sep 09 21:02:12.193991 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.193880    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-47e41c\"/\"default-dockercfg-cbzth\""
Sep 09 21:02:12.198010 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.197943    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"]
Sep 09 21:02:12.323858 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.323822    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-dshm\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.323858 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.323857    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-tmp-dir\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.324092 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.323882    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-model-cache\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.324092 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.324017    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t88g4\" (UniqueName: \"kubernetes.io/projected/bd096f77-d445-412e-aa61-b9130963203d-kube-api-access-t88g4\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.324092 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.324048    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd096f77-d445-412e-aa61-b9130963203d-tls-certs\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.324092 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.324068    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-home\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.424840 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.424803    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-dshm\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.424840 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.424839    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-tmp-dir\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.425120 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.424860    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-model-cache\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.425120 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.424935    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88g4\" (UniqueName: \"kubernetes.io/projected/bd096f77-d445-412e-aa61-b9130963203d-kube-api-access-t88g4\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.425120 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.424964    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd096f77-d445-412e-aa61-b9130963203d-tls-certs\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.425120 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.424985    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-home\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.425347 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.425330    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-model-cache\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.425401 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.425364    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-tmp-dir\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.425401 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.425384    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-home\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.427278 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.427255    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-dshm\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.427638 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.427619    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd096f77-d445-412e-aa61-b9130963203d-tls-certs\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.434858 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.434834    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88g4\" (UniqueName: \"kubernetes.io/projected/bd096f77-d445-412e-aa61-b9130963203d-kube-api-access-t88g4\") pod \"unconfigured-w4-47e41c-kserve-787f44687b-4mlb6\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") " pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.500405 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.500316    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:12.779513 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:12.779482    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"]
Sep 09 21:02:12.781106 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:02:12.781076    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd096f77_d445_412e_aa61_b9130963203d.slice/crio-234b81c7329764d4d391e2683ca0cf3e7a505354b5faad9807fa4229c79a1f4f WatchSource:0}: Error finding container 234b81c7329764d4d391e2683ca0cf3e7a505354b5faad9807fa4229c79a1f4f: Status 404 returned error can't find the container with id 234b81c7329764d4d391e2683ca0cf3e7a505354b5faad9807fa4229c79a1f4f
Sep 09 21:02:13.043316 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:13.043283    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6" event={"ID":"bd096f77-d445-412e-aa61-b9130963203d","Type":"ContainerStarted","Data":"466e9559c47e418b015533e5dbda46ba564559d8fa4938a9762766c0ec2572d8"}
Sep 09 21:02:13.043479 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:13.043332    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6" event={"ID":"bd096f77-d445-412e-aa61-b9130963203d","Type":"ContainerStarted","Data":"234b81c7329764d4d391e2683ca0cf3e7a505354b5faad9807fa4229c79a1f4f"}
Sep 09 21:02:13.060249 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:13.060195    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6" podStartSLOduration=1.060173677 podStartE2EDuration="1.060173677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:13.059554477 +0000 UTC m=+1292.116091621" watchObservedRunningTime="2026-09-09 21:02:13.060173677 +0000 UTC m=+1292.116710819"
Sep 09 21:02:22.500982 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:22.500941    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:22.501389 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:22.501039    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:22.513638 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:22.513613    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:23.116821 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:23.116787    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:02:54.316920 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.316863    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"]
Sep 09 21:02:54.321280 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.321256    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.325164 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.325140    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-615c6f\"/\"auth-test-model-615c6f-kserve-self-signed-certs\""
Sep 09 21:02:54.325301 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.325143    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-615c6f\"/\"default-dockercfg-gnj27\""
Sep 09 21:02:54.325301 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.325175    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-615c6f\"/\"kube-root-ca.crt\""
Sep 09 21:02:54.325301 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.325199    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-615c6f\"/\"openshift-service-ca.crt\""
Sep 09 21:02:54.391982 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.391953    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"]
Sep 09 21:02:54.427963 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.427921    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-home\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.428120 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.427968    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmn9\" (UniqueName: \"kubernetes.io/projected/4711feb8-7fe5-4011-adf3-158cb927e57d-kube-api-access-mpmn9\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.428120 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.428038    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-dshm\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.428120 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.428088    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-tmp-dir\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.428120 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.428104    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-model-cache\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.428258 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.428122    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4711feb8-7fe5-4011-adf3-158cb927e57d-tls-certs\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.529635 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.529598    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-home\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.529815 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.529643    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmn9\" (UniqueName: \"kubernetes.io/projected/4711feb8-7fe5-4011-adf3-158cb927e57d-kube-api-access-mpmn9\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.529815 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.529679    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-dshm\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.529815 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.529706    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-tmp-dir\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.529815 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.529721    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-model-cache\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.529815 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.529739    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4711feb8-7fe5-4011-adf3-158cb927e57d-tls-certs\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.530146 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.530114    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-home\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.530221 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.530195    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-tmp-dir\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.530269 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.530235    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-model-cache\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.532228 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.532206    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-dshm\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.532465 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.532448    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4711feb8-7fe5-4011-adf3-158cb927e57d-tls-certs\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.550678 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.550648    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmn9\" (UniqueName: \"kubernetes.io/projected/4711feb8-7fe5-4011-adf3-158cb927e57d-kube-api-access-mpmn9\") pod \"auth-test-model-615c6f-kserve-6944b77f67-g2t22\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") " pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.631012 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.630921    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:02:54.940300 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:54.940207    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"]
Sep 09 21:02:54.948771 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:02:54.948746    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4711feb8_7fe5_4011_adf3_158cb927e57d.slice/crio-7aa06ccb768d23e9c23f755112d294a972617fd62731037d55455a3e760ed6ca WatchSource:0}: Error finding container 7aa06ccb768d23e9c23f755112d294a972617fd62731037d55455a3e760ed6ca: Status 404 returned error can't find the container with id 7aa06ccb768d23e9c23f755112d294a972617fd62731037d55455a3e760ed6ca
Sep 09 21:02:55.310593 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:55.310559    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22" event={"ID":"4711feb8-7fe5-4011-adf3-158cb927e57d","Type":"ContainerStarted","Data":"b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b"}
Sep 09 21:02:55.310801 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:02:55.310602    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22" event={"ID":"4711feb8-7fe5-4011-adf3-158cb927e57d","Type":"ContainerStarted","Data":"7aa06ccb768d23e9c23f755112d294a972617fd62731037d55455a3e760ed6ca"}
Sep 09 21:03:04.631947 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:03:04.631850    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:03:04.632388 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:03:04.631997    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:03:04.644883 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:03:04.644857    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:03:04.667147 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:03:04.667096    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22" podStartSLOduration=10.66708083 podStartE2EDuration="10.66708083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:55.338652517 +0000 UTC m=+1334.395189659" watchObservedRunningTime="2026-09-09 21:03:04.66708083 +0000 UTC m=+1343.723617973"
Sep 09 21:03:05.388942 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:03:05.388891    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:04:04.739975 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:04.739938    2555 generic.go:356] "Generic (PLEG): container finished" podID="8dc81062-339d-4efd-9d78-bb38fa422930" containerID="913ae2aa4dce5f595d6fbea6853c157f2b6e9a44c6f09349e65b07bba12301e2" exitCode=137
Sep 09 21:04:04.740380 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:04.740020    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" event={"ID":"8dc81062-339d-4efd-9d78-bb38fa422930","Type":"ContainerDied","Data":"913ae2aa4dce5f595d6fbea6853c157f2b6e9a44c6f09349e65b07bba12301e2"}
Sep 09 21:04:04.740380 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:04.740353    2555 scope.go:117] "RemoveContainer" containerID="913ae2aa4dce5f595d6fbea6853c157f2b6e9a44c6f09349e65b07bba12301e2"
Sep 09 21:04:05.751130 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:05.751099    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" event={"ID":"8dc81062-339d-4efd-9d78-bb38fa422930","Type":"ContainerStarted","Data":"201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5"}
Sep 09 21:04:05.751667 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:05.751306    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 21:04:10.083349 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.083316    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"]
Sep 09 21:04:10.088983 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.087844    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.092682 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.092660    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-47e41c\"/\"embedding-w4-47e41c-kserve-self-signed-certs\""
Sep 09 21:04:10.097364 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.097322    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"]
Sep 09 21:04:10.194085 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.194055    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c7c1346-2781-4917-a52a-5769e7c7f889-tls-certs\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.194250 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.194137    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-tmp-dir\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.194250 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.194167    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-model-cache\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.194250 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.194199    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-dshm\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.194386 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.194283    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-home\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.194386 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.194307    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzsvq\" (UniqueName: \"kubernetes.io/projected/7c7c1346-2781-4917-a52a-5769e7c7f889-kube-api-access-zzsvq\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.295586 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.295550    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c7c1346-2781-4917-a52a-5769e7c7f889-tls-certs\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.295782 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.295604    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-tmp-dir\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.295782 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.295632    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-model-cache\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.295782 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.295673    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-dshm\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.295782 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.295753    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-home\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.296039 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.295788    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzsvq\" (UniqueName: \"kubernetes.io/projected/7c7c1346-2781-4917-a52a-5769e7c7f889-kube-api-access-zzsvq\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.296130 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.296103    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-tmp-dir\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.296265 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.296243    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-home\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.296350 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.296161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-model-cache\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.298036 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.298014    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-dshm\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.298303 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.298283    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c7c1346-2781-4917-a52a-5769e7c7f889-tls-certs\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.306969 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.306949    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzsvq\" (UniqueName: \"kubernetes.io/projected/7c7c1346-2781-4917-a52a-5769e7c7f889-kube-api-access-zzsvq\") pod \"embedding-w4-47e41c-kserve-646668ccfb-g92tv\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") " pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.402926 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.402828    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:10.677242 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.677207    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"]
Sep 09 21:04:10.678410 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:04:10.678382    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c7c1346_2781_4917_a52a_5769e7c7f889.slice/crio-ceddf31aaa0357df16bb7bc2b671872c1b4ae80701da515e213616a560bf068b WatchSource:0}: Error finding container ceddf31aaa0357df16bb7bc2b671872c1b4ae80701da515e213616a560bf068b: Status 404 returned error can't find the container with id ceddf31aaa0357df16bb7bc2b671872c1b4ae80701da515e213616a560bf068b
Sep 09 21:04:10.785775 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.785743    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv" event={"ID":"7c7c1346-2781-4917-a52a-5769e7c7f889","Type":"ContainerStarted","Data":"0cfade63f103b5b83ee9970ff7dc9137037eea4e99bbc6f22c102e449b7496b6"}
Sep 09 21:04:10.785965 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.785793    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv" event={"ID":"7c7c1346-2781-4917-a52a-5769e7c7f889","Type":"ContainerStarted","Data":"ceddf31aaa0357df16bb7bc2b671872c1b4ae80701da515e213616a560bf068b"}
Sep 09 21:04:10.804265 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:10.804214    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv" podStartSLOduration=0.804193742 podStartE2EDuration="804.193742ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:04:10.803848795 +0000 UTC m=+1409.860385938" watchObservedRunningTime="2026-09-09 21:04:10.804193742 +0000 UTC m=+1409.860730885"
Sep 09 21:04:16.760602 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:16.760570    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 21:04:19.334784 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.334749    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"]
Sep 09 21:04:19.335193 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.335070    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px" podUID="b1278698-1590-4762-9431-3f6fef81b182" containerName="maas-api" containerID="cri-o://cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837" gracePeriod=30
Sep 09 21:04:19.608188 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.608161    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:04:19.685960 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.685923    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-maas-api-tls\") pod \"b1278698-1590-4762-9431-3f6fef81b182\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") "
Sep 09 21:04:19.686138 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.685988    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1278698-1590-4762-9431-3f6fef81b182-openshift-service-ca\") pod \"b1278698-1590-4762-9431-3f6fef81b182\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") "
Sep 09 21:04:19.686138 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.686065    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6ws7\" (UniqueName: \"kubernetes.io/projected/b1278698-1590-4762-9431-3f6fef81b182-kube-api-access-p6ws7\") pod \"b1278698-1590-4762-9431-3f6fef81b182\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") "
Sep 09 21:04:19.686138 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.686130    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-metrics-certs\") pod \"b1278698-1590-4762-9431-3f6fef81b182\" (UID: \"b1278698-1590-4762-9431-3f6fef81b182\") "
Sep 09 21:04:19.686427 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.686385    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1278698-1590-4762-9431-3f6fef81b182-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1278698-1590-4762-9431-3f6fef81b182" (UID: "b1278698-1590-4762-9431-3f6fef81b182"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:04:19.686545 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.686516    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1278698-1590-4762-9431-3f6fef81b182-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:04:19.688191 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.688166    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1278698-1590-4762-9431-3f6fef81b182" (UID: "b1278698-1590-4762-9431-3f6fef81b182"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:04:19.688670 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.688645    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1278698-1590-4762-9431-3f6fef81b182-kube-api-access-p6ws7" (OuterVolumeSpecName: "kube-api-access-p6ws7") pod "b1278698-1590-4762-9431-3f6fef81b182" (UID: "b1278698-1590-4762-9431-3f6fef81b182"). InnerVolumeSpecName "kube-api-access-p6ws7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:04:19.688768 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.688645    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b1278698-1590-4762-9431-3f6fef81b182" (UID: "b1278698-1590-4762-9431-3f6fef81b182"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:04:19.787874 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.787800    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6ws7\" (UniqueName: \"kubernetes.io/projected/b1278698-1590-4762-9431-3f6fef81b182-kube-api-access-p6ws7\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:04:19.787874 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.787827    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:04:19.787874 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.787836    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1278698-1590-4762-9431-3f6fef81b182-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:04:19.845201 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.845167    2555 generic.go:356] "Generic (PLEG): container finished" podID="b1278698-1590-4762-9431-3f6fef81b182" containerID="cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837" exitCode=0
Sep 09 21:04:19.845373 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.845219    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"
Sep 09 21:04:19.845373 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.845265    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px" event={"ID":"b1278698-1590-4762-9431-3f6fef81b182","Type":"ContainerDied","Data":"cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837"}
Sep 09 21:04:19.845373 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.845346    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px" event={"ID":"b1278698-1590-4762-9431-3f6fef81b182","Type":"ContainerDied","Data":"ab9575a8b9d103bf02ba197dca32647af9d80dcc6d1231713d54495373510620"}
Sep 09 21:04:19.845373 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.845370    2555 scope.go:117] "RemoveContainer" containerID="cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837"
Sep 09 21:04:19.855772 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.855754    2555 scope.go:117] "RemoveContainer" containerID="cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837"
Sep 09 21:04:19.856109 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:04:19.856083    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837\": container with ID starting with cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837 not found: ID does not exist" containerID="cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837"
Sep 09 21:04:19.856170 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.856113    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837"} err="failed to get container status \"cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837\": rpc error: code = NotFound desc = could not find container \"cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837\": container with ID starting with cd7ce639948bfbcfc321a22b66b825606b8736c953d53d5fbdbeac768a185837 not found: ID does not exist"
Sep 09 21:04:19.869362 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.869340    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"]
Sep 09 21:04:19.875267 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:19.875242    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12f2a92f-54f876b9f4-sw5px"]
Sep 09 21:04:20.402978 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:20.402947    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:20.403423 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:20.403000    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:20.415488 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:20.415463    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:20.864015 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:20.863984    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:04:21.432034 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:04:21.432001    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1278698-1590-4762-9431-3f6fef81b182" path="/var/lib/kubelet/pods/b1278698-1590-4762-9431-3f6fef81b182/volumes"
Sep 09 21:05:45.380632 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:05:45.380592    2555 generic.go:356] "Generic (PLEG): container finished" podID="8dc81062-339d-4efd-9d78-bb38fa422930" containerID="201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5" exitCode=137
Sep 09 21:05:45.381161 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:05:45.380663    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" event={"ID":"8dc81062-339d-4efd-9d78-bb38fa422930","Type":"ContainerDied","Data":"201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5"}
Sep 09 21:05:45.381161 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:05:45.380720    2555 scope.go:117] "RemoveContainer" containerID="913ae2aa4dce5f595d6fbea6853c157f2b6e9a44c6f09349e65b07bba12301e2"
Sep 09 21:05:45.381161 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:05:45.381093    2555 scope.go:117] "RemoveContainer" containerID="201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5"
Sep 09 21:05:45.381377 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:05:45.381354    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-5769f99d9f-69mrp_kuadrant-system(8dc81062-339d-4efd-9d78-bb38fa422930)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" podUID="8dc81062-339d-4efd-9d78-bb38fa422930"
Sep 09 21:05:46.759059 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:05:46.759021    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 21:05:46.759496 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:05:46.759447    2555 scope.go:117] "RemoveContainer" containerID="201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5"
Sep 09 21:05:46.759641 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:05:46.759616    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-5769f99d9f-69mrp_kuadrant-system(8dc81062-339d-4efd-9d78-bb38fa422930)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" podUID="8dc81062-339d-4efd-9d78-bb38fa422930"
Sep 09 21:05:58.425843 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:05:58.425802    2555 scope.go:117] "RemoveContainer" containerID="201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5"
Sep 09 21:05:59.467968 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:05:59.467937    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" event={"ID":"8dc81062-339d-4efd-9d78-bb38fa422930","Type":"ContainerStarted","Data":"b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0"}
Sep 09 21:05:59.468470 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:05:59.468174    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 21:06:10.477468 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:10.477383    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 21:06:25.687210 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.687179    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"]
Sep 09 21:06:25.687650 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.687635    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1278698-1590-4762-9431-3f6fef81b182" containerName="maas-api"
Sep 09 21:06:25.687699 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.687652    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1278698-1590-4762-9431-3f6fef81b182" containerName="maas-api"
Sep 09 21:06:25.687755 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.687746    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1278698-1590-4762-9431-3f6fef81b182" containerName="maas-api"
Sep 09 21:06:25.691170 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.691146    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.694627 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.694607    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1e8973-serving-cert\""
Sep 09 21:06:25.703415 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.703112    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"]
Sep 09 21:06:25.773111 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.773076    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v976d\" (UniqueName: \"kubernetes.io/projected/0eb5001c-a6ce-4151-94ba-bd4ed9217649-kube-api-access-v976d\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.773304 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.773135    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-metrics-certs\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.773304 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.773284    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-maas-api-tls\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.773491 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.773353    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb5001c-a6ce-4151-94ba-bd4ed9217649-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.874247 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.874207    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v976d\" (UniqueName: \"kubernetes.io/projected/0eb5001c-a6ce-4151-94ba-bd4ed9217649-kube-api-access-v976d\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.874457 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.874272    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-metrics-certs\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.874457 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.874333    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-maas-api-tls\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.874457 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.874366    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb5001c-a6ce-4151-94ba-bd4ed9217649-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.875203 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.875172    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb5001c-a6ce-4151-94ba-bd4ed9217649-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.877031 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.877012    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-metrics-certs\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.877119 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.877027    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-maas-api-tls\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:25.883980 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:25.883957    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v976d\" (UniqueName: \"kubernetes.io/projected/0eb5001c-a6ce-4151-94ba-bd4ed9217649-kube-api-access-v976d\") pod \"maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:26.005251 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:26.005159    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:26.293656 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:26.293622    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"]
Sep 09 21:06:26.295516 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:06:26.295488    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb5001c_a6ce_4151_94ba_bd4ed9217649.slice/crio-568a76ea4a4d62dad7ffef8d2792e5db6c933776fe5433d0556211a691084159 WatchSource:0}: Error finding container 568a76ea4a4d62dad7ffef8d2792e5db6c933776fe5433d0556211a691084159: Status 404 returned error can't find the container with id 568a76ea4a4d62dad7ffef8d2792e5db6c933776fe5433d0556211a691084159
Sep 09 21:06:26.297534 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:26.297513    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:06:26.636781 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:26.636695    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd" event={"ID":"0eb5001c-a6ce-4151-94ba-bd4ed9217649","Type":"ContainerStarted","Data":"568a76ea4a4d62dad7ffef8d2792e5db6c933776fe5433d0556211a691084159"}
Sep 09 21:06:27.644521 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:27.644482    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd" event={"ID":"0eb5001c-a6ce-4151-94ba-bd4ed9217649","Type":"ContainerStarted","Data":"0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177"}
Sep 09 21:06:27.644885 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:27.644607    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:27.667135 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:27.667069    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd" podStartSLOduration=1.5372746579999998 podStartE2EDuration="2.667048926s" totalImagesPullingTime="1.129774268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:06:27.665037481 +0000 UTC m=+1546.721574620" watchObservedRunningTime="2026-09-09 21:06:27.667048926 +0000 UTC m=+1546.723586069"
Sep 09 21:06:33.656563 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:33.656532    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:06:50.214779 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:50.214741    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"]
Sep 09 21:06:50.219390 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:50.219365    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"]
Sep 09 21:06:54.799894 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.799857    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"]
Sep 09 21:06:54.804022 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.803995    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.807894 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.807874    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0622e2-serving-cert\""
Sep 09 21:06:54.821945 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.821889    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"]
Sep 09 21:06:54.860983 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.860936    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g9qd\" (UniqueName: \"kubernetes.io/projected/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-kube-api-access-8g9qd\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.861351 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.860993    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-metrics-certs\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.861351 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.861076    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-openshift-service-ca\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.861351 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.861188    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-maas-api-tls\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.962726 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.962691    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-maas-api-tls\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.962896 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.962790    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g9qd\" (UniqueName: \"kubernetes.io/projected/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-kube-api-access-8g9qd\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.962896 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.962822    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-metrics-certs\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.962896 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:06:54.962839    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-serving-cert: secret "maas-api-e2e-api-b-0622e2-serving-cert" not found
Sep 09 21:06:54.962896 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.962889    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-openshift-service-ca\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.963153 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:06:54.962938    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-maas-api-tls podName:0d9e3105-f2d0-4d5f-829e-ef30427e17cf nodeName:}" failed. No retries permitted until 2026-09-09 21:06:55.46289217 +0000 UTC m=+1574.519429291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-maas-api-tls") pod "maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9" (UID: "0d9e3105-f2d0-4d5f-829e-ef30427e17cf") : secret "maas-api-e2e-api-b-0622e2-serving-cert" not found
Sep 09 21:06:54.963566 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.963544    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-openshift-service-ca\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.965850 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.965827    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-metrics-certs\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:54.974486 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:54.974464    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g9qd\" (UniqueName: \"kubernetes.io/projected/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-kube-api-access-8g9qd\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:55.468686 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:55.468649    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-maas-api-tls\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:55.471331 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:55.471303    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-maas-api-tls\") pod \"maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:55.717520 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:55.717485    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:56.001846 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:56.001816    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"]
Sep 09 21:06:56.004532 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:06:56.004499    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9e3105_f2d0_4d5f_829e_ef30427e17cf.slice/crio-034489b165c511f731730cb6c24855f87acb0e89d7ff704c9440a3af6996fb0d WatchSource:0}: Error finding container 034489b165c511f731730cb6c24855f87acb0e89d7ff704c9440a3af6996fb0d: Status 404 returned error can't find the container with id 034489b165c511f731730cb6c24855f87acb0e89d7ff704c9440a3af6996fb0d
Sep 09 21:06:56.825668 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:56.825629    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9" event={"ID":"0d9e3105-f2d0-4d5f-829e-ef30427e17cf","Type":"ContainerStarted","Data":"1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559"}
Sep 09 21:06:56.825828 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:56.825722    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:06:56.825828 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:56.825745    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9" event={"ID":"0d9e3105-f2d0-4d5f-829e-ef30427e17cf","Type":"ContainerStarted","Data":"034489b165c511f731730cb6c24855f87acb0e89d7ff704c9440a3af6996fb0d"}
Sep 09 21:06:56.849830 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:06:56.849779    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9" podStartSLOduration=2.196809648 podStartE2EDuration="2.849765029s" totalImagesPullingTime="652.955381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:06:56.847203393 +0000 UTC m=+1575.903740537" watchObservedRunningTime="2026-09-09 21:06:56.849765029 +0000 UTC m=+1575.906302182"
Sep 09 21:07:01.029464 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.029431    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"]
Sep 09 21:07:01.029851 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.029629    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62" podUID="ee7caeeb-ae57-4e7b-aebc-96cd7789377f" containerName="maas-api" containerID="cri-o://b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef" gracePeriod=30
Sep 09 21:07:01.146818 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.146789    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"]
Sep 09 21:07:01.147054 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.147027    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx" podUID="787b4554-f547-47e3-8bbf-28a6c71013f6" containerName="payload-pre-processing" containerID="cri-o://f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac" gracePeriod=30
Sep 09 21:07:01.309084 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.309027    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 21:07:01.417801 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.417771    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 21:07:01.430568 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.430537    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf4h8\" (UniqueName: \"kubernetes.io/projected/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-kube-api-access-rf4h8\") pod \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") "
Sep 09 21:07:01.430737 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.430581    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-openshift-service-ca\") pod \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") "
Sep 09 21:07:01.430737 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.430630    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls\") pod \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") "
Sep 09 21:07:01.430737 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.430703    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-metrics-certs\") pod \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\" (UID: \"ee7caeeb-ae57-4e7b-aebc-96cd7789377f\") "
Sep 09 21:07:01.431269 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.431164    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ee7caeeb-ae57-4e7b-aebc-96cd7789377f" (UID: "ee7caeeb-ae57-4e7b-aebc-96cd7789377f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:07:01.433329 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.433302    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ee7caeeb-ae57-4e7b-aebc-96cd7789377f" (UID: "ee7caeeb-ae57-4e7b-aebc-96cd7789377f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:07:01.433581 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.433562    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ee7caeeb-ae57-4e7b-aebc-96cd7789377f" (UID: "ee7caeeb-ae57-4e7b-aebc-96cd7789377f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:07:01.433581 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.433570    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-kube-api-access-rf4h8" (OuterVolumeSpecName: "kube-api-access-rf4h8") pod "ee7caeeb-ae57-4e7b-aebc-96cd7789377f" (UID: "ee7caeeb-ae57-4e7b-aebc-96cd7789377f"). InnerVolumeSpecName "kube-api-access-rf4h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:07:01.532047 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.531951    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787b4554-f547-47e3-8bbf-28a6c71013f6-plugins-config-volume\") pod \"787b4554-f547-47e3-8bbf-28a6c71013f6\" (UID: \"787b4554-f547-47e3-8bbf-28a6c71013f6\") "
Sep 09 21:07:01.532047 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.532028    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nxnj\" (UniqueName: \"kubernetes.io/projected/787b4554-f547-47e3-8bbf-28a6c71013f6-kube-api-access-5nxnj\") pod \"787b4554-f547-47e3-8bbf-28a6c71013f6\" (UID: \"787b4554-f547-47e3-8bbf-28a6c71013f6\") "
Sep 09 21:07:01.532320 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.532250    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf4h8\" (UniqueName: \"kubernetes.io/projected/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-kube-api-access-rf4h8\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:01.532320 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.532261    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:01.532320 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.532270    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:01.532320 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.532278    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee7caeeb-ae57-4e7b-aebc-96cd7789377f-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:01.532505 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.532411    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/787b4554-f547-47e3-8bbf-28a6c71013f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "787b4554-f547-47e3-8bbf-28a6c71013f6" (UID: "787b4554-f547-47e3-8bbf-28a6c71013f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:07:01.534239 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.534218    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/787b4554-f547-47e3-8bbf-28a6c71013f6-kube-api-access-5nxnj" (OuterVolumeSpecName: "kube-api-access-5nxnj") pod "787b4554-f547-47e3-8bbf-28a6c71013f6" (UID: "787b4554-f547-47e3-8bbf-28a6c71013f6"). InnerVolumeSpecName "kube-api-access-5nxnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:07:01.633177 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.633138    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787b4554-f547-47e3-8bbf-28a6c71013f6-plugins-config-volume\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:01.633177 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.633170    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nxnj\" (UniqueName: \"kubernetes.io/projected/787b4554-f547-47e3-8bbf-28a6c71013f6-kube-api-access-5nxnj\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:01.858816 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.858773    2555 generic.go:356] "Generic (PLEG): container finished" podID="ee7caeeb-ae57-4e7b-aebc-96cd7789377f" containerID="b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef" exitCode=0
Sep 09 21:07:01.859047 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.858839    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"
Sep 09 21:07:01.859047 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.858830    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62" event={"ID":"ee7caeeb-ae57-4e7b-aebc-96cd7789377f","Type":"ContainerDied","Data":"b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef"}
Sep 09 21:07:01.859047 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.858961    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62" event={"ID":"ee7caeeb-ae57-4e7b-aebc-96cd7789377f","Type":"ContainerDied","Data":"39791db7003b1656c634deab535852cfeb42500c153ec10bbb58afa0c884ac56"}
Sep 09 21:07:01.859047 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.858998    2555 scope.go:117] "RemoveContainer" containerID="b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef"
Sep 09 21:07:01.860485 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.860457    2555 generic.go:356] "Generic (PLEG): container finished" podID="787b4554-f547-47e3-8bbf-28a6c71013f6" containerID="f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac" exitCode=0
Sep 09 21:07:01.860652 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.860493    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"
Sep 09 21:07:01.860652 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.860537    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx" event={"ID":"787b4554-f547-47e3-8bbf-28a6c71013f6","Type":"ContainerDied","Data":"f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac"}
Sep 09 21:07:01.860652 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.860586    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx" event={"ID":"787b4554-f547-47e3-8bbf-28a6c71013f6","Type":"ContainerDied","Data":"c82ddac415c855fc6b9e7c87d955349859b0ef0136a7c26e27d64ba216a933a9"}
Sep 09 21:07:01.872251 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.872225    2555 scope.go:117] "RemoveContainer" containerID="b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef"
Sep 09 21:07:01.872509 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:07:01.872480    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef\": container with ID starting with b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef not found: ID does not exist" containerID="b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef"
Sep 09 21:07:01.872613 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.872521    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef"} err="failed to get container status \"b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef\": rpc error: code = NotFound desc = could not find container \"b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef\": container with ID starting with b7be8f27caa934d2758c19e3b29e409f9528aa16ea57958a41437cd621a571ef not found: ID does not exist"
Sep 09 21:07:01.872613 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.872544    2555 scope.go:117] "RemoveContainer" containerID="f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac"
Sep 09 21:07:01.891985 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.891938    2555 scope.go:117] "RemoveContainer" containerID="f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac"
Sep 09 21:07:01.892272 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:07:01.892249    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac\": container with ID starting with f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac not found: ID does not exist" containerID="f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac"
Sep 09 21:07:01.892334 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.892281    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac"} err="failed to get container status \"f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac\": rpc error: code = NotFound desc = could not find container \"f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac\": container with ID starting with f72b67c79cd891d18aeca56caf8a949efec58cc96c74b2374c335de2b87eb6ac not found: ID does not exist"
Sep 09 21:07:01.896959 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.896930    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"]
Sep 09 21:07:01.902774 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.902748    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx"]
Sep 09 21:07:01.915279 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.915248    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"]
Sep 09 21:07:01.921102 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:07:01.921073    2555 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787b4554_f547_47e3_8bbf_28a6c71013f6.slice/crio-c82ddac415c855fc6b9e7c87d955349859b0ef0136a7c26e27d64ba216a933a9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787b4554_f547_47e3_8bbf_28a6c71013f6.slice\": RecentStats: unable to find data in memory cache]"
Sep 09 21:07:01.926916 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:01.926880    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d36b91-744fb497d5-ggw62"]
Sep 09 21:07:02.836635 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:02.836605    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:07:03.432085 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:03.432053    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="787b4554-f547-47e3-8bbf-28a6c71013f6" path="/var/lib/kubelet/pods/787b4554-f547-47e3-8bbf-28a6c71013f6/volumes"
Sep 09 21:07:03.432465 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:03.432453    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee7caeeb-ae57-4e7b-aebc-96cd7789377f" path="/var/lib/kubelet/pods/ee7caeeb-ae57-4e7b-aebc-96cd7789377f/volumes"
Sep 09 21:07:05.237464 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.237418    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r" podUID="2c3b3a3a-c775-4557-93c9-46fb856afe9e" containerName="main" containerID="cri-o://4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e" gracePeriod=45
Sep 09 21:07:05.240187 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.240134    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66" podUID="aa59e886-3812-4cd3-8bf0-e08fb2d52099" containerName="main" containerID="cri-o://f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd" gracePeriod=45
Sep 09 21:07:05.530334 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.530023    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 21:07:05.533795 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.533769    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:07:05.677579 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.677544    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tls-certs\") pod \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") "
Sep 09 21:07:05.677761 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.677604    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zvpc\" (UniqueName: \"kubernetes.io/projected/2c3b3a3a-c775-4557-93c9-46fb856afe9e-kube-api-access-9zvpc\") pod \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") "
Sep 09 21:07:05.677761 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.677718    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-model-cache\") pod \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") "
Sep 09 21:07:05.678059 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678030    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c3b3a3a-c775-4557-93c9-46fb856afe9e" (UID: "2c3b3a3a-c775-4557-93c9-46fb856afe9e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:07:05.678168 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678094    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-home" (OuterVolumeSpecName: "home") pod "aa59e886-3812-4cd3-8bf0-e08fb2d52099" (UID: "aa59e886-3812-4cd3-8bf0-e08fb2d52099"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:07:05.678168 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678103    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-home\") pod \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") "
Sep 09 21:07:05.678277 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678182    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28cbn\" (UniqueName: \"kubernetes.io/projected/aa59e886-3812-4cd3-8bf0-e08fb2d52099-kube-api-access-28cbn\") pod \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") "
Sep 09 21:07:05.678277 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678220    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-dshm\") pod \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") "
Sep 09 21:07:05.678277 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678254    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tmp-dir\") pod \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") "
Sep 09 21:07:05.678428 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678281    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tls-certs\") pod \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") "
Sep 09 21:07:05.678428 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678314    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-home\") pod \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\" (UID: \"2c3b3a3a-c775-4557-93c9-46fb856afe9e\") "
Sep 09 21:07:05.678428 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678366    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tmp-dir\") pod \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") "
Sep 09 21:07:05.678428 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678394    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-model-cache\") pod \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") "
Sep 09 21:07:05.678631 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678427    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-dshm\") pod \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\" (UID: \"aa59e886-3812-4cd3-8bf0-e08fb2d52099\") "
Sep 09 21:07:05.678631 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678515    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c3b3a3a-c775-4557-93c9-46fb856afe9e" (UID: "2c3b3a3a-c775-4557-93c9-46fb856afe9e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:07:05.678737 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678671    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa59e886-3812-4cd3-8bf0-e08fb2d52099" (UID: "aa59e886-3812-4cd3-8bf0-e08fb2d52099"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:07:05.678737 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.678694    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-home" (OuterVolumeSpecName: "home") pod "2c3b3a3a-c775-4557-93c9-46fb856afe9e" (UID: "2c3b3a3a-c775-4557-93c9-46fb856afe9e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:07:05.679028 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.679004    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-model-cache\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.679116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.679030    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-home\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.679116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.679042    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tmp-dir\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.679116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.679053    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-home\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.679116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.679068    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tmp-dir\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.679116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.679047    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa59e886-3812-4cd3-8bf0-e08fb2d52099" (UID: "aa59e886-3812-4cd3-8bf0-e08fb2d52099"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:07:05.682867 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.682841    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-dshm" (OuterVolumeSpecName: "dshm") pod "aa59e886-3812-4cd3-8bf0-e08fb2d52099" (UID: "aa59e886-3812-4cd3-8bf0-e08fb2d52099"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:07:05.683655 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.683615    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c3b3a3a-c775-4557-93c9-46fb856afe9e" (UID: "2c3b3a3a-c775-4557-93c9-46fb856afe9e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:07:05.683655 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.683645    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa59e886-3812-4cd3-8bf0-e08fb2d52099-kube-api-access-28cbn" (OuterVolumeSpecName: "kube-api-access-28cbn") pod "aa59e886-3812-4cd3-8bf0-e08fb2d52099" (UID: "aa59e886-3812-4cd3-8bf0-e08fb2d52099"). InnerVolumeSpecName "kube-api-access-28cbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:07:05.684277 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.683955    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa59e886-3812-4cd3-8bf0-e08fb2d52099" (UID: "aa59e886-3812-4cd3-8bf0-e08fb2d52099"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:07:05.684277 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.683998    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3b3a3a-c775-4557-93c9-46fb856afe9e-kube-api-access-9zvpc" (OuterVolumeSpecName: "kube-api-access-9zvpc") pod "2c3b3a3a-c775-4557-93c9-46fb856afe9e" (UID: "2c3b3a3a-c775-4557-93c9-46fb856afe9e"). InnerVolumeSpecName "kube-api-access-9zvpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:07:05.684277 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.684178    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-dshm" (OuterVolumeSpecName: "dshm") pod "2c3b3a3a-c775-4557-93c9-46fb856afe9e" (UID: "2c3b3a3a-c775-4557-93c9-46fb856afe9e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:07:05.780175 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.780078    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c3b3a3a-c775-4557-93c9-46fb856afe9e-tls-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.780175 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.780106    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-model-cache\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.780175 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.780115    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa59e886-3812-4cd3-8bf0-e08fb2d52099-dshm\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.780175 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.780122    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa59e886-3812-4cd3-8bf0-e08fb2d52099-tls-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.780175 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.780130    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zvpc\" (UniqueName: \"kubernetes.io/projected/2c3b3a3a-c775-4557-93c9-46fb856afe9e-kube-api-access-9zvpc\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.780175 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.780140    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28cbn\" (UniqueName: \"kubernetes.io/projected/aa59e886-3812-4cd3-8bf0-e08fb2d52099-kube-api-access-28cbn\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.780175 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.780150    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c3b3a3a-c775-4557-93c9-46fb856afe9e-dshm\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:05.890940 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.890883    2555 generic.go:356] "Generic (PLEG): container finished" podID="aa59e886-3812-4cd3-8bf0-e08fb2d52099" containerID="f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd" exitCode=0
Sep 09 21:07:05.891116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.890947    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"
Sep 09 21:07:05.891116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.890977    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66" event={"ID":"aa59e886-3812-4cd3-8bf0-e08fb2d52099","Type":"ContainerDied","Data":"f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd"}
Sep 09 21:07:05.891116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.891045    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66" event={"ID":"aa59e886-3812-4cd3-8bf0-e08fb2d52099","Type":"ContainerDied","Data":"6134076aeb29121d3516ef400da67be132d7790d1f12e905bf66d2e65d8f6c78"}
Sep 09 21:07:05.891116 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.891066    2555 scope.go:117] "RemoveContainer" containerID="f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd"
Sep 09 21:07:05.892542 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.892516    2555 generic.go:356] "Generic (PLEG): container finished" podID="2c3b3a3a-c775-4557-93c9-46fb856afe9e" containerID="4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e" exitCode=0
Sep 09 21:07:05.892676 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.892550    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r" event={"ID":"2c3b3a3a-c775-4557-93c9-46fb856afe9e","Type":"ContainerDied","Data":"4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e"}
Sep 09 21:07:05.892676 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.892566    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"
Sep 09 21:07:05.892676 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.892579    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r" event={"ID":"2c3b3a3a-c775-4557-93c9-46fb856afe9e","Type":"ContainerDied","Data":"44ef6483d041584b8bee30b80a75297eb7088ccfb8fe24a98411c883638738ff"}
Sep 09 21:07:05.903982 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.903875    2555 scope.go:117] "RemoveContainer" containerID="f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd"
Sep 09 21:07:05.904409 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:07:05.904383    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd\": container with ID starting with f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd not found: ID does not exist" containerID="f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd"
Sep 09 21:07:05.904621 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.904419    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd"} err="failed to get container status \"f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd\": rpc error: code = NotFound desc = could not find container \"f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd\": container with ID starting with f1a2ec11272bf9b8b12871c7c7d2062bb3bf3f123835eb0ec207cdf2997db1bd not found: ID does not exist"
Sep 09 21:07:05.904621 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.904441    2555 scope.go:117] "RemoveContainer" containerID="4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e"
Sep 09 21:07:05.914232 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.914207    2555 scope.go:117] "RemoveContainer" containerID="4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e"
Sep 09 21:07:05.914609 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:07:05.914584    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e\": container with ID starting with 4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e not found: ID does not exist" containerID="4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e"
Sep 09 21:07:05.914696 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.914617    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e"} err="failed to get container status \"4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e\": rpc error: code = NotFound desc = could not find container \"4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e\": container with ID starting with 4820d4456e286a7fb277a564e6f945207820c7829dcc4e54991d30f7cb82f98e not found: ID does not exist"
Sep 09 21:07:05.929918 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.929879    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"]
Sep 09 21:07:05.934893 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.934872    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-2-w0-d36b91-kserve-7b8c4644b7-7nd5r"]
Sep 09 21:07:05.944862 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.944843    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"]
Sep 09 21:07:05.948577 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:05.948555    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-d36b91/distinct-w0-d36b91-kserve-6d47c96b56-pvs66"]
Sep 09 21:07:07.431945 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:07.431894    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c3b3a3a-c775-4557-93c9-46fb856afe9e" path="/var/lib/kubelet/pods/2c3b3a3a-c775-4557-93c9-46fb856afe9e/volumes"
Sep 09 21:07:07.432330 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:07.432316    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa59e886-3812-4cd3-8bf0-e08fb2d52099" path="/var/lib/kubelet/pods/aa59e886-3812-4cd3-8bf0-e08fb2d52099/volumes"
Sep 09 21:07:36.765225 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:36.765189    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"]
Sep 09 21:07:36.765802 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:36.765428    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd" podUID="0eb5001c-a6ce-4151-94ba-bd4ed9217649" containerName="maas-api" containerID="cri-o://0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177" gracePeriod=30
Sep 09 21:07:37.023706 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.023643    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:07:37.079505 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.079476    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-metrics-certs\") pod \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") "
Sep 09 21:07:37.079657 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.079529    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb5001c-a6ce-4151-94ba-bd4ed9217649-openshift-service-ca\") pod \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") "
Sep 09 21:07:37.079657 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.079547    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-maas-api-tls\") pod \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") "
Sep 09 21:07:37.079657 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.079622    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v976d\" (UniqueName: \"kubernetes.io/projected/0eb5001c-a6ce-4151-94ba-bd4ed9217649-kube-api-access-v976d\") pod \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\" (UID: \"0eb5001c-a6ce-4151-94ba-bd4ed9217649\") "
Sep 09 21:07:37.080110 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.080078    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eb5001c-a6ce-4151-94ba-bd4ed9217649-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0eb5001c-a6ce-4151-94ba-bd4ed9217649" (UID: "0eb5001c-a6ce-4151-94ba-bd4ed9217649"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:07:37.081820 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.081756    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0eb5001c-a6ce-4151-94ba-bd4ed9217649" (UID: "0eb5001c-a6ce-4151-94ba-bd4ed9217649"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:07:37.081820 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.081805    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb5001c-a6ce-4151-94ba-bd4ed9217649-kube-api-access-v976d" (OuterVolumeSpecName: "kube-api-access-v976d") pod "0eb5001c-a6ce-4151-94ba-bd4ed9217649" (UID: "0eb5001c-a6ce-4151-94ba-bd4ed9217649"). InnerVolumeSpecName "kube-api-access-v976d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:07:37.082038 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.081835    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0eb5001c-a6ce-4151-94ba-bd4ed9217649" (UID: "0eb5001c-a6ce-4151-94ba-bd4ed9217649"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:07:37.091884 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.091855    2555 generic.go:356] "Generic (PLEG): container finished" podID="0eb5001c-a6ce-4151-94ba-bd4ed9217649" containerID="0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177" exitCode=0
Sep 09 21:07:37.092023 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.091934    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"
Sep 09 21:07:37.092023 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.091931    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd" event={"ID":"0eb5001c-a6ce-4151-94ba-bd4ed9217649","Type":"ContainerDied","Data":"0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177"}
Sep 09 21:07:37.092023 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.091987    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd" event={"ID":"0eb5001c-a6ce-4151-94ba-bd4ed9217649","Type":"ContainerDied","Data":"568a76ea4a4d62dad7ffef8d2792e5db6c933776fe5433d0556211a691084159"}
Sep 09 21:07:37.092023 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.092009    2555 scope.go:117] "RemoveContainer" containerID="0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177"
Sep 09 21:07:37.105908 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.105877    2555 scope.go:117] "RemoveContainer" containerID="0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177"
Sep 09 21:07:37.106211 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:07:37.106193    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177\": container with ID starting with 0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177 not found: ID does not exist" containerID="0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177"
Sep 09 21:07:37.106279 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.106219    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177"} err="failed to get container status \"0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177\": rpc error: code = NotFound desc = could not find container \"0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177\": container with ID starting with 0958ab576bc7cb6fbd2ca4ec50979718b94d8eebef883e18c9b513b61e6e2177 not found: ID does not exist"
Sep 09 21:07:37.122520 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.122495    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"]
Sep 09 21:07:37.130219 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.130192    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e8973-97785bd9c-jfvcd"]
Sep 09 21:07:37.180961 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.180929    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v976d\" (UniqueName: \"kubernetes.io/projected/0eb5001c-a6ce-4151-94ba-bd4ed9217649-kube-api-access-v976d\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:37.180961 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.180958    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:37.180961 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.180968    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb5001c-a6ce-4151-94ba-bd4ed9217649-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:37.181216 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.180977    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eb5001c-a6ce-4151-94ba-bd4ed9217649-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:07:37.431165 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:07:37.431129    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eb5001c-a6ce-4151-94ba-bd4ed9217649" path="/var/lib/kubelet/pods/0eb5001c-a6ce-4151-94ba-bd4ed9217649/volumes"
Sep 09 21:08:00.413584 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.413547    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"]
Sep 09 21:08:00.414083 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.413763    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9" podUID="0d9e3105-f2d0-4d5f-829e-ef30427e17cf" containerName="maas-api" containerID="cri-o://1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559" gracePeriod=30
Sep 09 21:08:00.666725 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.666659    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:08:00.813966 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.813926    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g9qd\" (UniqueName: \"kubernetes.io/projected/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-kube-api-access-8g9qd\") pod \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") "
Sep 09 21:08:00.813966 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.813968    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-openshift-service-ca\") pod \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") "
Sep 09 21:08:00.814218 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.813992    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-maas-api-tls\") pod \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") "
Sep 09 21:08:00.814218 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.814033    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-metrics-certs\") pod \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\" (UID: \"0d9e3105-f2d0-4d5f-829e-ef30427e17cf\") "
Sep 09 21:08:00.814399 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.814372    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d9e3105-f2d0-4d5f-829e-ef30427e17cf" (UID: "0d9e3105-f2d0-4d5f-829e-ef30427e17cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:08:00.816434 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.816408    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d9e3105-f2d0-4d5f-829e-ef30427e17cf" (UID: "0d9e3105-f2d0-4d5f-829e-ef30427e17cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:08:00.816434 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.816413    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-kube-api-access-8g9qd" (OuterVolumeSpecName: "kube-api-access-8g9qd") pod "0d9e3105-f2d0-4d5f-829e-ef30427e17cf" (UID: "0d9e3105-f2d0-4d5f-829e-ef30427e17cf"). InnerVolumeSpecName "kube-api-access-8g9qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:08:00.816561 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.816431    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0d9e3105-f2d0-4d5f-829e-ef30427e17cf" (UID: "0d9e3105-f2d0-4d5f-829e-ef30427e17cf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:08:00.915225 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.915188    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:00.915225 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.915222    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:00.915225 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.915232    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:00.915476 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:00.915239    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g9qd\" (UniqueName: \"kubernetes.io/projected/0d9e3105-f2d0-4d5f-829e-ef30427e17cf-kube-api-access-8g9qd\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:01.239061 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.239025    2555 generic.go:356] "Generic (PLEG): container finished" podID="0d9e3105-f2d0-4d5f-829e-ef30427e17cf" containerID="1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559" exitCode=0
Sep 09 21:08:01.239212 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.239077    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"
Sep 09 21:08:01.239212 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.239112    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9" event={"ID":"0d9e3105-f2d0-4d5f-829e-ef30427e17cf","Type":"ContainerDied","Data":"1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559"}
Sep 09 21:08:01.239212 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.239174    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9" event={"ID":"0d9e3105-f2d0-4d5f-829e-ef30427e17cf","Type":"ContainerDied","Data":"034489b165c511f731730cb6c24855f87acb0e89d7ff704c9440a3af6996fb0d"}
Sep 09 21:08:01.239212 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.239202    2555 scope.go:117] "RemoveContainer" containerID="1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559"
Sep 09 21:08:01.249799 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.249777    2555 scope.go:117] "RemoveContainer" containerID="1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559"
Sep 09 21:08:01.250130 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:08:01.250110    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559\": container with ID starting with 1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559 not found: ID does not exist" containerID="1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559"
Sep 09 21:08:01.250179 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.250139    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559"} err="failed to get container status \"1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559\": rpc error: code = NotFound desc = could not find container \"1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559\": container with ID starting with 1d39c5541d84ab83786e41b58ad7c9e40af538ea33b0d0b51a0d068dca929559 not found: ID does not exist"
Sep 09 21:08:01.274393 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.274358    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"]
Sep 09 21:08:01.286458 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.281871    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0622e2-7cdbb4474-sd8l9"]
Sep 09 21:08:01.431867 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:01.431833    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9e3105-f2d0-4d5f-829e-ef30427e17cf" path="/var/lib/kubelet/pods/0d9e3105-f2d0-4d5f-829e-ef30427e17cf/volumes"
Sep 09 21:08:18.879167 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:18.879128    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"]
Sep 09 21:08:18.879684 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:18.879397    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb" podUID="6806ac69-9db9-4992-be74-20ea5f816877" containerName="maas-api" containerID="cri-o://ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b" gracePeriod=30
Sep 09 21:08:19.146178 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.146154    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 21:08:19.213391 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.213361    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc89l\" (UniqueName: \"kubernetes.io/projected/6806ac69-9db9-4992-be74-20ea5f816877-kube-api-access-lc89l\") pod \"6806ac69-9db9-4992-be74-20ea5f816877\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") "
Sep 09 21:08:19.213548 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.213420    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-metrics-certs\") pod \"6806ac69-9db9-4992-be74-20ea5f816877\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") "
Sep 09 21:08:19.213548 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.213435    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-maas-api-tls\") pod \"6806ac69-9db9-4992-be74-20ea5f816877\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") "
Sep 09 21:08:19.213548 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.213467    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6806ac69-9db9-4992-be74-20ea5f816877-openshift-service-ca\") pod \"6806ac69-9db9-4992-be74-20ea5f816877\" (UID: \"6806ac69-9db9-4992-be74-20ea5f816877\") "
Sep 09 21:08:19.213958 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.213930    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6806ac69-9db9-4992-be74-20ea5f816877-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6806ac69-9db9-4992-be74-20ea5f816877" (UID: "6806ac69-9db9-4992-be74-20ea5f816877"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:08:19.215738 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.215712    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6806ac69-9db9-4992-be74-20ea5f816877-kube-api-access-lc89l" (OuterVolumeSpecName: "kube-api-access-lc89l") pod "6806ac69-9db9-4992-be74-20ea5f816877" (UID: "6806ac69-9db9-4992-be74-20ea5f816877"). InnerVolumeSpecName "kube-api-access-lc89l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:08:19.216588 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.216257    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6806ac69-9db9-4992-be74-20ea5f816877" (UID: "6806ac69-9db9-4992-be74-20ea5f816877"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:08:19.216588 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.216323    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6806ac69-9db9-4992-be74-20ea5f816877" (UID: "6806ac69-9db9-4992-be74-20ea5f816877"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:08:19.314414 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.314377    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc89l\" (UniqueName: \"kubernetes.io/projected/6806ac69-9db9-4992-be74-20ea5f816877-kube-api-access-lc89l\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:19.314414 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.314409    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:19.314414 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.314420    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6806ac69-9db9-4992-be74-20ea5f816877-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:19.314660 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.314427    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6806ac69-9db9-4992-be74-20ea5f816877-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:19.348932 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.348865    2555 generic.go:356] "Generic (PLEG): container finished" podID="6806ac69-9db9-4992-be74-20ea5f816877" containerID="ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b" exitCode=0
Sep 09 21:08:19.349124 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.348953    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"
Sep 09 21:08:19.349124 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.348970    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb" event={"ID":"6806ac69-9db9-4992-be74-20ea5f816877","Type":"ContainerDied","Data":"ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b"}
Sep 09 21:08:19.349124 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.349063    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb" event={"ID":"6806ac69-9db9-4992-be74-20ea5f816877","Type":"ContainerDied","Data":"be9b84c4f35dc79b49d98a201dbd4e7d3863b669ca5cebc7fb07340693a5fce4"}
Sep 09 21:08:19.349124 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.349095    2555 scope.go:117] "RemoveContainer" containerID="ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b"
Sep 09 21:08:19.360048 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.360027    2555 scope.go:117] "RemoveContainer" containerID="ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b"
Sep 09 21:08:19.360396 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:08:19.360374    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b\": container with ID starting with ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b not found: ID does not exist" containerID="ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b"
Sep 09 21:08:19.360468 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.360403    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b"} err="failed to get container status \"ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b\": rpc error: code = NotFound desc = could not find container \"ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b\": container with ID starting with ca7012ec813d307dc2430a72a2d2b491fb253afada488797f23d8452a2a95f5b not found: ID does not exist"
Sep 09 21:08:19.391227 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.391160    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"]
Sep 09 21:08:19.394893 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.394869    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e73aab-648bd96b7b-mhplb"]
Sep 09 21:08:19.432203 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:19.432175    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6806ac69-9db9-4992-be74-20ea5f816877" path="/var/lib/kubelet/pods/6806ac69-9db9-4992-be74-20ea5f816877/volumes"
Sep 09 21:08:37.227672 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.227637    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"]
Sep 09 21:08:37.228176 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.227923    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc" podUID="2b01ee8c-5a54-45db-a249-bda1c9327358" containerName="maas-api" containerID="cri-o://7065d0c9f4b1443a3f18f4e9954b782b9fcac6f8a9bf83794b9c88691e68f681" gracePeriod=30
Sep 09 21:08:37.463736 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.463708    2555 generic.go:356] "Generic (PLEG): container finished" podID="2b01ee8c-5a54-45db-a249-bda1c9327358" containerID="7065d0c9f4b1443a3f18f4e9954b782b9fcac6f8a9bf83794b9c88691e68f681" exitCode=0
Sep 09 21:08:37.463811 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.463775    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc" event={"ID":"2b01ee8c-5a54-45db-a249-bda1c9327358","Type":"ContainerDied","Data":"7065d0c9f4b1443a3f18f4e9954b782b9fcac6f8a9bf83794b9c88691e68f681"}
Sep 09 21:08:37.463862 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.463824    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc" event={"ID":"2b01ee8c-5a54-45db-a249-bda1c9327358","Type":"ContainerDied","Data":"dcca14bdd6cdd04c2e4c24a7beac149f7501b858394faf211e11f8b9804cff32"}
Sep 09 21:08:37.463862 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.463841    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcca14bdd6cdd04c2e4c24a7beac149f7501b858394faf211e11f8b9804cff32"
Sep 09 21:08:37.479422 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.479373    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:08:37.500649 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.500615    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-maas-api-tls\") pod \"2b01ee8c-5a54-45db-a249-bda1c9327358\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") "
Sep 09 21:08:37.500787 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.500670    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-metrics-certs\") pod \"2b01ee8c-5a54-45db-a249-bda1c9327358\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") "
Sep 09 21:08:37.500787 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.500731    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k755p\" (UniqueName: \"kubernetes.io/projected/2b01ee8c-5a54-45db-a249-bda1c9327358-kube-api-access-k755p\") pod \"2b01ee8c-5a54-45db-a249-bda1c9327358\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") "
Sep 09 21:08:37.500787 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.500777    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01ee8c-5a54-45db-a249-bda1c9327358-openshift-service-ca\") pod \"2b01ee8c-5a54-45db-a249-bda1c9327358\" (UID: \"2b01ee8c-5a54-45db-a249-bda1c9327358\") "
Sep 09 21:08:37.501667 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.501576    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b01ee8c-5a54-45db-a249-bda1c9327358-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b01ee8c-5a54-45db-a249-bda1c9327358" (UID: "2b01ee8c-5a54-45db-a249-bda1c9327358"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:08:37.503371 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.503344    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b01ee8c-5a54-45db-a249-bda1c9327358" (UID: "2b01ee8c-5a54-45db-a249-bda1c9327358"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:08:37.503558 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.503537    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b01ee8c-5a54-45db-a249-bda1c9327358" (UID: "2b01ee8c-5a54-45db-a249-bda1c9327358"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:08:37.503709 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.503693    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b01ee8c-5a54-45db-a249-bda1c9327358-kube-api-access-k755p" (OuterVolumeSpecName: "kube-api-access-k755p") pod "2b01ee8c-5a54-45db-a249-bda1c9327358" (UID: "2b01ee8c-5a54-45db-a249-bda1c9327358"). InnerVolumeSpecName "kube-api-access-k755p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:08:37.602363 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.602322    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01ee8c-5a54-45db-a249-bda1c9327358-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:37.602548 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.602390    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:37.602548 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.602405    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01ee8c-5a54-45db-a249-bda1c9327358-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:37.602548 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:37.602419    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k755p\" (UniqueName: \"kubernetes.io/projected/2b01ee8c-5a54-45db-a249-bda1c9327358-kube-api-access-k755p\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:08:38.469455 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:38.469423    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"
Sep 09 21:08:38.496567 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:38.496540    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"]
Sep 09 21:08:38.506685 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:38.506642    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-06e1ff-664f69799d-zx9sc"]
Sep 09 21:08:39.431106 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:39.431061    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b01ee8c-5a54-45db-a249-bda1c9327358" path="/var/lib/kubelet/pods/2b01ee8c-5a54-45db-a249-bda1c9327358/volumes"
Sep 09 21:08:41.684146 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:08:41.684113    2555 scope.go:117] "RemoveContainer" containerID="7065d0c9f4b1443a3f18f4e9954b782b9fcac6f8a9bf83794b9c88691e68f681"
Sep 09 21:09:11.513548 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:11.513466    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"]
Sep 09 21:09:11.562459 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:11.562425    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"]
Sep 09 21:09:22.645797 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:22.645752    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"]
Sep 09 21:09:22.646350 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:22.646080    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k" podUID="f197d3e9-0669-43cc-8ade-cb275ee4d699" containerName="payload-pre-processing" containerID="cri-o://1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b" gracePeriod=30
Sep 09 21:09:22.900021 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:22.899962    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 21:09:22.949987 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:22.949952    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-578j6\" (UniqueName: \"kubernetes.io/projected/f197d3e9-0669-43cc-8ade-cb275ee4d699-kube-api-access-578j6\") pod \"f197d3e9-0669-43cc-8ade-cb275ee4d699\" (UID: \"f197d3e9-0669-43cc-8ade-cb275ee4d699\") "
Sep 09 21:09:22.950185 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:22.950056    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f197d3e9-0669-43cc-8ade-cb275ee4d699-plugins-config-volume\") pod \"f197d3e9-0669-43cc-8ade-cb275ee4d699\" (UID: \"f197d3e9-0669-43cc-8ade-cb275ee4d699\") "
Sep 09 21:09:22.950464 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:22.950440    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f197d3e9-0669-43cc-8ade-cb275ee4d699-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f197d3e9-0669-43cc-8ade-cb275ee4d699" (UID: "f197d3e9-0669-43cc-8ade-cb275ee4d699"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:09:22.952119 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:22.952092    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f197d3e9-0669-43cc-8ade-cb275ee4d699-kube-api-access-578j6" (OuterVolumeSpecName: "kube-api-access-578j6") pod "f197d3e9-0669-43cc-8ade-cb275ee4d699" (UID: "f197d3e9-0669-43cc-8ade-cb275ee4d699"). InnerVolumeSpecName "kube-api-access-578j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:09:23.051072 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.051034    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f197d3e9-0669-43cc-8ade-cb275ee4d699-plugins-config-volume\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:23.051072 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.051062    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-578j6\" (UniqueName: \"kubernetes.io/projected/f197d3e9-0669-43cc-8ade-cb275ee4d699-kube-api-access-578j6\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:23.733480 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.733396    2555 generic.go:356] "Generic (PLEG): container finished" podID="f197d3e9-0669-43cc-8ade-cb275ee4d699" containerID="1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b" exitCode=0
Sep 09 21:09:23.733480 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.733443    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"
Sep 09 21:09:23.733928 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.733485    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k" event={"ID":"f197d3e9-0669-43cc-8ade-cb275ee4d699","Type":"ContainerDied","Data":"1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b"}
Sep 09 21:09:23.733928 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.733542    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k" event={"ID":"f197d3e9-0669-43cc-8ade-cb275ee4d699","Type":"ContainerDied","Data":"e1eb3e57f5e2c54bf6d71bdb371808b607704c9eb6196723f6a4c1cc44139905"}
Sep 09 21:09:23.733928 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.733569    2555 scope.go:117] "RemoveContainer" containerID="1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b"
Sep 09 21:09:23.745305 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.745287    2555 scope.go:117] "RemoveContainer" containerID="1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b"
Sep 09 21:09:23.745609 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:09:23.745590    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b\": container with ID starting with 1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b not found: ID does not exist" containerID="1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b"
Sep 09 21:09:23.745671 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.745618    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b"} err="failed to get container status \"1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b\": rpc error: code = NotFound desc = could not find container \"1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b\": container with ID starting with 1cdb47911c453f760488d7f901528a57aed79d5d85104ffd31abbfa57b2dbb9b not found: ID does not exist"
Sep 09 21:09:23.756348 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.756325    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"]
Sep 09 21:09:23.766909 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:23.766874    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k"]
Sep 09 21:09:25.431394 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:25.431362    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f197d3e9-0669-43cc-8ade-cb275ee4d699" path="/var/lib/kubelet/pods/f197d3e9-0669-43cc-8ade-cb275ee4d699/volumes"
Sep 09 21:09:26.534230 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.534179    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv" podUID="7c7c1346-2781-4917-a52a-5769e7c7f889" containerName="main" containerID="cri-o://0cfade63f103b5b83ee9970ff7dc9137037eea4e99bbc6f22c102e449b7496b6" gracePeriod=45
Sep 09 21:09:26.582361 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.582324    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6" podUID="bd096f77-d445-412e-aa61-b9130963203d" containerName="main" containerID="cri-o://466e9559c47e418b015533e5dbda46ba564559d8fa4938a9762766c0ec2572d8" gracePeriod=45
Sep 09 21:09:26.757084 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.756848    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd096f77-d445-412e-aa61-b9130963203d" containerID="466e9559c47e418b015533e5dbda46ba564559d8fa4938a9762766c0ec2572d8" exitCode=0
Sep 09 21:09:26.757084 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.757018    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6" event={"ID":"bd096f77-d445-412e-aa61-b9130963203d","Type":"ContainerDied","Data":"466e9559c47e418b015533e5dbda46ba564559d8fa4938a9762766c0ec2572d8"}
Sep 09 21:09:26.758865 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.758777    2555 generic.go:356] "Generic (PLEG): container finished" podID="7c7c1346-2781-4917-a52a-5769e7c7f889" containerID="0cfade63f103b5b83ee9970ff7dc9137037eea4e99bbc6f22c102e449b7496b6" exitCode=0
Sep 09 21:09:26.758865 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.758846    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv" event={"ID":"7c7c1346-2781-4917-a52a-5769e7c7f889","Type":"ContainerDied","Data":"0cfade63f103b5b83ee9970ff7dc9137037eea4e99bbc6f22c102e449b7496b6"}
Sep 09 21:09:26.858337 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.858316    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:09:26.863099 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.863069    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:09:26.886815 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.886780    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c7c1346-2781-4917-a52a-5769e7c7f889-tls-certs\") pod \"7c7c1346-2781-4917-a52a-5769e7c7f889\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") "
Sep 09 21:09:26.887385 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.886820    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-dshm\") pod \"7c7c1346-2781-4917-a52a-5769e7c7f889\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") "
Sep 09 21:09:26.887385 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.886843    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-home\") pod \"7c7c1346-2781-4917-a52a-5769e7c7f889\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") "
Sep 09 21:09:26.887385 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.886871    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-tmp-dir\") pod \"7c7c1346-2781-4917-a52a-5769e7c7f889\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") "
Sep 09 21:09:26.887385 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.886951    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzsvq\" (UniqueName: \"kubernetes.io/projected/7c7c1346-2781-4917-a52a-5769e7c7f889-kube-api-access-zzsvq\") pod \"7c7c1346-2781-4917-a52a-5769e7c7f889\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") "
Sep 09 21:09:26.887385 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.887089    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-model-cache\") pod \"7c7c1346-2781-4917-a52a-5769e7c7f889\" (UID: \"7c7c1346-2781-4917-a52a-5769e7c7f889\") "
Sep 09 21:09:26.889459 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.887532    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c7c1346-2781-4917-a52a-5769e7c7f889" (UID: "7c7c1346-2781-4917-a52a-5769e7c7f889"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:26.889459 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.887549    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-home" (OuterVolumeSpecName: "home") pod "7c7c1346-2781-4917-a52a-5769e7c7f889" (UID: "7c7c1346-2781-4917-a52a-5769e7c7f889"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:26.889459 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.887614    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c7c1346-2781-4917-a52a-5769e7c7f889" (UID: "7c7c1346-2781-4917-a52a-5769e7c7f889"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:26.890804 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.890769    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7c1346-2781-4917-a52a-5769e7c7f889-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c7c1346-2781-4917-a52a-5769e7c7f889" (UID: "7c7c1346-2781-4917-a52a-5769e7c7f889"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:09:26.890946 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.890896    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7c1346-2781-4917-a52a-5769e7c7f889-kube-api-access-zzsvq" (OuterVolumeSpecName: "kube-api-access-zzsvq") pod "7c7c1346-2781-4917-a52a-5769e7c7f889" (UID: "7c7c1346-2781-4917-a52a-5769e7c7f889"). InnerVolumeSpecName "kube-api-access-zzsvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:09:26.891025 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.891003    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-dshm" (OuterVolumeSpecName: "dshm") pod "7c7c1346-2781-4917-a52a-5769e7c7f889" (UID: "7c7c1346-2781-4917-a52a-5769e7c7f889"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:26.988303 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988264    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-model-cache\") pod \"bd096f77-d445-412e-aa61-b9130963203d\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") "
Sep 09 21:09:26.988504 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988356    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-dshm\") pod \"bd096f77-d445-412e-aa61-b9130963203d\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") "
Sep 09 21:09:26.988504 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988378    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-home\") pod \"bd096f77-d445-412e-aa61-b9130963203d\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") "
Sep 09 21:09:26.988504 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988434    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-tmp-dir\") pod \"bd096f77-d445-412e-aa61-b9130963203d\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") "
Sep 09 21:09:26.988504 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988457    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t88g4\" (UniqueName: \"kubernetes.io/projected/bd096f77-d445-412e-aa61-b9130963203d-kube-api-access-t88g4\") pod \"bd096f77-d445-412e-aa61-b9130963203d\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") "
Sep 09 21:09:26.988504 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988480    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd096f77-d445-412e-aa61-b9130963203d-tls-certs\") pod \"bd096f77-d445-412e-aa61-b9130963203d\" (UID: \"bd096f77-d445-412e-aa61-b9130963203d\") "
Sep 09 21:09:26.988780 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988536    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd096f77-d445-412e-aa61-b9130963203d" (UID: "bd096f77-d445-412e-aa61-b9130963203d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:26.988780 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988708    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd096f77-d445-412e-aa61-b9130963203d" (UID: "bd096f77-d445-412e-aa61-b9130963203d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:26.988780 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988717    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-home" (OuterVolumeSpecName: "home") pod "bd096f77-d445-412e-aa61-b9130963203d" (UID: "bd096f77-d445-412e-aa61-b9130963203d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:26.988957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988831    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzsvq\" (UniqueName: \"kubernetes.io/projected/7c7c1346-2781-4917-a52a-5769e7c7f889-kube-api-access-zzsvq\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:26.988957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988845    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-home\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:26.988957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988855    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-tmp-dir\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:26.988957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988865    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-model-cache\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:26.988957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988871    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-model-cache\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:26.988957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988881    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c7c1346-2781-4917-a52a-5769e7c7f889-tls-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:26.988957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988891    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-dshm\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:26.988957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988932    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-home\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:26.988957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.988943    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c7c1346-2781-4917-a52a-5769e7c7f889-tmp-dir\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:26.990617 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.990593    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-dshm" (OuterVolumeSpecName: "dshm") pod "bd096f77-d445-412e-aa61-b9130963203d" (UID: "bd096f77-d445-412e-aa61-b9130963203d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:26.990682 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.990624    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd096f77-d445-412e-aa61-b9130963203d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd096f77-d445-412e-aa61-b9130963203d" (UID: "bd096f77-d445-412e-aa61-b9130963203d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:09:26.990682 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:26.990662    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd096f77-d445-412e-aa61-b9130963203d-kube-api-access-t88g4" (OuterVolumeSpecName: "kube-api-access-t88g4") pod "bd096f77-d445-412e-aa61-b9130963203d" (UID: "bd096f77-d445-412e-aa61-b9130963203d"). InnerVolumeSpecName "kube-api-access-t88g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:09:27.090033 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.089994    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd096f77-d445-412e-aa61-b9130963203d-dshm\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:27.090033 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.090030    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t88g4\" (UniqueName: \"kubernetes.io/projected/bd096f77-d445-412e-aa61-b9130963203d-kube-api-access-t88g4\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:27.090290 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.090046    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd096f77-d445-412e-aa61-b9130963203d-tls-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:27.766594 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.766509    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"
Sep 09 21:09:27.766594 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.766524    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6" event={"ID":"bd096f77-d445-412e-aa61-b9130963203d","Type":"ContainerDied","Data":"234b81c7329764d4d391e2683ca0cf3e7a505354b5faad9807fa4229c79a1f4f"}
Sep 09 21:09:27.766594 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.766587    2555 scope.go:117] "RemoveContainer" containerID="466e9559c47e418b015533e5dbda46ba564559d8fa4938a9762766c0ec2572d8"
Sep 09 21:09:27.768102 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.768081    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"
Sep 09 21:09:27.768227 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.768112    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv" event={"ID":"7c7c1346-2781-4917-a52a-5769e7c7f889","Type":"ContainerDied","Data":"ceddf31aaa0357df16bb7bc2b671872c1b4ae80701da515e213616a560bf068b"}
Sep 09 21:09:27.776129 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.776114    2555 scope.go:117] "RemoveContainer" containerID="0cfade63f103b5b83ee9970ff7dc9137037eea4e99bbc6f22c102e449b7496b6"
Sep 09 21:09:27.789888 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.789868    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"]
Sep 09 21:09:27.797971 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.797943    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/embedding-w4-47e41c-kserve-646668ccfb-g92tv"]
Sep 09 21:09:27.808701 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.808682    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"]
Sep 09 21:09:27.810948 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:27.810928    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-47e41c/unconfigured-w4-47e41c-kserve-787f44687b-4mlb6"]
Sep 09 21:09:29.431798 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:29.431765    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c7c1346-2781-4917-a52a-5769e7c7f889" path="/var/lib/kubelet/pods/7c7c1346-2781-4917-a52a-5769e7c7f889/volumes"
Sep 09 21:09:29.432211 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:29.432187    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd096f77-d445-412e-aa61-b9130963203d" path="/var/lib/kubelet/pods/bd096f77-d445-412e-aa61-b9130963203d/volumes"
Sep 09 21:09:38.942274 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.942232    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7540-791a68"]
Sep 09 21:09:38.943097 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943069    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f197d3e9-0669-43cc-8ade-cb275ee4d699" containerName="payload-pre-processing"
Sep 09 21:09:38.943097 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943098    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f197d3e9-0669-43cc-8ade-cb275ee4d699" containerName="payload-pre-processing"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943114    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b01ee8c-5a54-45db-a249-bda1c9327358" containerName="maas-api"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943123    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b01ee8c-5a54-45db-a249-bda1c9327358" containerName="maas-api"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943141    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb5001c-a6ce-4151-94ba-bd4ed9217649" containerName="maas-api"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943150    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb5001c-a6ce-4151-94ba-bd4ed9217649" containerName="maas-api"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943161    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9e3105-f2d0-4d5f-829e-ef30427e17cf" containerName="maas-api"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943169    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9e3105-f2d0-4d5f-829e-ef30427e17cf" containerName="maas-api"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943187    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3b3a3a-c775-4557-93c9-46fb856afe9e" containerName="main"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943194    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3b3a3a-c775-4557-93c9-46fb856afe9e" containerName="main"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943243    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee7caeeb-ae57-4e7b-aebc-96cd7789377f" containerName="maas-api"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943251    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee7caeeb-ae57-4e7b-aebc-96cd7789377f" containerName="maas-api"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943264    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6806ac69-9db9-4992-be74-20ea5f816877" containerName="maas-api"
Sep 09 21:09:38.943275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943272    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6806ac69-9db9-4992-be74-20ea5f816877" containerName="maas-api"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943288    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="787b4554-f547-47e3-8bbf-28a6c71013f6" containerName="payload-pre-processing"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943296    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="787b4554-f547-47e3-8bbf-28a6c71013f6" containerName="payload-pre-processing"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943305    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7c1346-2781-4917-a52a-5769e7c7f889" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943314    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7c1346-2781-4917-a52a-5769e7c7f889" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943333    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa59e886-3812-4cd3-8bf0-e08fb2d52099" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943341    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa59e886-3812-4cd3-8bf0-e08fb2d52099" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943350    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd096f77-d445-412e-aa61-b9130963203d" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943358    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd096f77-d445-412e-aa61-b9130963203d" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943542    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="787b4554-f547-47e3-8bbf-28a6c71013f6" containerName="payload-pre-processing"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943556    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7c1346-2781-4917-a52a-5769e7c7f889" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943575    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee7caeeb-ae57-4e7b-aebc-96cd7789377f" containerName="maas-api"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943591    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9e3105-f2d0-4d5f-829e-ef30427e17cf" containerName="maas-api"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943599    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa59e886-3812-4cd3-8bf0-e08fb2d52099" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943608    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd096f77-d445-412e-aa61-b9130963203d" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943624    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f197d3e9-0669-43cc-8ade-cb275ee4d699" containerName="payload-pre-processing"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943633    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b01ee8c-5a54-45db-a249-bda1c9327358" containerName="maas-api"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943641    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3b3a3a-c775-4557-93c9-46fb856afe9e" containerName="main"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943656    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb5001c-a6ce-4151-94ba-bd4ed9217649" containerName="maas-api"
Sep 09 21:09:38.943848 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.943664    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6806ac69-9db9-4992-be74-20ea5f816877" containerName="maas-api"
Sep 09 21:09:38.948816 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.948794    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-791a68"
Sep 09 21:09:38.952855 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.952834    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7540-791a68"]
Sep 09 21:09:38.953343 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:38.953323    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n65wg\""
Sep 09 21:09:39.107668 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:39.107629    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxqfg\" (UniqueName: \"kubernetes.io/projected/ab0c4bb8-b31f-43bd-a117-ed3429482eb9-kube-api-access-hxqfg\") pod \"test-curl-7540-791a68\" (UID: \"ab0c4bb8-b31f-43bd-a117-ed3429482eb9\") " pod="opendatahub/test-curl-7540-791a68"
Sep 09 21:09:39.209126 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:39.209015    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxqfg\" (UniqueName: \"kubernetes.io/projected/ab0c4bb8-b31f-43bd-a117-ed3429482eb9-kube-api-access-hxqfg\") pod \"test-curl-7540-791a68\" (UID: \"ab0c4bb8-b31f-43bd-a117-ed3429482eb9\") " pod="opendatahub/test-curl-7540-791a68"
Sep 09 21:09:39.220227 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:39.220200    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxqfg\" (UniqueName: \"kubernetes.io/projected/ab0c4bb8-b31f-43bd-a117-ed3429482eb9-kube-api-access-hxqfg\") pod \"test-curl-7540-791a68\" (UID: \"ab0c4bb8-b31f-43bd-a117-ed3429482eb9\") " pod="opendatahub/test-curl-7540-791a68"
Sep 09 21:09:39.259340 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:39.259306    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-791a68"
Sep 09 21:09:39.553146 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:39.553115    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7540-791a68"]
Sep 09 21:09:39.553284 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:09:39.553242    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab0c4bb8_b31f_43bd_a117_ed3429482eb9.slice/crio-c8ce188df3246a4c38418c2c242889e44a1764cb10e002732b5ab6c50a8bbf7b WatchSource:0}: Error finding container c8ce188df3246a4c38418c2c242889e44a1764cb10e002732b5ab6c50a8bbf7b: Status 404 returned error can't find the container with id c8ce188df3246a4c38418c2c242889e44a1764cb10e002732b5ab6c50a8bbf7b
Sep 09 21:09:39.841819 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:39.841711    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7540-791a68" event={"ID":"ab0c4bb8-b31f-43bd-a117-ed3429482eb9","Type":"ContainerStarted","Data":"e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8"}
Sep 09 21:09:39.841819 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:39.841759    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7540-791a68" event={"ID":"ab0c4bb8-b31f-43bd-a117-ed3429482eb9","Type":"ContainerStarted","Data":"c8ce188df3246a4c38418c2c242889e44a1764cb10e002732b5ab6c50a8bbf7b"}
Sep 09 21:09:39.866067 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:39.866016    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7540-791a68" podStartSLOduration=1.866000938 podStartE2EDuration="1.866000938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:09:39.86311552 +0000 UTC m=+1738.919652661" watchObservedRunningTime="2026-09-09 21:09:39.866000938 +0000 UTC m=+1738.922538079"
Sep 09 21:09:40.488198 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:40.488153    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7540-791a68"]
Sep 09 21:09:40.494132 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:40.494105    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7540-791a68"]
Sep 09 21:09:40.847709 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:09:40.847676    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7540-791a68" container="test-curl-7540-791a68"
Sep 09 21:09:41.853572 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:41.853520    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7540-791a68" podUID="ab0c4bb8-b31f-43bd-a117-ed3429482eb9" containerName="test-curl-7540-791a68" containerID="cri-o://e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8" gracePeriod=2
Sep 09 21:09:42.657557 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:42.657527    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"]
Sep 09 21:09:44.040641 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:44.040615    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-791a68"
Sep 09 21:09:44.155508 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:44.155410    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxqfg\" (UniqueName: \"kubernetes.io/projected/ab0c4bb8-b31f-43bd-a117-ed3429482eb9-kube-api-access-hxqfg\") pod \"ab0c4bb8-b31f-43bd-a117-ed3429482eb9\" (UID: \"ab0c4bb8-b31f-43bd-a117-ed3429482eb9\") "
Sep 09 21:09:44.157694 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:44.157666    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0c4bb8-b31f-43bd-a117-ed3429482eb9-kube-api-access-hxqfg" (OuterVolumeSpecName: "kube-api-access-hxqfg") pod "ab0c4bb8-b31f-43bd-a117-ed3429482eb9" (UID: "ab0c4bb8-b31f-43bd-a117-ed3429482eb9"). InnerVolumeSpecName "kube-api-access-hxqfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:09:44.256328 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:44.256286    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxqfg\" (UniqueName: \"kubernetes.io/projected/ab0c4bb8-b31f-43bd-a117-ed3429482eb9-kube-api-access-hxqfg\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:44.872756 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:44.872717    2555 generic.go:356] "Generic (PLEG): container finished" podID="ab0c4bb8-b31f-43bd-a117-ed3429482eb9" containerID="e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8" exitCode=137
Sep 09 21:09:44.872973 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:44.872763    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-791a68"
Sep 09 21:09:44.872973 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:44.872817    2555 scope.go:117] "RemoveContainer" containerID="e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8"
Sep 09 21:09:44.882352 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:44.882327    2555 scope.go:117] "RemoveContainer" containerID="e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8"
Sep 09 21:09:44.882659 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:09:44.882637    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8\": container with ID starting with e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8 not found: ID does not exist" containerID="e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8"
Sep 09 21:09:44.882725 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:44.882668    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8"} err="failed to get container status \"e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8\": rpc error: code = NotFound desc = could not find container \"e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8\": container with ID starting with e05206b9cc4f4f28f738b4956c2ec6a156f87a7bf9a18482705ba2311c46c0c8 not found: ID does not exist"
Sep 09 21:09:44.883611 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:09:44.883592    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7540-791a68\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="ab0c4bb8-b31f-43bd-a117-ed3429482eb9" pod="opendatahub/test-curl-7540-791a68"
Sep 09 21:09:45.431308 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:45.431271    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0c4bb8-b31f-43bd-a117-ed3429482eb9" path="/var/lib/kubelet/pods/ab0c4bb8-b31f-43bd-a117-ed3429482eb9/volumes"
Sep 09 21:09:57.677882 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.677826    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22" podUID="4711feb8-7fe5-4011-adf3-158cb927e57d" containerName="main" containerID="cri-o://b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b" gracePeriod=45
Sep 09 21:09:57.933517 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.933440    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:09:57.948706 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.948669    2555 generic.go:356] "Generic (PLEG): container finished" podID="4711feb8-7fe5-4011-adf3-158cb927e57d" containerID="b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b" exitCode=0
Sep 09 21:09:57.948885 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.948715    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"
Sep 09 21:09:57.948885 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.948761    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22" event={"ID":"4711feb8-7fe5-4011-adf3-158cb927e57d","Type":"ContainerDied","Data":"b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b"}
Sep 09 21:09:57.948885 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.948808    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22" event={"ID":"4711feb8-7fe5-4011-adf3-158cb927e57d","Type":"ContainerDied","Data":"7aa06ccb768d23e9c23f755112d294a972617fd62731037d55455a3e760ed6ca"}
Sep 09 21:09:57.948885 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.948829    2555 scope.go:117] "RemoveContainer" containerID="b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b"
Sep 09 21:09:57.958112 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.958089    2555 scope.go:117] "RemoveContainer" containerID="b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b"
Sep 09 21:09:57.958408 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:09:57.958379    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b\": container with ID starting with b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b not found: ID does not exist" containerID="b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b"
Sep 09 21:09:57.958531 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.958413    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b"} err="failed to get container status \"b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b\": rpc error: code = NotFound desc = could not find container \"b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b\": container with ID starting with b64796837af76cacea8e8241f46d7754e9de1bf8c9b3007045f10f2f50c1919b not found: ID does not exist"
Sep 09 21:09:57.988323 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988277    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpmn9\" (UniqueName: \"kubernetes.io/projected/4711feb8-7fe5-4011-adf3-158cb927e57d-kube-api-access-mpmn9\") pod \"4711feb8-7fe5-4011-adf3-158cb927e57d\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") "
Sep 09 21:09:57.988518 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988378    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-model-cache\") pod \"4711feb8-7fe5-4011-adf3-158cb927e57d\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") "
Sep 09 21:09:57.988518 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988420    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-tmp-dir\") pod \"4711feb8-7fe5-4011-adf3-158cb927e57d\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") "
Sep 09 21:09:57.988518 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988460    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-home\") pod \"4711feb8-7fe5-4011-adf3-158cb927e57d\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") "
Sep 09 21:09:57.988518 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988492    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-dshm\") pod \"4711feb8-7fe5-4011-adf3-158cb927e57d\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") "
Sep 09 21:09:57.988762 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988549    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4711feb8-7fe5-4011-adf3-158cb927e57d-tls-certs\") pod \"4711feb8-7fe5-4011-adf3-158cb927e57d\" (UID: \"4711feb8-7fe5-4011-adf3-158cb927e57d\") "
Sep 09 21:09:57.988762 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988697    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-model-cache" (OuterVolumeSpecName: "model-cache") pod "4711feb8-7fe5-4011-adf3-158cb927e57d" (UID: "4711feb8-7fe5-4011-adf3-158cb927e57d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:57.988762 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988711    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4711feb8-7fe5-4011-adf3-158cb927e57d" (UID: "4711feb8-7fe5-4011-adf3-158cb927e57d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:57.988762 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988720    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-home" (OuterVolumeSpecName: "home") pod "4711feb8-7fe5-4011-adf3-158cb927e57d" (UID: "4711feb8-7fe5-4011-adf3-158cb927e57d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:57.989018 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988895    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-model-cache\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:57.989018 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988940    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-tmp-dir\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:57.989018 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.988954    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-home\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:57.990941 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.990886    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-dshm" (OuterVolumeSpecName: "dshm") pod "4711feb8-7fe5-4011-adf3-158cb927e57d" (UID: "4711feb8-7fe5-4011-adf3-158cb927e57d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:09:57.991075 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.991045    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4711feb8-7fe5-4011-adf3-158cb927e57d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4711feb8-7fe5-4011-adf3-158cb927e57d" (UID: "4711feb8-7fe5-4011-adf3-158cb927e57d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:09:57.991186 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:57.991166    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4711feb8-7fe5-4011-adf3-158cb927e57d-kube-api-access-mpmn9" (OuterVolumeSpecName: "kube-api-access-mpmn9") pod "4711feb8-7fe5-4011-adf3-158cb927e57d" (UID: "4711feb8-7fe5-4011-adf3-158cb927e57d"). InnerVolumeSpecName "kube-api-access-mpmn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:09:58.089584 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:58.089546    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4711feb8-7fe5-4011-adf3-158cb927e57d-dshm\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:58.089584 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:58.089585    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4711feb8-7fe5-4011-adf3-158cb927e57d-tls-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:58.089789 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:58.089602    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpmn9\" (UniqueName: \"kubernetes.io/projected/4711feb8-7fe5-4011-adf3-158cb927e57d-kube-api-access-mpmn9\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:09:58.287638 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:58.287593    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"]
Sep 09 21:09:58.297480 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:58.297431    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-615c6f/auth-test-model-615c6f-kserve-6944b77f67-g2t22"]
Sep 09 21:09:59.431203 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:09:59.431171    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4711feb8-7fe5-4011-adf3-158cb927e57d" path="/var/lib/kubelet/pods/4711feb8-7fe5-4011-adf3-158cb927e57d/volumes"
Sep 09 21:11:08.446923 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.446873    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7540-686648"]
Sep 09 21:11:08.447314 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.447297    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0c4bb8-b31f-43bd-a117-ed3429482eb9" containerName="test-curl-7540-791a68"
Sep 09 21:11:08.447314 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.447311    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0c4bb8-b31f-43bd-a117-ed3429482eb9" containerName="test-curl-7540-791a68"
Sep 09 21:11:08.447392 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.447343    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4711feb8-7fe5-4011-adf3-158cb927e57d" containerName="main"
Sep 09 21:11:08.447392 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.447349    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4711feb8-7fe5-4011-adf3-158cb927e57d" containerName="main"
Sep 09 21:11:08.447456 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.447407    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0c4bb8-b31f-43bd-a117-ed3429482eb9" containerName="test-curl-7540-791a68"
Sep 09 21:11:08.447456 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.447421    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4711feb8-7fe5-4011-adf3-158cb927e57d" containerName="main"
Sep 09 21:11:08.450600 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.450582    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:08.453849 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.453829    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n65wg\""
Sep 09 21:11:08.459106 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.459086    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7540-686648"]
Sep 09 21:11:08.530770 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.530736    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c89lf\" (UniqueName: \"kubernetes.io/projected/3bf80054-be53-4b54-b9bc-3215353bce73-kube-api-access-c89lf\") pod \"test-curl-7540-686648\" (UID: \"3bf80054-be53-4b54-b9bc-3215353bce73\") " pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:08.631308 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.631278    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c89lf\" (UniqueName: \"kubernetes.io/projected/3bf80054-be53-4b54-b9bc-3215353bce73-kube-api-access-c89lf\") pod \"test-curl-7540-686648\" (UID: \"3bf80054-be53-4b54-b9bc-3215353bce73\") " pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:08.639184 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.639155    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c89lf\" (UniqueName: \"kubernetes.io/projected/3bf80054-be53-4b54-b9bc-3215353bce73-kube-api-access-c89lf\") pod \"test-curl-7540-686648\" (UID: \"3bf80054-be53-4b54-b9bc-3215353bce73\") " pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:08.760549 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:08.760469    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:09.032569 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:09.032544    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7540-686648"]
Sep 09 21:11:09.034789 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:11:09.034749    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bf80054_be53_4b54_b9bc_3215353bce73.slice/crio-22b33bc271e0df9221947e6165451c8de8d537bfae3e87d991d0890e844a14a0 WatchSource:0}: Error finding container 22b33bc271e0df9221947e6165451c8de8d537bfae3e87d991d0890e844a14a0: Status 404 returned error can't find the container with id 22b33bc271e0df9221947e6165451c8de8d537bfae3e87d991d0890e844a14a0
Sep 09 21:11:09.373197 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:09.373157    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7540-686648" event={"ID":"3bf80054-be53-4b54-b9bc-3215353bce73","Type":"ContainerStarted","Data":"0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18"}
Sep 09 21:11:09.373197 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:09.373201    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7540-686648" event={"ID":"3bf80054-be53-4b54-b9bc-3215353bce73","Type":"ContainerStarted","Data":"22b33bc271e0df9221947e6165451c8de8d537bfae3e87d991d0890e844a14a0"}
Sep 09 21:11:09.389635 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:09.389586    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7540-686648" podStartSLOduration=1.389572518 podStartE2EDuration="1.389572518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:11:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:11:09.38742862 +0000 UTC m=+1828.443965763" watchObservedRunningTime="2026-09-09 21:11:09.389572518 +0000 UTC m=+1828.446109659"
Sep 09 21:11:10.070177 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.070141    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7540-686648"]
Sep 09 21:11:10.074931 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.074889    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7540-686648"]
Sep 09 21:11:10.186359 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.186265    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7540-756316"]
Sep 09 21:11:10.186742 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.186720    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf80054-be53-4b54-b9bc-3215353bce73" containerName="test-curl-7540-686648"
Sep 09 21:11:10.186830 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.186745    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf80054-be53-4b54-b9bc-3215353bce73" containerName="test-curl-7540-686648"
Sep 09 21:11:10.186896 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.186867    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf80054-be53-4b54-b9bc-3215353bce73" containerName="test-curl-7540-686648"
Sep 09 21:11:10.189995 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.189966    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-756316"
Sep 09 21:11:10.196828 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.196797    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7540-756316"]
Sep 09 21:11:10.347423 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.347383    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gbwr\" (UniqueName: \"kubernetes.io/projected/1e817c68-e140-4282-977e-4a6199cc9b9c-kube-api-access-5gbwr\") pod \"test-curl-7540-756316\" (UID: \"1e817c68-e140-4282-977e-4a6199cc9b9c\") " pod="opendatahub/test-curl-7540-756316"
Sep 09 21:11:10.378621 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:10.378592    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7540-686648" container="test-curl-7540-686648"
Sep 09 21:11:10.448309 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.448233    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gbwr\" (UniqueName: \"kubernetes.io/projected/1e817c68-e140-4282-977e-4a6199cc9b9c-kube-api-access-5gbwr\") pod \"test-curl-7540-756316\" (UID: \"1e817c68-e140-4282-977e-4a6199cc9b9c\") " pod="opendatahub/test-curl-7540-756316"
Sep 09 21:11:10.457450 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.457413    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gbwr\" (UniqueName: \"kubernetes.io/projected/1e817c68-e140-4282-977e-4a6199cc9b9c-kube-api-access-5gbwr\") pod \"test-curl-7540-756316\" (UID: \"1e817c68-e140-4282-977e-4a6199cc9b9c\") " pod="opendatahub/test-curl-7540-756316"
Sep 09 21:11:10.501155 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.501062    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-756316"
Sep 09 21:11:10.779513 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:10.779487    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7540-756316"]
Sep 09 21:11:10.781879 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:11:10.781848    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e817c68_e140_4282_977e_4a6199cc9b9c.slice/crio-cd3cf5cd2ab0858ac5995ff8e108a9157cc883745cd0a8b220725cf94857b9d8 WatchSource:0}: Error finding container cd3cf5cd2ab0858ac5995ff8e108a9157cc883745cd0a8b220725cf94857b9d8: Status 404 returned error can't find the container with id cd3cf5cd2ab0858ac5995ff8e108a9157cc883745cd0a8b220725cf94857b9d8
Sep 09 21:11:11.385160 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:11.385119    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7540-756316" event={"ID":"1e817c68-e140-4282-977e-4a6199cc9b9c","Type":"ContainerStarted","Data":"07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4"}
Sep 09 21:11:11.385597 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:11.385173    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7540-756316" event={"ID":"1e817c68-e140-4282-977e-4a6199cc9b9c","Type":"ContainerStarted","Data":"cd3cf5cd2ab0858ac5995ff8e108a9157cc883745cd0a8b220725cf94857b9d8"}
Sep 09 21:11:11.385597 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:11.385260    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7540-686648" podUID="3bf80054-be53-4b54-b9bc-3215353bce73" containerName="test-curl-7540-686648" containerID="cri-o://0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18" gracePeriod=2
Sep 09 21:11:11.401241 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:11.401196    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7540-756316" podStartSLOduration=1.401177982 podStartE2EDuration="1.401177982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:11:11.400020078 +0000 UTC m=+1830.456557224" watchObservedRunningTime="2026-09-09 21:11:11.401177982 +0000 UTC m=+1830.457715127"
Sep 09 21:11:11.402525 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:11.402497    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7540-686648\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="3bf80054-be53-4b54-b9bc-3215353bce73" pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:11.404626 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:11.404603    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7540-686648\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="3bf80054-be53-4b54-b9bc-3215353bce73" pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:11.429537 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:11.429499    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7540-686648\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="3bf80054-be53-4b54-b9bc-3215353bce73" pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:12.002077 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:12.002043    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7540-756316"]
Sep 09 21:11:12.009658 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:12.009627    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7540-756316"]
Sep 09 21:11:12.390815 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:12.390784    2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7540-756316" container="test-curl-7540-756316"
Sep 09 21:11:13.398281 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:13.398245    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7540-756316" podUID="1e817c68-e140-4282-977e-4a6199cc9b9c" containerName="test-curl-7540-756316" containerID="cri-o://07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4" gracePeriod=2
Sep 09 21:11:13.400712 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:13.400664    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7540-756316\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="1e817c68-e140-4282-977e-4a6199cc9b9c" pod="opendatahub/test-curl-7540-756316"
Sep 09 21:11:13.570142 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:13.570117    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:13.680114 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:13.680024    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c89lf\" (UniqueName: \"kubernetes.io/projected/3bf80054-be53-4b54-b9bc-3215353bce73-kube-api-access-c89lf\") pod \"3bf80054-be53-4b54-b9bc-3215353bce73\" (UID: \"3bf80054-be53-4b54-b9bc-3215353bce73\") "
Sep 09 21:11:13.682282 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:13.682244    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf80054-be53-4b54-b9bc-3215353bce73-kube-api-access-c89lf" (OuterVolumeSpecName: "kube-api-access-c89lf") pod "3bf80054-be53-4b54-b9bc-3215353bce73" (UID: "3bf80054-be53-4b54-b9bc-3215353bce73"). InnerVolumeSpecName "kube-api-access-c89lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:11:13.780797 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:13.780762    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c89lf\" (UniqueName: \"kubernetes.io/projected/3bf80054-be53-4b54-b9bc-3215353bce73-kube-api-access-c89lf\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:11:14.406449 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:14.406408    2555 generic.go:356] "Generic (PLEG): container finished" podID="3bf80054-be53-4b54-b9bc-3215353bce73" containerID="0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18" exitCode=137
Sep 09 21:11:14.406449 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:14.406450    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:14.406988 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:14.406499    2555 scope.go:117] "RemoveContainer" containerID="0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18"
Sep 09 21:11:14.416395 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:14.416376    2555 scope.go:117] "RemoveContainer" containerID="0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18"
Sep 09 21:11:14.416676 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:14.416660    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18\": container with ID starting with 0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18 not found: ID does not exist" containerID="0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18"
Sep 09 21:11:14.416722 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:14.416685    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18"} err="failed to get container status \"0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18\": rpc error: code = NotFound desc = could not find container \"0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18\": container with ID starting with 0745ad768d157465aed03a3f6818597229405eb455cdecd8090b72d36e4f3f18 not found: ID does not exist"
Sep 09 21:11:14.417121 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:14.417104    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7540-686648\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="3bf80054-be53-4b54-b9bc-3215353bce73" pod="opendatahub/test-curl-7540-686648"
Sep 09 21:11:15.431594 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:15.431557    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bf80054-be53-4b54-b9bc-3215353bce73" path="/var/lib/kubelet/pods/3bf80054-be53-4b54-b9bc-3215353bce73/volumes"
Sep 09 21:11:15.580639 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:15.580617    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-756316"
Sep 09 21:11:15.699859 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:15.699777    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gbwr\" (UniqueName: \"kubernetes.io/projected/1e817c68-e140-4282-977e-4a6199cc9b9c-kube-api-access-5gbwr\") pod \"1e817c68-e140-4282-977e-4a6199cc9b9c\" (UID: \"1e817c68-e140-4282-977e-4a6199cc9b9c\") "
Sep 09 21:11:15.702010 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:15.701978    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e817c68-e140-4282-977e-4a6199cc9b9c-kube-api-access-5gbwr" (OuterVolumeSpecName: "kube-api-access-5gbwr") pod "1e817c68-e140-4282-977e-4a6199cc9b9c" (UID: "1e817c68-e140-4282-977e-4a6199cc9b9c"). InnerVolumeSpecName "kube-api-access-5gbwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:11:15.800995 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:15.800957    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gbwr\" (UniqueName: \"kubernetes.io/projected/1e817c68-e140-4282-977e-4a6199cc9b9c-kube-api-access-5gbwr\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:11:16.421980 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:16.421942    2555 generic.go:356] "Generic (PLEG): container finished" podID="1e817c68-e140-4282-977e-4a6199cc9b9c" containerID="07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4" exitCode=137
Sep 09 21:11:16.421980 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:16.421983    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7540-756316"
Sep 09 21:11:16.422226 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:16.422035    2555 scope.go:117] "RemoveContainer" containerID="07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4"
Sep 09 21:11:16.431698 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:16.431681    2555 scope.go:117] "RemoveContainer" containerID="07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4"
Sep 09 21:11:16.432024 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:16.431978    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4\": container with ID starting with 07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4 not found: ID does not exist" containerID="07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4"
Sep 09 21:11:16.432024 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:11:16.431975    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7540-756316\" is forbidden: User \"system:node:ip-10-0-135-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-158.ec2.internal' and this object" podUID="1e817c68-e140-4282-977e-4a6199cc9b9c" pod="opendatahub/test-curl-7540-756316"
Sep 09 21:11:16.432121 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:16.432013    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4"} err="failed to get container status \"07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4\": rpc error: code = NotFound desc = could not find container \"07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4\": container with ID starting with 07ce6f12f1efdb0b55a40d75c911d213e145e8f5e0048115197033c28d2bb9a4 not found: ID does not exist"
Sep 09 21:11:17.430591 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:11:17.430558    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e817c68-e140-4282-977e-4a6199cc9b9c" path="/var/lib/kubelet/pods/1e817c68-e140-4282-977e-4a6199cc9b9c/volumes"
Sep 09 21:12:24.854692 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.854659    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"]
Sep 09 21:12:24.855138 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.855051    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e817c68-e140-4282-977e-4a6199cc9b9c" containerName="test-curl-7540-756316"
Sep 09 21:12:24.855138 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.855064    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e817c68-e140-4282-977e-4a6199cc9b9c" containerName="test-curl-7540-756316"
Sep 09 21:12:24.855138 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.855131    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e817c68-e140-4282-977e-4a6199cc9b9c" containerName="test-curl-7540-756316"
Sep 09 21:12:24.857691 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.857666    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:24.860470 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.860441    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-7c0011-serving-cert\""
Sep 09 21:12:24.874394 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.874366    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"]
Sep 09 21:12:24.946115 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.946076    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:24.946308 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.946145    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-metrics-certs\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:24.946308 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.946200    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vchfc\" (UniqueName: \"kubernetes.io/projected/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-kube-api-access-vchfc\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:24.946308 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:24.946261    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.047108 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.047069    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.047316 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.047129    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-metrics-certs\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.047316 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.047157    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vchfc\" (UniqueName: \"kubernetes.io/projected/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-kube-api-access-vchfc\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.047316 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.047205    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.047957 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.047934    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.049732 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.049713    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.049846 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.049801    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-metrics-certs\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.056846 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.056825    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vchfc\" (UniqueName: \"kubernetes.io/projected/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-kube-api-access-vchfc\") pod \"maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.169788 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.169699    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:25.455647 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.455618    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"]
Sep 09 21:12:25.457639 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:12:25.457611    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2f3e7d_e4f4_4a7e_8ac2_a470fa577ef8.slice/crio-868fbc73ed6e8149cc7e986d3e7e4d6816287970b4a73a8b3b6eb107a1c2c950 WatchSource:0}: Error finding container 868fbc73ed6e8149cc7e986d3e7e4d6816287970b4a73a8b3b6eb107a1c2c950: Status 404 returned error can't find the container with id 868fbc73ed6e8149cc7e986d3e7e4d6816287970b4a73a8b3b6eb107a1c2c950
Sep 09 21:12:25.459015 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.458997    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:12:25.834218 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:25.834181    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp" event={"ID":"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8","Type":"ContainerStarted","Data":"868fbc73ed6e8149cc7e986d3e7e4d6816287970b4a73a8b3b6eb107a1c2c950"}
Sep 09 21:12:26.840967 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:26.840931    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp" event={"ID":"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8","Type":"ContainerStarted","Data":"f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611"}
Sep 09 21:12:26.841378 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:26.841038    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:26.885347 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:26.885296    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp" podStartSLOduration=2.436303994 podStartE2EDuration="2.88527861s" totalImagesPullingTime="448.974616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:26.884536214 +0000 UTC m=+1905.941073373" watchObservedRunningTime="2026-09-09 21:12:26.88527861 +0000 UTC m=+1905.941815752"
Sep 09 21:12:32.852387 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:32.852353    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:12:53.689321 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.689283    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"]
Sep 09 21:12:53.693584 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.693557    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.697300 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.697276    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-7d51a3-serving-cert\""
Sep 09 21:12:53.709082 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.709060    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"]
Sep 09 21:12:53.722285 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.722259    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-maas-api-tls\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.722492 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.722462    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfw97\" (UniqueName: \"kubernetes.io/projected/bef40092-f5ff-411c-a508-f32144a68171-kube-api-access-qfw97\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.722623 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.722513    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef40092-f5ff-411c-a508-f32144a68171-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.722693 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.722646    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-metrics-certs\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.823861 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.823826    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-metrics-certs\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.824060 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.823883    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-maas-api-tls\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.824060 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.823946    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfw97\" (UniqueName: \"kubernetes.io/projected/bef40092-f5ff-411c-a508-f32144a68171-kube-api-access-qfw97\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.824060 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.823970    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef40092-f5ff-411c-a508-f32144a68171-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.824060 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:12:53.823996    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-serving-cert: secret "maas-api-e2e-ipp-b-7d51a3-serving-cert" not found
Sep 09 21:12:53.824232 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:12:53.824072    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-maas-api-tls podName:bef40092-f5ff-411c-a508-f32144a68171 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:54.32405028 +0000 UTC m=+1933.380587403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-maas-api-tls") pod "maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69" (UID: "bef40092-f5ff-411c-a508-f32144a68171") : secret "maas-api-e2e-ipp-b-7d51a3-serving-cert" not found
Sep 09 21:12:53.824653 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.824634    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef40092-f5ff-411c-a508-f32144a68171-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.826499 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.826475    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-metrics-certs\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:53.836362 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:53.836339    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfw97\" (UniqueName: \"kubernetes.io/projected/bef40092-f5ff-411c-a508-f32144a68171-kube-api-access-qfw97\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:54.330266 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:54.330231    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-maas-api-tls\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:54.333070 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:54.333043    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-maas-api-tls\") pod \"maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:54.608230 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:54.608144    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:54.898340 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:54.898311    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"]
Sep 09 21:12:54.900406 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:12:54.900377    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef40092_f5ff_411c_a508_f32144a68171.slice/crio-82ce3686798b67c83e6b80d279b1ff5551b34ea03853e1bf7d67d91f24f88cd9 WatchSource:0}: Error finding container 82ce3686798b67c83e6b80d279b1ff5551b34ea03853e1bf7d67d91f24f88cd9: Status 404 returned error can't find the container with id 82ce3686798b67c83e6b80d279b1ff5551b34ea03853e1bf7d67d91f24f88cd9
Sep 09 21:12:55.009768 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:55.009731    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69" event={"ID":"bef40092-f5ff-411c-a508-f32144a68171","Type":"ContainerStarted","Data":"82ce3686798b67c83e6b80d279b1ff5551b34ea03853e1bf7d67d91f24f88cd9"}
Sep 09 21:12:56.017359 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:56.017313    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69" event={"ID":"bef40092-f5ff-411c-a508-f32144a68171","Type":"ContainerStarted","Data":"bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13"}
Sep 09 21:12:56.017766 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:56.017502    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:12:56.042690 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:12:56.042635    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69" podStartSLOduration=2.665886916 podStartE2EDuration="3.042618939s" totalImagesPullingTime="376.732023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:56.041151998 +0000 UTC m=+1935.097689139" watchObservedRunningTime="2026-09-09 21:12:56.042618939 +0000 UTC m=+1935.099156081"
Sep 09 21:13:02.028951 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:13:02.028893    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:13:22.698304 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:13:22.698267    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-f6bkm_a3983dcb-acac-4a61-bd54-8c6acf9e940d/payload-processing/0.log"
Sep 09 21:13:58.826585 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:13:58.826553    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-f6bkm_a3983dcb-acac-4a61-bd54-8c6acf9e940d/payload-processing/0.log"
Sep 09 21:14:04.265838 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.265805    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"]
Sep 09 21:14:04.268474 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.268456    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.272062 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.272040    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-5fc36f-serving-cert\""
Sep 09 21:14:04.285962 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.285932    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"]
Sep 09 21:14:04.391435 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.391393    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.391435 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.391440    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfd47\" (UniqueName: \"kubernetes.io/projected/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-kube-api-access-vfd47\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.391673 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.391462    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.391673 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.391552    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.492657 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.492614    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.492657 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.492661    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfd47\" (UniqueName: \"kubernetes.io/projected/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-kube-api-access-vfd47\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.492959 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.492680    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.492959 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.492726    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.493406 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.493369    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.495338 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.495315    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.495450 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.495431    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.504102 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.504078    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfd47\" (UniqueName: \"kubernetes.io/projected/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-kube-api-access-vfd47\") pod \"maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.580519 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.580480    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:04.862418 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:04.862389    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"]
Sep 09 21:14:04.864993 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:14:04.864962    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be34eef_67bd_4c4b_82bf_dfb0ddaad134.slice/crio-c53823ebc34d4143c7cf22ec574be9891ec7e8d6db1c720cbc4fa745a6b58a62 WatchSource:0}: Error finding container c53823ebc34d4143c7cf22ec574be9891ec7e8d6db1c720cbc4fa745a6b58a62: Status 404 returned error can't find the container with id c53823ebc34d4143c7cf22ec574be9891ec7e8d6db1c720cbc4fa745a6b58a62
Sep 09 21:14:05.410777 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:05.410740    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn" event={"ID":"5be34eef-67bd-4c4b-82bf-dfb0ddaad134","Type":"ContainerStarted","Data":"ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92"}
Sep 09 21:14:05.411139 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:05.410806    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn" event={"ID":"5be34eef-67bd-4c4b-82bf-dfb0ddaad134","Type":"ContainerStarted","Data":"c53823ebc34d4143c7cf22ec574be9891ec7e8d6db1c720cbc4fa745a6b58a62"}
Sep 09 21:14:05.411139 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:05.410840    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:05.438877 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:05.438816    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn" podStartSLOduration=1.007093654 podStartE2EDuration="1.438799265s" totalImagesPullingTime="431.705611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:14:05.43703653 +0000 UTC m=+2004.493573673" watchObservedRunningTime="2026-09-09 21:14:05.438799265 +0000 UTC m=+2004.495336406"
Sep 09 21:14:11.422542 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:11.422502    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:35.199506 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.199474    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"]
Sep 09 21:14:35.200039 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.199691    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn" podUID="5be34eef-67bd-4c4b-82bf-dfb0ddaad134" containerName="maas-api" containerID="cri-o://ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92" gracePeriod=30
Sep 09 21:14:35.460707 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.460636    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:35.584086 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.584051    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-maas-api-tls\") pod \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") "
Sep 09 21:14:35.584086 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.584089    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfd47\" (UniqueName: \"kubernetes.io/projected/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-kube-api-access-vfd47\") pod \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") "
Sep 09 21:14:35.584305 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.584128    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-openshift-service-ca\") pod \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") "
Sep 09 21:14:35.584305 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.584152    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-metrics-certs\") pod \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\" (UID: \"5be34eef-67bd-4c4b-82bf-dfb0ddaad134\") "
Sep 09 21:14:35.584537 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.584508    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5be34eef-67bd-4c4b-82bf-dfb0ddaad134" (UID: "5be34eef-67bd-4c4b-82bf-dfb0ddaad134"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:14:35.586534 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.586501    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-kube-api-access-vfd47" (OuterVolumeSpecName: "kube-api-access-vfd47") pod "5be34eef-67bd-4c4b-82bf-dfb0ddaad134" (UID: "5be34eef-67bd-4c4b-82bf-dfb0ddaad134"). InnerVolumeSpecName "kube-api-access-vfd47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:14:35.586634 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.586552    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5be34eef-67bd-4c4b-82bf-dfb0ddaad134" (UID: "5be34eef-67bd-4c4b-82bf-dfb0ddaad134"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:14:35.586634 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.586564    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5be34eef-67bd-4c4b-82bf-dfb0ddaad134" (UID: "5be34eef-67bd-4c4b-82bf-dfb0ddaad134"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:14:35.600061 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.600029    2555 generic.go:356] "Generic (PLEG): container finished" podID="5be34eef-67bd-4c4b-82bf-dfb0ddaad134" containerID="ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92" exitCode=0
Sep 09 21:14:35.600200 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.600077    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"
Sep 09 21:14:35.600200 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.600119    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn" event={"ID":"5be34eef-67bd-4c4b-82bf-dfb0ddaad134","Type":"ContainerDied","Data":"ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92"}
Sep 09 21:14:35.600200 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.600181    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn" event={"ID":"5be34eef-67bd-4c4b-82bf-dfb0ddaad134","Type":"ContainerDied","Data":"c53823ebc34d4143c7cf22ec574be9891ec7e8d6db1c720cbc4fa745a6b58a62"}
Sep 09 21:14:35.600375 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.600210    2555 scope.go:117] "RemoveContainer" containerID="ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92"
Sep 09 21:14:35.610665 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.610646    2555 scope.go:117] "RemoveContainer" containerID="ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92"
Sep 09 21:14:35.610980 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:14:35.610961    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92\": container with ID starting with ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92 not found: ID does not exist" containerID="ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92"
Sep 09 21:14:35.611072 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.610989    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92"} err="failed to get container status \"ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92\": rpc error: code = NotFound desc = could not find container \"ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92\": container with ID starting with ef83fde94254a8d7f90d35aedd09a8994af61cd804b0f22ba5f8017717690d92 not found: ID does not exist"
Sep 09 21:14:35.641714 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.641687    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"]
Sep 09 21:14:35.664328 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.664301    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fc36f-54c6b7648c-mpqzn"]
Sep 09 21:14:35.685614 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.685587    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:14:35.685614 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.685612    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfd47\" (UniqueName: \"kubernetes.io/projected/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-kube-api-access-vfd47\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:14:35.685785 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.685622    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:14:35.685785 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:35.685631    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5be34eef-67bd-4c4b-82bf-dfb0ddaad134-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:14:37.431310 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:14:37.431275    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5be34eef-67bd-4c4b-82bf-dfb0ddaad134" path="/var/lib/kubelet/pods/5be34eef-67bd-4c4b-82bf-dfb0ddaad134/volumes"
Sep 09 21:15:01.727710 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:01.727675    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"]
Sep 09 21:15:01.728177 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:01.727916    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp" podUID="9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" containerName="maas-api" containerID="cri-o://f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611" gracePeriod=30
Sep 09 21:15:02.001149 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.001071    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:15:02.021024 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.020989    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-metrics-certs\") pod \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") "
Sep 09 21:15:02.021224 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.021063    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-maas-api-tls\") pod \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") "
Sep 09 21:15:02.021224 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.021107    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-openshift-service-ca\") pod \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") "
Sep 09 21:15:02.021224 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.021181    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vchfc\" (UniqueName: \"kubernetes.io/projected/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-kube-api-access-vchfc\") pod \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\" (UID: \"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8\") "
Sep 09 21:15:02.021658 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.021632    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" (UID: "9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:15:02.023930 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.023877    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" (UID: "9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:15:02.023930 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.023887    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" (UID: "9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:15:02.024253 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.024225    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-kube-api-access-vchfc" (OuterVolumeSpecName: "kube-api-access-vchfc") pod "9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" (UID: "9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8"). InnerVolumeSpecName "kube-api-access-vchfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:15:02.121919 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.121878    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:15:02.122108 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.121929    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:15:02.122108 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.121939    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vchfc\" (UniqueName: \"kubernetes.io/projected/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-kube-api-access-vchfc\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:15:02.122108 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.121948    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:15:02.767633 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.767550    2555 generic.go:356] "Generic (PLEG): container finished" podID="9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" containerID="f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611" exitCode=0
Sep 09 21:15:02.767633 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.767615    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"
Sep 09 21:15:02.768157 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.767642    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp" event={"ID":"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8","Type":"ContainerDied","Data":"f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611"}
Sep 09 21:15:02.768157 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.767707    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp" event={"ID":"9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8","Type":"ContainerDied","Data":"868fbc73ed6e8149cc7e986d3e7e4d6816287970b4a73a8b3b6eb107a1c2c950"}
Sep 09 21:15:02.768157 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.767753    2555 scope.go:117] "RemoveContainer" containerID="f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611"
Sep 09 21:15:02.777770 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.777749    2555 scope.go:117] "RemoveContainer" containerID="f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611"
Sep 09 21:15:02.778069 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:15:02.778052    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611\": container with ID starting with f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611 not found: ID does not exist" containerID="f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611"
Sep 09 21:15:02.778139 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.778078    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611"} err="failed to get container status \"f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611\": rpc error: code = NotFound desc = could not find container \"f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611\": container with ID starting with f430e44f569fd84afa22d98b8061da65fe120d205fa8999df17d4c09d6468611 not found: ID does not exist"
Sep 09 21:15:02.791533 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.791510    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"]
Sep 09 21:15:02.802216 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:02.796314    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c0011-7c9dd8ff79-hm7hp"]
Sep 09 21:15:03.434548 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:15:03.434513    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" path="/var/lib/kubelet/pods/9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8/volumes"
Sep 09 21:16:08.281668 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.281632    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"]
Sep 09 21:16:08.282287 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.281894    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69" podUID="bef40092-f5ff-411c-a508-f32144a68171" containerName="maas-api" containerID="cri-o://bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13" gracePeriod=30
Sep 09 21:16:08.545228 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.545193    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:16:08.634582 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.634546    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfw97\" (UniqueName: \"kubernetes.io/projected/bef40092-f5ff-411c-a508-f32144a68171-kube-api-access-qfw97\") pod \"bef40092-f5ff-411c-a508-f32144a68171\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") "
Sep 09 21:16:08.634808 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.634593    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-metrics-certs\") pod \"bef40092-f5ff-411c-a508-f32144a68171\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") "
Sep 09 21:16:08.634808 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.634631    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef40092-f5ff-411c-a508-f32144a68171-openshift-service-ca\") pod \"bef40092-f5ff-411c-a508-f32144a68171\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") "
Sep 09 21:16:08.634808 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.634691    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-maas-api-tls\") pod \"bef40092-f5ff-411c-a508-f32144a68171\" (UID: \"bef40092-f5ff-411c-a508-f32144a68171\") "
Sep 09 21:16:08.635091 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.635064    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bef40092-f5ff-411c-a508-f32144a68171-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bef40092-f5ff-411c-a508-f32144a68171" (UID: "bef40092-f5ff-411c-a508-f32144a68171"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:16:08.637095 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.637040    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bef40092-f5ff-411c-a508-f32144a68171" (UID: "bef40092-f5ff-411c-a508-f32144a68171"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:16:08.637215 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.637100    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bef40092-f5ff-411c-a508-f32144a68171" (UID: "bef40092-f5ff-411c-a508-f32144a68171"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:16:08.637215 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.637138    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bef40092-f5ff-411c-a508-f32144a68171-kube-api-access-qfw97" (OuterVolumeSpecName: "kube-api-access-qfw97") pod "bef40092-f5ff-411c-a508-f32144a68171" (UID: "bef40092-f5ff-411c-a508-f32144a68171"). InnerVolumeSpecName "kube-api-access-qfw97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:16:08.735817 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.735775    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfw97\" (UniqueName: \"kubernetes.io/projected/bef40092-f5ff-411c-a508-f32144a68171-kube-api-access-qfw97\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:08.735817 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.735810    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:08.735817 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.735820    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef40092-f5ff-411c-a508-f32144a68171-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:08.735817 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:08.735828    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bef40092-f5ff-411c-a508-f32144a68171-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:09.173818 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.173779    2555 generic.go:356] "Generic (PLEG): container finished" podID="bef40092-f5ff-411c-a508-f32144a68171" containerID="bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13" exitCode=0
Sep 09 21:16:09.174050 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.173824    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"
Sep 09 21:16:09.174050 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.173858    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69" event={"ID":"bef40092-f5ff-411c-a508-f32144a68171","Type":"ContainerDied","Data":"bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13"}
Sep 09 21:16:09.174050 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.173948    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69" event={"ID":"bef40092-f5ff-411c-a508-f32144a68171","Type":"ContainerDied","Data":"82ce3686798b67c83e6b80d279b1ff5551b34ea03853e1bf7d67d91f24f88cd9"}
Sep 09 21:16:09.174050 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.173975    2555 scope.go:117] "RemoveContainer" containerID="bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13"
Sep 09 21:16:09.184361 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.184342    2555 scope.go:117] "RemoveContainer" containerID="bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13"
Sep 09 21:16:09.184724 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:16:09.184698    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13\": container with ID starting with bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13 not found: ID does not exist" containerID="bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13"
Sep 09 21:16:09.184810 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.184732    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13"} err="failed to get container status \"bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13\": rpc error: code = NotFound desc = could not find container \"bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13\": container with ID starting with bcbcfc9c9a86473cfd28598babeb80c7be5fdae9612f9e6c9ea94c1bdd6f1e13 not found: ID does not exist"
Sep 09 21:16:09.213162 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.213119    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"]
Sep 09 21:16:09.221292 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.221250    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7d51a3-857ccb884f-m8j69"]
Sep 09 21:16:09.431545 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:09.431452    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bef40092-f5ff-411c-a508-f32144a68171" path="/var/lib/kubelet/pods/bef40092-f5ff-411c-a508-f32144a68171/volumes"
Sep 09 21:16:26.384290 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.384235    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"]
Sep 09 21:16:26.384770 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.384459    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt" podUID="a39762fa-569b-4954-b6b2-281e9e686ee9" containerName="maas-api" containerID="cri-o://be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0" gracePeriod=30
Sep 09 21:16:26.642047 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.641973    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:16:26.813429 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.813386    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-maas-api-tls\") pod \"a39762fa-569b-4954-b6b2-281e9e686ee9\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") "
Sep 09 21:16:26.813632 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.813454    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtvf8\" (UniqueName: \"kubernetes.io/projected/a39762fa-569b-4954-b6b2-281e9e686ee9-kube-api-access-rtvf8\") pod \"a39762fa-569b-4954-b6b2-281e9e686ee9\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") "
Sep 09 21:16:26.813632 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.813501    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39762fa-569b-4954-b6b2-281e9e686ee9-openshift-service-ca\") pod \"a39762fa-569b-4954-b6b2-281e9e686ee9\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") "
Sep 09 21:16:26.813632 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.813582    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-metrics-certs\") pod \"a39762fa-569b-4954-b6b2-281e9e686ee9\" (UID: \"a39762fa-569b-4954-b6b2-281e9e686ee9\") "
Sep 09 21:16:26.813979 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.813896    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a39762fa-569b-4954-b6b2-281e9e686ee9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a39762fa-569b-4954-b6b2-281e9e686ee9" (UID: "a39762fa-569b-4954-b6b2-281e9e686ee9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:16:26.815774 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.815748    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a39762fa-569b-4954-b6b2-281e9e686ee9" (UID: "a39762fa-569b-4954-b6b2-281e9e686ee9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:16:26.816269 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.816242    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a39762fa-569b-4954-b6b2-281e9e686ee9" (UID: "a39762fa-569b-4954-b6b2-281e9e686ee9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:16:26.816359 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.816337    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39762fa-569b-4954-b6b2-281e9e686ee9-kube-api-access-rtvf8" (OuterVolumeSpecName: "kube-api-access-rtvf8") pod "a39762fa-569b-4954-b6b2-281e9e686ee9" (UID: "a39762fa-569b-4954-b6b2-281e9e686ee9"). InnerVolumeSpecName "kube-api-access-rtvf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:16:26.914713 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.914624    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:26.914713 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.914654    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39762fa-569b-4954-b6b2-281e9e686ee9-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:26.914713 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.914663    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtvf8\" (UniqueName: \"kubernetes.io/projected/a39762fa-569b-4954-b6b2-281e9e686ee9-kube-api-access-rtvf8\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:26.914713 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:26.914675    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39762fa-569b-4954-b6b2-281e9e686ee9-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:27.292789 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.292748    2555 generic.go:356] "Generic (PLEG): container finished" podID="a39762fa-569b-4954-b6b2-281e9e686ee9" containerID="be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0" exitCode=0
Sep 09 21:16:27.293025 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.292793    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"
Sep 09 21:16:27.293025 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.292836    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt" event={"ID":"a39762fa-569b-4954-b6b2-281e9e686ee9","Type":"ContainerDied","Data":"be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0"}
Sep 09 21:16:27.293025 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.292915    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt" event={"ID":"a39762fa-569b-4954-b6b2-281e9e686ee9","Type":"ContainerDied","Data":"13f6fda6fe47d432743dc0bb61d29a289f5ded424cc03854ff6d49486a12845c"}
Sep 09 21:16:27.293025 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.292949    2555 scope.go:117] "RemoveContainer" containerID="be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0"
Sep 09 21:16:27.304493 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.304471    2555 scope.go:117] "RemoveContainer" containerID="be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0"
Sep 09 21:16:27.304929 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:16:27.304855    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0\": container with ID starting with be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0 not found: ID does not exist" containerID="be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0"
Sep 09 21:16:27.304929 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.304889    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0"} err="failed to get container status \"be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0\": rpc error: code = NotFound desc = could not find container \"be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0\": container with ID starting with be3b8cd7216dcd9dc107fec0bed38db97a5c077a44b40d0d52a0c8a7a8a23eb0 not found: ID does not exist"
Sep 09 21:16:27.323593 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.323552    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"]
Sep 09 21:16:27.326821 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.326790    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-615c6f-8f78bfb77-672mt"]
Sep 09 21:16:27.431594 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:27.431544    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a39762fa-569b-4954-b6b2-281e9e686ee9" path="/var/lib/kubelet/pods/a39762fa-569b-4954-b6b2-281e9e686ee9/volumes"
Sep 09 21:16:44.751197 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:44.751153    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"]
Sep 09 21:16:44.751648 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:44.751353    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j" podUID="c8d619ae-758d-469a-91f6-d5ee92bf5e4f" containerName="maas-api" containerID="cri-o://71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642" gracePeriod=30
Sep 09 21:16:45.010572 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.010508    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:16:45.061152 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.061116    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9qft\" (UniqueName: \"kubernetes.io/projected/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-kube-api-access-d9qft\") pod \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") "
Sep 09 21:16:45.061152 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.061154    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-openshift-service-ca\") pod \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") "
Sep 09 21:16:45.061351 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.061187    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-metrics-certs\") pod \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") "
Sep 09 21:16:45.061351 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.061211    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-maas-api-tls\") pod \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\" (UID: \"c8d619ae-758d-469a-91f6-d5ee92bf5e4f\") "
Sep 09 21:16:45.061496 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.061474    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8d619ae-758d-469a-91f6-d5ee92bf5e4f" (UID: "c8d619ae-758d-469a-91f6-d5ee92bf5e4f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:16:45.063473 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.063447    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-kube-api-access-d9qft" (OuterVolumeSpecName: "kube-api-access-d9qft") pod "c8d619ae-758d-469a-91f6-d5ee92bf5e4f" (UID: "c8d619ae-758d-469a-91f6-d5ee92bf5e4f"). InnerVolumeSpecName "kube-api-access-d9qft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:16:45.063594 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.063486    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c8d619ae-758d-469a-91f6-d5ee92bf5e4f" (UID: "c8d619ae-758d-469a-91f6-d5ee92bf5e4f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:16:45.063594 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.063504    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8d619ae-758d-469a-91f6-d5ee92bf5e4f" (UID: "c8d619ae-758d-469a-91f6-d5ee92bf5e4f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:16:45.162912 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.162877    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9qft\" (UniqueName: \"kubernetes.io/projected/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-kube-api-access-d9qft\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:45.163063 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.162927    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:45.163063 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.162938    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:45.163063 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.162947    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8d619ae-758d-469a-91f6-d5ee92bf5e4f-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:16:45.396330 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.396290    2555 generic.go:356] "Generic (PLEG): container finished" podID="c8d619ae-758d-469a-91f6-d5ee92bf5e4f" containerID="71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642" exitCode=0
Sep 09 21:16:45.396508 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.396384    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j" event={"ID":"c8d619ae-758d-469a-91f6-d5ee92bf5e4f","Type":"ContainerDied","Data":"71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642"}
Sep 09 21:16:45.396508 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.396439    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j" event={"ID":"c8d619ae-758d-469a-91f6-d5ee92bf5e4f","Type":"ContainerDied","Data":"71edf346b49959bf43d78ef0546cf6b178b74714b8c413dc8dd72839f6120d45"}
Sep 09 21:16:45.396508 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.396476    2555 scope.go:117] "RemoveContainer" containerID="71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642"
Sep 09 21:16:45.396617 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.396390    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"
Sep 09 21:16:45.407111 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.407087    2555 scope.go:117] "RemoveContainer" containerID="71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642"
Sep 09 21:16:45.407395 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:16:45.407376    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642\": container with ID starting with 71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642 not found: ID does not exist" containerID="71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642"
Sep 09 21:16:45.407454 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.407405    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642"} err="failed to get container status \"71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642\": rpc error: code = NotFound desc = could not find container \"71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642\": container with ID starting with 71908228f481358e46d9af3bc46377855ef98d87a1c8ca85bc8d69fe04dc6642 not found: ID does not exist"
Sep 09 21:16:45.421743 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.421718    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"]
Sep 09 21:16:45.430542 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:45.430521    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-0b5d4c-b5fbf7f4c-bmf9j"]
Sep 09 21:16:47.430947 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:16:47.430883    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8d619ae-758d-469a-91f6-d5ee92bf5e4f" path="/var/lib/kubelet/pods/c8d619ae-758d-469a-91f6-d5ee92bf5e4f/volumes"
Sep 09 21:19:31.032717 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:31.032681    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"]
Sep 09 21:19:31.033213 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:31.032930    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager" containerID="cri-o://b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0" gracePeriod=10
Sep 09 21:19:33.476587 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:33.476549    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 21:19:33.578333 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:33.578232    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c45k9\" (UniqueName: \"kubernetes.io/projected/8dc81062-339d-4efd-9d78-bb38fa422930-kube-api-access-c45k9\") pod \"8dc81062-339d-4efd-9d78-bb38fa422930\" (UID: \"8dc81062-339d-4efd-9d78-bb38fa422930\") "
Sep 09 21:19:33.578522 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:33.578340    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8dc81062-339d-4efd-9d78-bb38fa422930-extensions-socket-volume\") pod \"8dc81062-339d-4efd-9d78-bb38fa422930\" (UID: \"8dc81062-339d-4efd-9d78-bb38fa422930\") "
Sep 09 21:19:33.578761 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:33.578733    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dc81062-339d-4efd-9d78-bb38fa422930-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8dc81062-339d-4efd-9d78-bb38fa422930" (UID: "8dc81062-339d-4efd-9d78-bb38fa422930"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:19:33.580689 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:33.580653    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc81062-339d-4efd-9d78-bb38fa422930-kube-api-access-c45k9" (OuterVolumeSpecName: "kube-api-access-c45k9") pod "8dc81062-339d-4efd-9d78-bb38fa422930" (UID: "8dc81062-339d-4efd-9d78-bb38fa422930"). InnerVolumeSpecName "kube-api-access-c45k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:19:33.679841 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:33.679800    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c45k9\" (UniqueName: \"kubernetes.io/projected/8dc81062-339d-4efd-9d78-bb38fa422930-kube-api-access-c45k9\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:19:33.679841 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:33.679833    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8dc81062-339d-4efd-9d78-bb38fa422930-extensions-socket-volume\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:19:34.331831 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.331796    2555 generic.go:356] "Generic (PLEG): container finished" podID="8dc81062-339d-4efd-9d78-bb38fa422930" containerID="b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0" exitCode=0
Sep 09 21:19:34.332064 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.331842    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"
Sep 09 21:19:34.332064 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.331878    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" event={"ID":"8dc81062-339d-4efd-9d78-bb38fa422930","Type":"ContainerDied","Data":"b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0"}
Sep 09 21:19:34.332064 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.331962    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp" event={"ID":"8dc81062-339d-4efd-9d78-bb38fa422930","Type":"ContainerDied","Data":"67471c77b0ac1b41beb6ed54bb3c93ccdaf9843a6b437c0f34f607dabd33a5aa"}
Sep 09 21:19:34.332064 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.331994    2555 scope.go:117] "RemoveContainer" containerID="b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0"
Sep 09 21:19:34.342364 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.342349    2555 scope.go:117] "RemoveContainer" containerID="201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5"
Sep 09 21:19:34.350983 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.350808    2555 scope.go:117] "RemoveContainer" containerID="b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0"
Sep 09 21:19:34.351165 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:19:34.351140    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0\": container with ID starting with b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0 not found: ID does not exist" containerID="b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0"
Sep 09 21:19:34.351217 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.351173    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0"} err="failed to get container status \"b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0\": rpc error: code = NotFound desc = could not find container \"b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0\": container with ID starting with b12cf7349a69bd199574153be4033f796e3aecdb5b661b0c9d5a0fd4e90859d0 not found: ID does not exist"
Sep 09 21:19:34.351217 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.351190    2555 scope.go:117] "RemoveContainer" containerID="201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5"
Sep 09 21:19:34.351486 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:19:34.351454    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5\": container with ID starting with 201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5 not found: ID does not exist" containerID="201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5"
Sep 09 21:19:34.351528 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.351491    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5"} err="failed to get container status \"201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5\": rpc error: code = NotFound desc = could not find container \"201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5\": container with ID starting with 201ee5d86d6ea5d6e51d3be03dddc6dd17dbf62286495e3970a6211cc9911ce5 not found: ID does not exist"
Sep 09 21:19:34.357779 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.357752    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"]
Sep 09 21:19:34.366381 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:34.366358    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-69mrp"]
Sep 09 21:19:35.430535 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:19:35.430503    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" path="/var/lib/kubelet/pods/8dc81062-339d-4efd-9d78-bb38fa422930/volumes"
Sep 09 21:20:31.713994 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.713953    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"]
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714314    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714326    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714335    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714340    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714347    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef40092-f5ff-411c-a508-f32144a68171" containerName="maas-api"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714352    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef40092-f5ff-411c-a508-f32144a68171" containerName="maas-api"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714371    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39762fa-569b-4954-b6b2-281e9e686ee9" containerName="maas-api"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714377    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39762fa-569b-4954-b6b2-281e9e686ee9" containerName="maas-api"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714382    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d619ae-758d-469a-91f6-d5ee92bf5e4f" containerName="maas-api"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714388    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d619ae-758d-469a-91f6-d5ee92bf5e4f" containerName="maas-api"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714399    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" containerName="maas-api"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714403    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" containerName="maas-api"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714410    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be34eef-67bd-4c4b-82bf-dfb0ddaad134" containerName="maas-api"
Sep 09 21:20:31.714411 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714415    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be34eef-67bd-4c4b-82bf-dfb0ddaad134" containerName="maas-api"
Sep 09 21:20:31.714842 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714468    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager"
Sep 09 21:20:31.714842 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714475    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager"
Sep 09 21:20:31.714842 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714484    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a39762fa-569b-4954-b6b2-281e9e686ee9" containerName="maas-api"
Sep 09 21:20:31.714842 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714490    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be34eef-67bd-4c4b-82bf-dfb0ddaad134" containerName="maas-api"
Sep 09 21:20:31.714842 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714496    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d619ae-758d-469a-91f6-d5ee92bf5e4f" containerName="maas-api"
Sep 09 21:20:31.714842 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714500    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c2f3e7d-e4f4-4a7e-8ac2-a470fa577ef8" containerName="maas-api"
Sep 09 21:20:31.714842 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.714507    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bef40092-f5ff-411c-a508-f32144a68171" containerName="maas-api"
Sep 09 21:20:31.717530 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.717513    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:31.720308 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.720280    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4gg4f\""
Sep 09 21:20:31.730207 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.730185    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"]
Sep 09 21:20:31.805130 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.805097    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d787eeb9-83eb-42be-9809-c8582028d1ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xw8p2\" (UID: \"d787eeb9-83eb-42be-9809-c8582028d1ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:31.805302 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.805164    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj9bk\" (UniqueName: \"kubernetes.io/projected/d787eeb9-83eb-42be-9809-c8582028d1ff-kube-api-access-pj9bk\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xw8p2\" (UID: \"d787eeb9-83eb-42be-9809-c8582028d1ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:31.906195 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.906158    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj9bk\" (UniqueName: \"kubernetes.io/projected/d787eeb9-83eb-42be-9809-c8582028d1ff-kube-api-access-pj9bk\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xw8p2\" (UID: \"d787eeb9-83eb-42be-9809-c8582028d1ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:31.906368 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.906231    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d787eeb9-83eb-42be-9809-c8582028d1ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xw8p2\" (UID: \"d787eeb9-83eb-42be-9809-c8582028d1ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:31.906586 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.906564    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d787eeb9-83eb-42be-9809-c8582028d1ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xw8p2\" (UID: \"d787eeb9-83eb-42be-9809-c8582028d1ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:31.916202 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:31.916166    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj9bk\" (UniqueName: \"kubernetes.io/projected/d787eeb9-83eb-42be-9809-c8582028d1ff-kube-api-access-pj9bk\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xw8p2\" (UID: \"d787eeb9-83eb-42be-9809-c8582028d1ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:32.027854 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:32.027766    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:32.318612 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:20:32.318576    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd787eeb9_83eb_42be_9809_c8582028d1ff.slice/crio-cbca57a08bfc0216f15b047c1cc3570ec324fa902ec31cc0b164c4f3e1adda48 WatchSource:0}: Error finding container cbca57a08bfc0216f15b047c1cc3570ec324fa902ec31cc0b164c4f3e1adda48: Status 404 returned error can't find the container with id cbca57a08bfc0216f15b047c1cc3570ec324fa902ec31cc0b164c4f3e1adda48
Sep 09 21:20:32.319399 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:32.319370    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"]
Sep 09 21:20:32.654758 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:32.654656    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2" event={"ID":"d787eeb9-83eb-42be-9809-c8582028d1ff","Type":"ContainerStarted","Data":"0d6b4a3db6089b69b4209ca8a8bfb1a3d0a7a3e19ffd49a37ed2abc40f29880d"}
Sep 09 21:20:32.654758 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:32.654728    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:32.654758 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:32.654752    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2" event={"ID":"d787eeb9-83eb-42be-9809-c8582028d1ff","Type":"ContainerStarted","Data":"cbca57a08bfc0216f15b047c1cc3570ec324fa902ec31cc0b164c4f3e1adda48"}
Sep 09 21:20:43.661738 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:43.661704    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2"
Sep 09 21:20:43.688784 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:20:43.688720    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xw8p2" podStartSLOduration=12.68870349 podStartE2EDuration="12.68870349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:20:32.693101796 +0000 UTC m=+2391.749638938" watchObservedRunningTime="2026-09-09 21:20:43.68870349 +0000 UTC m=+2402.745240694"
Sep 09 21:22:20.423442 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.423408    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"]
Sep 09 21:22:20.423849 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.423771    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager"
Sep 09 21:22:20.423849 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.423781    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager"
Sep 09 21:22:20.423849 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.423837    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc81062-339d-4efd-9d78-bb38fa422930" containerName="manager"
Sep 09 21:22:20.426780 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.426764    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.430588 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.430565    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 21:22:20.431623 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.431587    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 21:22:20.431760 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.431634    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 21:22:20.431760 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.431678    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2mhvs\""
Sep 09 21:22:20.431760 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.431634    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 21:22:20.439543 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.439523    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"]
Sep 09 21:22:20.504539 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.504506    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-maas-api-tls\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.504539 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.504544    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w27gl\" (UniqueName: \"kubernetes.io/projected/038823e1-5bd8-48ef-8ac9-76cc21ca1001-kube-api-access-w27gl\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.504797 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.504628    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-metrics-certs\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.504797 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.504669    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038823e1-5bd8-48ef-8ac9-76cc21ca1001-openshift-service-ca\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.605872 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.605830    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-metrics-certs\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.606111 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.605922    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038823e1-5bd8-48ef-8ac9-76cc21ca1001-openshift-service-ca\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.606111 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.605983    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-maas-api-tls\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.606111 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.606005    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w27gl\" (UniqueName: \"kubernetes.io/projected/038823e1-5bd8-48ef-8ac9-76cc21ca1001-kube-api-access-w27gl\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.606814 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.606744    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038823e1-5bd8-48ef-8ac9-76cc21ca1001-openshift-service-ca\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.608498 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.608470    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-metrics-certs\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.608607 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.608556    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-maas-api-tls\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.614732 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.614708    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w27gl\" (UniqueName: \"kubernetes.io/projected/038823e1-5bd8-48ef-8ac9-76cc21ca1001-kube-api-access-w27gl\") pod \"maas-api-6ffbd7f869-rrpvs\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") " pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:20.738482 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:20.738384    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:21.016933 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:21.016890    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"]
Sep 09 21:22:21.018398 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:22:21.018374    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038823e1_5bd8_48ef_8ac9_76cc21ca1001.slice/crio-dcee44243530cca6dab6466ae43f02bcd8ac7748a2edb6e405fdb9175c74283a WatchSource:0}: Error finding container dcee44243530cca6dab6466ae43f02bcd8ac7748a2edb6e405fdb9175c74283a: Status 404 returned error can't find the container with id dcee44243530cca6dab6466ae43f02bcd8ac7748a2edb6e405fdb9175c74283a
Sep 09 21:22:21.019733 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:21.019713    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:22:21.264857 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:21.264814    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs" event={"ID":"038823e1-5bd8-48ef-8ac9-76cc21ca1001","Type":"ContainerStarted","Data":"dcee44243530cca6dab6466ae43f02bcd8ac7748a2edb6e405fdb9175c74283a"}
Sep 09 21:22:22.271733 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:22.271695    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs" event={"ID":"038823e1-5bd8-48ef-8ac9-76cc21ca1001","Type":"ContainerStarted","Data":"aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b"}
Sep 09 21:22:22.272180 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:22.271773    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:22.303784 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:22.303734    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs" podStartSLOduration=1.835623176 podStartE2EDuration="2.303718887s" totalImagesPullingTime="468.095711ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:22:22.302637821 +0000 UTC m=+2501.359174965" watchObservedRunningTime="2026-09-09 21:22:22.303718887 +0000 UTC m=+2501.360256027"
Sep 09 21:22:28.283171 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.283140    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:28.381154 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.381123    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"]
Sep 09 21:22:28.384599 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.384575    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.407328 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.407295    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"]
Sep 09 21:22:28.474684 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.474641    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-maas-api-tls\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.474684 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.474680    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-metrics-certs\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.474936 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.474716    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhczv\" (UniqueName: \"kubernetes.io/projected/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-kube-api-access-zhczv\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.474936 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.474758    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-openshift-service-ca\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.575519 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.575487    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-maas-api-tls\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.575692 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.575541    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-metrics-certs\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.575692 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.575661    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhczv\" (UniqueName: \"kubernetes.io/projected/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-kube-api-access-zhczv\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.575815 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.575713    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-openshift-service-ca\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.576419 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.576332    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-openshift-service-ca\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.578083 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.578059    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-metrics-certs\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.578210 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.578153    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-maas-api-tls\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.584673 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.584654    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhczv\" (UniqueName: \"kubernetes.io/projected/99f0ae58-a364-42ca-a6b1-ec39c63e3cec-kube-api-access-zhczv\") pod \"maas-api-6f8859b88f-2gzxb\" (UID: \"99f0ae58-a364-42ca-a6b1-ec39c63e3cec\") " pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.695880 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.695841    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:28.974614 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:28.974588    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"]
Sep 09 21:22:28.977226 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:22:28.977200    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f0ae58_a364_42ca_a6b1_ec39c63e3cec.slice/crio-95d6f081f97438d725643718dbbddddde00c6993210c99d8ebf770a785ebf4d7 WatchSource:0}: Error finding container 95d6f081f97438d725643718dbbddddde00c6993210c99d8ebf770a785ebf4d7: Status 404 returned error can't find the container with id 95d6f081f97438d725643718dbbddddde00c6993210c99d8ebf770a785ebf4d7
Sep 09 21:22:29.312939 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:29.312888    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb" event={"ID":"99f0ae58-a364-42ca-a6b1-ec39c63e3cec","Type":"ContainerStarted","Data":"95d6f081f97438d725643718dbbddddde00c6993210c99d8ebf770a785ebf4d7"}
Sep 09 21:22:30.319896 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:30.319852    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb" event={"ID":"99f0ae58-a364-42ca-a6b1-ec39c63e3cec","Type":"ContainerStarted","Data":"9d7fdd9b56956a94b7e6a8e4c7c2e3810b942303ddefe30c1fb82e379c0e28cf"}
Sep 09 21:22:30.320399 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:30.320031    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:30.343475 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:30.343430    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb" podStartSLOduration=1.8436690759999999 podStartE2EDuration="2.343417461s" totalImagesPullingTime="499.748385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:22:30.340616169 +0000 UTC m=+2509.397153312" watchObservedRunningTime="2026-09-09 21:22:30.343417461 +0000 UTC m=+2509.399954600"
Sep 09 21:22:36.330313 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:36.330285    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6f8859b88f-2gzxb"
Sep 09 21:22:36.396009 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:36.395975    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"]
Sep 09 21:22:36.396250 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:36.396216    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs" podUID="038823e1-5bd8-48ef-8ac9-76cc21ca1001" containerName="maas-api" containerID="cri-o://aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b" gracePeriod=30
Sep 09 21:22:37.642595 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.642569    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:37.658384 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.658357    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038823e1-5bd8-48ef-8ac9-76cc21ca1001-openshift-service-ca\") pod \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") "
Sep 09 21:22:37.658510 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.658404    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-metrics-certs\") pod \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") "
Sep 09 21:22:37.658510 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.658433    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w27gl\" (UniqueName: \"kubernetes.io/projected/038823e1-5bd8-48ef-8ac9-76cc21ca1001-kube-api-access-w27gl\") pod \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") "
Sep 09 21:22:37.658510 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.658487    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-maas-api-tls\") pod \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\" (UID: \"038823e1-5bd8-48ef-8ac9-76cc21ca1001\") "
Sep 09 21:22:37.658756 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.658721    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038823e1-5bd8-48ef-8ac9-76cc21ca1001-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "038823e1-5bd8-48ef-8ac9-76cc21ca1001" (UID: "038823e1-5bd8-48ef-8ac9-76cc21ca1001"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:22:37.660540 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.660519    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "038823e1-5bd8-48ef-8ac9-76cc21ca1001" (UID: "038823e1-5bd8-48ef-8ac9-76cc21ca1001"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:22:37.660631 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.660573    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038823e1-5bd8-48ef-8ac9-76cc21ca1001-kube-api-access-w27gl" (OuterVolumeSpecName: "kube-api-access-w27gl") pod "038823e1-5bd8-48ef-8ac9-76cc21ca1001" (UID: "038823e1-5bd8-48ef-8ac9-76cc21ca1001"). InnerVolumeSpecName "kube-api-access-w27gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:22:37.660675 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.660631    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "038823e1-5bd8-48ef-8ac9-76cc21ca1001" (UID: "038823e1-5bd8-48ef-8ac9-76cc21ca1001"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:22:37.759545 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.759463    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038823e1-5bd8-48ef-8ac9-76cc21ca1001-openshift-service-ca\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:22:37.759545 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.759495    2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-metrics-certs\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:22:37.759545 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.759507    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w27gl\" (UniqueName: \"kubernetes.io/projected/038823e1-5bd8-48ef-8ac9-76cc21ca1001-kube-api-access-w27gl\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:22:37.759545 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:37.759515    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038823e1-5bd8-48ef-8ac9-76cc21ca1001-maas-api-tls\") on node \"ip-10-0-135-158.ec2.internal\" DevicePath \"\""
Sep 09 21:22:38.363344 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:38.363309    2555 generic.go:356] "Generic (PLEG): container finished" podID="038823e1-5bd8-48ef-8ac9-76cc21ca1001" containerID="aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b" exitCode=0
Sep 09 21:22:38.363541 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:38.363363    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"
Sep 09 21:22:38.363541 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:38.363392    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs" event={"ID":"038823e1-5bd8-48ef-8ac9-76cc21ca1001","Type":"ContainerDied","Data":"aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b"}
Sep 09 21:22:38.363541 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:38.363447    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs" event={"ID":"038823e1-5bd8-48ef-8ac9-76cc21ca1001","Type":"ContainerDied","Data":"dcee44243530cca6dab6466ae43f02bcd8ac7748a2edb6e405fdb9175c74283a"}
Sep 09 21:22:38.363541 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:38.363469    2555 scope.go:117] "RemoveContainer" containerID="aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b"
Sep 09 21:22:38.373588 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:38.373573    2555 scope.go:117] "RemoveContainer" containerID="aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b"
Sep 09 21:22:38.373882 ip-10-0-135-158 kubenswrapper[2555]: E0909 21:22:38.373864    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b\": container with ID starting with aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b not found: ID does not exist" containerID="aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b"
Sep 09 21:22:38.373943 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:38.373891    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b"} err="failed to get container status \"aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b\": rpc error: code = NotFound desc = could not find container \"aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b\": container with ID starting with aec8cac9a03896fa277a88560b9425601eabda376a12dcf72e2151fc78dfc32b not found: ID does not exist"
Sep 09 21:22:38.391551 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:38.391518    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"]
Sep 09 21:22:38.399644 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:38.399613    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ffbd7f869-rrpvs"]
Sep 09 21:22:39.430692 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:39.430657    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="038823e1-5bd8-48ef-8ac9-76cc21ca1001" path="/var/lib/kubelet/pods/038823e1-5bd8-48ef-8ac9-76cc21ca1001/volumes"
Sep 09 21:22:50.191100 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:50.191063    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b49fd485d-wkpbk_2d2382a8-607e-4b9d-bae2-3a18a220fe7e/authorino/0.log"
Sep 09 21:22:56.248980 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:56.248950    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d46659dfc-sfgvg_66478945-9a6b-4e36-90be-ae134d500971/copy-manifests/0.log"
Sep 09 21:22:56.262630 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:56.262599    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d46659dfc-sfgvg_66478945-9a6b-4e36-90be-ae134d500971/manager/0.log"
Sep 09 21:22:56.842008 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:56.841974    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6f8859b88f-2gzxb_99f0ae58-a364-42ca-a6b1-ec39c63e3cec/maas-api/0.log"
Sep 09 21:22:58.075611 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:58.075575    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b49fd485d-wkpbk_2d2382a8-607e-4b9d-bae2-3a18a220fe7e/authorino/0.log"
Sep 09 21:22:58.533607 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:58.533532    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-xw8p2_d787eeb9-83eb-42be-9809-c8582028d1ff/manager/0.log"
Sep 09 21:22:59.327802 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:59.327772    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c8d5d5c67-c62cx_3061d9da-2b59-4084-b6c7-d2207b862cd9/kube-auth-proxy/0.log"
Sep 09 21:22:59.821944 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:22:59.821885    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-f6bkm_a3983dcb-acac-4a61-bd54-8c6acf9e940d/payload-processing/0.log"
Sep 09 21:23:00.498729 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:00.498703    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-l5xs9_2523a081-edff-47f3-b44f-bf548350c37e/main/0.log"
Sep 09 21:23:09.147424 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:09.147388    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hh7dn_8389da71-7435-4fe7-8ef9-698d0f2486c7/global-pull-secret-syncer/0.log"
Sep 09 21:23:09.318291 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:09.318260    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jw6lc_33d147f1-c408-4f83-8a62-85daa68efe74/konnectivity-agent/0.log"
Sep 09 21:23:09.430224 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:09.430119    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-158.ec2.internal_ca53e03ff182c14b08d53f7da0d644e0/haproxy/0.log"
Sep 09 21:23:13.457159 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:13.457125    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b49fd485d-wkpbk_2d2382a8-607e-4b9d-bae2-3a18a220fe7e/authorino/0.log"
Sep 09 21:23:13.695880 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:13.695848    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-xw8p2_d787eeb9-83eb-42be-9809-c8582028d1ff/manager/0.log"
Sep 09 21:23:15.381983 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.381952    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52399550-ac1d-43d7-bd80-81ce65c532a7/alertmanager/0.log"
Sep 09 21:23:15.422454 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.422431    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52399550-ac1d-43d7-bd80-81ce65c532a7/config-reloader/0.log"
Sep 09 21:23:15.453738 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.453709    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52399550-ac1d-43d7-bd80-81ce65c532a7/kube-rbac-proxy-web/0.log"
Sep 09 21:23:15.483598 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.483570    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52399550-ac1d-43d7-bd80-81ce65c532a7/kube-rbac-proxy/0.log"
Sep 09 21:23:15.511255 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.511222    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52399550-ac1d-43d7-bd80-81ce65c532a7/kube-rbac-proxy-metric/0.log"
Sep 09 21:23:15.547774 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.547743    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52399550-ac1d-43d7-bd80-81ce65c532a7/prom-label-proxy/0.log"
Sep 09 21:23:15.577370 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.577341    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52399550-ac1d-43d7-bd80-81ce65c532a7/init-config-reloader/0.log"
Sep 09 21:23:15.620174 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.620142    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-84lsb_d930effb-3a2c-42ef-b110-901daa5ce831/cluster-monitoring-operator/0.log"
Sep 09 21:23:15.650152 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.650081    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-fspcw_aa79e567-0b12-46bc-b317-5c312594c5f5/kube-state-metrics/0.log"
Sep 09 21:23:15.672486 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.672455    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-fspcw_aa79e567-0b12-46bc-b317-5c312594c5f5/kube-rbac-proxy-main/0.log"
Sep 09 21:23:15.701154 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.701129    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-fspcw_aa79e567-0b12-46bc-b317-5c312594c5f5/kube-rbac-proxy-self/0.log"
Sep 09 21:23:15.736873 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.736851    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56579dd9d4-qp97l_8b716ad6-96c2-4eb4-9ac2-ba2394dadbde/metrics-server/0.log"
Sep 09 21:23:15.781417 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.781392    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-qtwsf_f66c97f8-ae57-4407-8559-643a46f53953/monitoring-plugin/0.log"
Sep 09 21:23:15.922019 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.921942    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lrwcb_1a9d3518-c4bc-4874-a211-20d33e2da7c0/node-exporter/0.log"
Sep 09 21:23:15.956062 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.956036    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lrwcb_1a9d3518-c4bc-4874-a211-20d33e2da7c0/kube-rbac-proxy/0.log"
Sep 09 21:23:15.992549 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:15.992525    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lrwcb_1a9d3518-c4bc-4874-a211-20d33e2da7c0/init-textfile/0.log"
Sep 09 21:23:16.656209 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:16.656128    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-j7kml_72a06277-6430-460d-8b88-07153f40361c/prometheus-operator-admission-webhook/0.log"
Sep 09 21:23:16.708178 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:16.708147    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b98474b9-4mn47_f1a597d9-691a-438e-8913-947d5a420526/telemeter-client/0.log"
Sep 09 21:23:16.754917 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:16.754874    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b98474b9-4mn47_f1a597d9-691a-438e-8913-947d5a420526/reload/0.log"
Sep 09 21:23:16.799369 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:16.799340    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b98474b9-4mn47_f1a597d9-691a-438e-8913-947d5a420526/kube-rbac-proxy/0.log"
Sep 09 21:23:18.938159 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:18.938119    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"]
Sep 09 21:23:18.938552 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:18.938490    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038823e1-5bd8-48ef-8ac9-76cc21ca1001" containerName="maas-api"
Sep 09 21:23:18.938552 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:18.938502    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="038823e1-5bd8-48ef-8ac9-76cc21ca1001" containerName="maas-api"
Sep 09 21:23:18.938645 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:18.938578    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="038823e1-5bd8-48ef-8ac9-76cc21ca1001" containerName="maas-api"
Sep 09 21:23:18.941406 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:18.941390    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:18.945732 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:18.945710    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dsjk4\"/\"kube-root-ca.crt\""
Sep 09 21:23:18.945873 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:18.945839    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dsjk4\"/\"openshift-service-ca.crt\""
Sep 09 21:23:18.945978 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:18.945927    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dsjk4\"/\"default-dockercfg-78ph6\""
Sep 09 21:23:18.955943 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:18.955918    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"]
Sep 09 21:23:19.047068 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.047038    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-sys\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.047068 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.047070    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-lib-modules\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.047298 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.047086    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-podres\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.047298 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.047166    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-proc\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.047298 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.047225    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwsgz\" (UniqueName: \"kubernetes.io/projected/150f1d1d-8f28-423d-af05-2592a1117834-kube-api-access-fwsgz\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.148196 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.148148    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-proc\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.148389 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.148231    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwsgz\" (UniqueName: \"kubernetes.io/projected/150f1d1d-8f28-423d-af05-2592a1117834-kube-api-access-fwsgz\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.148389 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.148277    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-proc\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.148389 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.148314    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-sys\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.148389 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.148339    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-lib-modules\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.148389 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.148363    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-podres\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.148389 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.148379    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-sys\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.148620 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.148459    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-lib-modules\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.148620 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.148470    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/150f1d1d-8f28-423d-af05-2592a1117834-podres\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.157071 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.157047    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwsgz\" (UniqueName: \"kubernetes.io/projected/150f1d1d-8f28-423d-af05-2592a1117834-kube-api-access-fwsgz\") pod \"perf-node-gather-daemonset-4mjc2\" (UID: \"150f1d1d-8f28-423d-af05-2592a1117834\") " pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.251528 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.251446    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:19.542933 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.542886    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"]
Sep 09 21:23:19.545192 ip-10-0-135-158 kubenswrapper[2555]: W0909 21:23:19.545162    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod150f1d1d_8f28_423d_af05_2592a1117834.slice/crio-3fb5d762c61be6fb87af83b6ae9d484058c8600c0d52fe37238e75afc5b61a63 WatchSource:0}: Error finding container 3fb5d762c61be6fb87af83b6ae9d484058c8600c0d52fe37238e75afc5b61a63: Status 404 returned error can't find the container with id 3fb5d762c61be6fb87af83b6ae9d484058c8600c0d52fe37238e75afc5b61a63
Sep 09 21:23:19.592954 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.592923    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2" event={"ID":"150f1d1d-8f28-423d-af05-2592a1117834","Type":"ContainerStarted","Data":"3fb5d762c61be6fb87af83b6ae9d484058c8600c0d52fe37238e75afc5b61a63"}
Sep 09 21:23:19.902101 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.902014    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6545c485c8-jbf69_54d1dca7-3dd7-4017-9939-78b84992ab97/console/0.log"
Sep 09 21:23:19.941312 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:19.941281    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-b7s5t_143e5dbf-1f38-4def-a45b-29f993bc00df/download-server/0.log"
Sep 09 21:23:20.600959 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:20.600923    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2" event={"ID":"150f1d1d-8f28-423d-af05-2592a1117834","Type":"ContainerStarted","Data":"655a37ed44b9faf02746f9cee8e6fcc71f62b2103d10ac96ff08a36f89d6505d"}
Sep 09 21:23:20.601197 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:20.601078    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:20.622005 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:20.621957    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2" podStartSLOduration=2.621941005 podStartE2EDuration="2.621941005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:23:20.6194577 +0000 UTC m=+2559.675994842" watchObservedRunningTime="2026-09-09 21:23:20.621941005 +0000 UTC m=+2559.678478146"
Sep 09 21:23:20.728784 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:20.728759    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-56976_72052fb4-4585-4dc4-bcdc-bf8e9992383f/volume-data-source-validator/0.log"
Sep 09 21:23:22.066220 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:22.066186    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rnztl_e606789c-9c2a-441a-8652-fa003893a458/dns/0.log"
Sep 09 21:23:22.092275 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:22.092245    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rnztl_e606789c-9c2a-441a-8652-fa003893a458/kube-rbac-proxy/0.log"
Sep 09 21:23:22.128562 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:22.128529    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7rzt9_2918f9ef-71c5-4062-8256-0298b6c0ee39/dns-node-resolver/0.log"
Sep 09 21:23:22.812009 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:22.811980    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-52qg8_d34c436a-fb65-4ffb-9965-4ac57316f6fc/node-ca/0.log"
Sep 09 21:23:24.225143 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:24.225118    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c8d5d5c67-c62cx_3061d9da-2b59-4084-b6c7-d2207b862cd9/kube-auth-proxy/0.log"
Sep 09 21:23:24.395329 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:24.395290    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-f6bkm_a3983dcb-acac-4a61-bd54-8c6acf9e940d/payload-processing/0.log"
Sep 09 21:23:25.397392 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:25.397355    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lm7hp_76b01924-bfed-4f5a-bc20-211a744910f6/serve-healthcheck-canary/0.log"
Sep 09 21:23:26.126174 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:26.126143    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7mtv_8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a/kube-rbac-proxy/0.log"
Sep 09 21:23:26.155919 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:26.155870    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7mtv_8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a/exporter/0.log"
Sep 09 21:23:26.187095 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:26.187069    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7mtv_8f9f3a97-bfdb-49d7-bf8a-2dabb82fd26a/extractor/0.log"
Sep 09 21:23:26.617993 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:26.617963    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dsjk4/perf-node-gather-daemonset-4mjc2"
Sep 09 21:23:29.628857 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:29.628820    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d46659dfc-sfgvg_66478945-9a6b-4e36-90be-ae134d500971/manager/0.log"
Sep 09 21:23:29.741915 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:29.741880    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d46659dfc-sfgvg_66478945-9a6b-4e36-90be-ae134d500971/copy-manifests/0.log"
Sep 09 21:23:29.990711 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:29.990631    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c8d5d5c67-c62cx_3061d9da-2b59-4084-b6c7-d2207b862cd9/kube-auth-proxy/0.log"
Sep 09 21:23:30.125839 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:30.125793    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-f6bkm_a3983dcb-acac-4a61-bd54-8c6acf9e940d/payload-processing/0.log"
Sep 09 21:23:31.320687 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:31.320651    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58fbd4c7f6-cnjwz_72a0fd72-65d6-4f35-ad30-65decb07f292/manager/0.log"
Sep 09 21:23:31.394290 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:31.394261    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xw4j9_bc990a10-f95f-44d1-8d14-4d002da98c98/openshift-lws-operator/0.log"
Sep 09 21:23:32.067124 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:32.067088    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c8d5d5c67-c62cx_3061d9da-2b59-4084-b6c7-d2207b862cd9/kube-auth-proxy/0.log"
Sep 09 21:23:32.191290 ip-10-0-135-158 kubenswrapper[2555]: I0909 21:23:32.191263    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-f6bkm_a3983dcb-acac-4a61-bd54-8c6acf9e940d/payload-processing/0.log"